Python Deserialization

Open-source Python projects categorized as Deserialization

Top 23 Python Deserialization Projects

Deserialization
  • marshmallow

    A lightweight library for converting complex objects to and from simple Python datatypes.

  • CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  • orjson

    Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

    Project mention: Web scraping of a dynamic website using Python with HTTP Client | dev.to | 2024-09-28

    The library already has support for an HTTP client that allows bypassing Cloudflare - CurlImpersonateHttpClient. Since we have to work with JSON responses we could use parsel_crawler added in version 0.3.0, but I think this is excessive for such tasks, besides I like the high speed of orjson.. Therefore, we'll need to implement our crawler rather than using one of the ready-made ones.

  • Schematics

    Python Data Structures for Humans™.

  • msgspec

    A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML

    Project mention: Don't let dicts spoil your code | news.ycombinator.com | 2024-10-09

    gjson [1] and a few other go packages offer a way to parse arbitrary JSON without requiring structs to hold them.

    re: Python. I like PyRight/PyLance for Python typing, it seems to "just work" afaict. I also like msgspec for dataclass like behavior [2].

    ---

    1: https://github.com/tidwall/gjson

    2: https://jcristharif.com/msgspec/

  • jsonpickle

    Python library for serializing any arbitrary object graph into JSON. It can take almost any Python object and turn the object into JSON. Additionally, it can reconstitute the object back into Python.

    Project mention: Show HN: Mutuple – Replace items in Python's "immutable" tuples | news.ycombinator.com | 2024-04-10

    While I mostly wrote `mutuple` for fun, it's also a proof of concept for solving a tricky pickling problem in the jsonpickle[1] library: restoring object graphs that contain tuples with back-references to the same tuple.

    I'm pretty sure there are better ways of handling this edge case, but, hey, it works and was a pretty fun experiment.

    [1] https://github.com/jsonpickle/jsonpickle/pull/491

  • cattrs

    Composable custom class converters for attrs, dataclasses and friends.

  • mashumaro

    Fast and well tested serialization library

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • mcap

    MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.

    Project mention: Rerun: Visualize Multimodal Data over Time | news.ycombinator.com | 2024-08-26

    Seems like it's aiming to be a more general alternative to tools like ROS rosbags, pretty widely used in robotics. Sounds like a good idea to me -- having a nice tool to create and visualize multimodal logs can be pretty useful outside of robotics.

    Foxglove (https://foxglove.dev/) is an alternative specifically aimed at robotics. It was originally a fork of Cruise webviz (https://webviz.io/), iirc, which came out of the ROS ecosystem. The format for ROS logs (rosbags) has evolved a bit - from a custom format, to a format based on sqlite, to a new format that is intended to be more general and compatible with various serialization formats, MCAP (https://mcap.dev/).

  • colander

    A serialization/deserialization/validation library for strings, mappings and lists.

  • rtoml

    A fast TOML library for python implemented in rust.

  • pymilo

    PyMilo: Python for ML I/O

    Project mention: Ask HN: What are you working on (August 2024)? | news.ycombinator.com | 2024-08-24

    I'm a Master's student in Artificial Intelligence at UofT. Right now, I'm adding the "ML (Machine Learning) Streaming" feature to PyMilo. PyMilo is an open-source Python package that provides a transparent, safe, and end-to-end way for users to export pre-trained machine-learning models.

    Transparency and non-executable export format is a serious thing, take a look at https://embracethered.com/blog/posts/2022/machine-learning-a....

    After version 0.9 release, PyMilo became feature-completed with full support of scikit-learn models, now it's time to move on to PyTorch and then Tensorflow. But we decided to add the "ML Streaming" feature before getting into PyTorch, in order to provide an easy way to smoothly stream your ML model. By using the "ML Streaming" feature you can easily deploy your model into the remote server, connect to it from the client side, and choose the working mode, either delegation or local mode, through delegation mode your requests will be relayed to the remote server and you can easily work with your remote model from any devices without any further dependencies, and finally, you can download model for local use.

    We will release the 1.0 (tenth) version of PyMilo around Sep 16th, this release will be the first release to have the "ML Streaming" feature with support of REST API, and we will next add other protocols such as Websocket.

    Here is PyMilo: https://github.com/openscilab/pymilo

  • PyFLP

    FL Studio project file parser

  • Pickora

    A toy compiler that can convert Python scripts 🐍 to pickle bytecode 🥒

  • dataconf

    Simple dataclasses configuration management for Python with hocon/json/yaml/properties/env-vars/dict/cli support.

  • chili

    Object serialization/deserialization tools for python. (by kodemore)

  • bytechomp

    A pure python declarative custom binary protocol parser & generator using dataclasses and type hinting. Like Pydantic for binary protocols.

  • quickapiclient

    Create fully typed declarative API clients quickly and easily.

    Project mention: Ask HN: What Are You Working On? (October 2024) | news.ycombinator.com | 2024-10-27

    I'm working on a library that allows anyone to build fully typed, declarative API clients very easily, in Python.

    https://github.com/martinn/quickapiclient

  • lupin is a Python JSON object mapper

    Python document object mapper (load python object from JSON and vice-versa)

  • orjsonl

    A lightweight, high-performance Python library for parsing jsonl files.

  • bstruct

    Simple, efficient and dependency-free binary (de)serialization using type annotations.

  • versionedobj

    Easy object serialization and versioning framework for python

  • py-object-factory

    objectfactory is a python package to easily implement the factory design pattern for object creation, serialization, and polymorphism

  • ZnJSON

    Package to Encode/Decode some common file formats to json

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Deserialization discussion

Log in or Post with

Python Deserialization related posts

  • Show HN: Mutuple – Replace items in Python's "immutable" tuples

    2 projects | news.ycombinator.com | 10 Apr 2024
  • Litestar 2.0

    4 projects | /r/Python | 29 Aug 2023
  • Help making draggable items for Flask app.

    1 project | /r/flask | 21 Aug 2023
  • Starlite updates March '22 | 2.0 is coming

    14 projects | /r/Python | 26 Mar 2023
  • Noob question on saving objects in YAML files

    1 project | /r/learnpython | 13 Oct 2022
  • Yet another object serialization framework!

    2 projects | /r/Python | 5 Sep 2022
  • For fun, I created a library to serialize / deserialize any python object into JSON

    2 projects | /r/Python | 27 Aug 2022
  • A note from our sponsor - SaaSHub
    www.saashub.com | 9 Dec 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Deserialization projects in Python? This list will help you:

Project Stars
1 marshmallow 7,067
2 orjson 6,340
3 Schematics 2,580
4 msgspec 2,474
5 jsonpickle 1,259
6 cattrs 830
7 mashumaro 789
8 mcap 533
9 colander 451
10 rtoml 324
11 pymilo 149
12 PyFLP 130
13 Pickora 116
14 dataconf 82
15 chili 71
16 bytechomp 43
17 quickapiclient 40
18 lupin is a Python JSON object mapper 26
19 orjsonl 25
20 bstruct 17
21 versionedobj 9
22 py-object-factory 9
23 ZnJSON 3

Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai

Did you konow that Python is
the 2nd most popular programming language
based on number of metions?