Python Serialization

Open-source Python projects categorized as Serialization

Top 23 Python Serialization Projects

Serialization
  • marshmallow

    A lightweight library for converting complex objects to and from simple Python datatypes.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • orjson

    Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

    Project mention: Web scraping of a dynamic website using Python with HTTP Client | dev.to | 2024-09-28

    The library already has support for an HTTP client that allows bypassing Cloudflare - CurlImpersonateHttpClient. Since we have to work with JSON responses we could use parsel_crawler added in version 0.3.0, but I think this is excessive for such tasks, besides I like the high speed of orjson.. Therefore, we'll need to implement our crawler rather than using one of the ready-made ones.

  • itsdangerous

    Safely pass trusted data to untrusted environments and back.

  • datasketch

    MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW

  • Schematics

    Python Data Structures for Humansβ„’.

  • msgspec

    A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML

    Project mention: Don't let dicts spoil your code | news.ycombinator.com | 2024-10-09

    gjson [1] and a few other go packages offer a way to parse arbitrary JSON without requiring structs to hold them.

    re: Python. I like PyRight/PyLance for Python typing, it seems to "just work" afaict. I also like msgspec for dataclass like behavior [2].

    ---

    1: https://github.com/tidwall/gjson

    2: https://jcristharif.com/msgspec/

  • strictyaml

    Type-safe YAML parser and validator.

    Project mention: Unit Tests as Documentation | news.ycombinator.com | 2024-10-17

    I dont think it is about discipline. At its core, a good test will take an example and do something with it to demonstrate an outcome.

    That's exactly what how to docs do - probably with the same examples.

    Logically, they should be the same thing.

    For example:

    https://github.com/crdoconnor/strictyaml/blob/master/hitch/s...

    And:

    https://hitchdev.com/strictyaml/using/alpha/scalar/email-and...

    You just need a (non turing complete) language that is dual use - it generates docs and runs tests.

  • jsonpickle

    Python library for serializing any arbitrary object graph into JSON. It can take almost any Python object and turn the object into JSON. Additionally, it can reconstitute the object back into Python.

    Project mention: Show HN: Mutuple – Replace items in Python's "immutable" tuples | news.ycombinator.com | 2024-04-10

    While I mostly wrote `mutuple` for fun, it's also a proof of concept for solving a tricky pickling problem in the jsonpickle[1] library: restoring object graphs that contain tuples with back-references to the same tuple.

    I'm pretty sure there are better ways of handling this edge case, but, hey, it works and was a pretty fun experiment.

    [1] https://github.com/jsonpickle/jsonpickle/pull/491

  • serpy

    ridiculously fast object serialization

  • cattrs

    Composable custom class converters for attrs, dataclasses and friends.

  • mashumaro

    Fast and well tested serialization library

  • pyserde

    Yet another serialization library on top of dataclasses, inspired by serde-rs.

    Project mention: Pyserde | news.ycombinator.com | 2024-05-06
  • pysimdjson

    Python bindings for the simdjson project.

  • PyLD

    JSON-LD processor written in Python

    Project mention: 12 easy SEO Tips Every Developer Should Know | dev.to | 2024-07-01

    Json-ld

  • mcap

    MCAP is a modular, performant, and serialization-agnostic container file format, useful for pub/sub and robotics applications.

    Project mention: Rerun: Visualize Multimodal Data over Time | news.ycombinator.com | 2024-08-26

    Seems like it's aiming to be a more general alternative to tools like ROS rosbags, pretty widely used in robotics. Sounds like a good idea to me -- having a nice tool to create and visualize multimodal logs can be pretty useful outside of robotics.

    Foxglove (https://foxglove.dev/) is an alternative specifically aimed at robotics. It was originally a fork of Cruise webviz (https://webviz.io/), iirc, which came out of the ROS ecosystem. The format for ROS logs (rosbags) has evolved a bit - from a custom format, to a format based on sqlite, to a new format that is intended to be more general and compatible with various serialization formats, MCAP (https://mcap.dev/).

  • Fast JSON schema for Python

    Fast JSON schema validator for Python.

  • colander

    A serialization/deserialization/validation library for strings, mappings and lists.

  • srsly

    πŸ¦‰ Modern high-performance serialization utilities for Python (JSON, MessagePack, Pickle)

  • nestedtext

    Human readable and writable data interchange format

  • django-data-wizard

    πŸ§™βš™οΈ Import structured data (e.g. Excel, CSV, XML, JSON) into one or more Django models via an interactive web-based wizard

  • jsons

    🐍 A Python lib for (de)serializing Python objects to/from JSON

  • pySHACL

    A Python validator for SHACL

  • apischema

    JSON (de)serialization, GraphQL and JSON schema generation using Python typing.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Serialization discussion

Log in or Post with

Python Serialization related posts

Index

What are some of the best open-source Serialization projects in Python? This list will help you:

Project Stars
1 marshmallow 7,073
2 orjson 6,449
3 itsdangerous 2,953
4 datasketch 2,628
5 Schematics 2,582
6 msgspec 2,518
7 strictyaml 1,499
8 jsonpickle 1,265
9 serpy 960
10 cattrs 839
11 mashumaro 802
12 pyserde 737
13 pysimdjson 651
14 PyLD 615
15 mcap 542
16 Fast JSON schema for Python 468
17 colander 452
18 srsly 444
19 nestedtext 375
20 django-data-wizard 342
21 jsons 290
22 pySHACL 259
23 apischema 230

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you konow that Python is
the 2nd most popular programming language
based on number of metions?