pysimdjson VS marshmallow

Compare pysimdjson vs marshmallow and see what are their differences.

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
pysimdjson marshmallow
6 11
629 6,888
- 0.8%
5.3 8.7
3 months ago 6 days ago
Python Python
GNU General Public License v3.0 or later MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

pysimdjson

Posts with mentions or reviews of pysimdjson. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-03-18.
  • Analyzing multi-gigabyte JSON files locally
    14 projects | news.ycombinator.com | 18 Mar 2023
  • I Use C When I Believe in Memory Safety
    5 projects | news.ycombinator.com | 5 Feb 2023
    Its magic function wrapping comes at a cost, trading ease of use for runtime performance. When you have a single C++ function to call that will run for a "long" time, pybind all the way. But pysimdjson tends to call a single function very quickly, and the overhead of a single function call is orders of magnitude slower than with cython when being explit with types and signatures. Wrap a class in pybind11 and cython and compare the stack trace between the two, and the difference is startling.

    Ex: https://github.com/TkTech/pysimdjson/issues/73

  • Processing JSON 2.5x faster than simdjson with msgspec
    5 projects | /r/Python | 3 Oct 2022
    simdjson
  • [package-find] lsp-bridge
    5 projects | /r/emacs | 23 May 2022
    You are aware of simdjson being available in python if you really need some json crunching, albeit json module in Python is implemented in C itself, so I don't think understand why do you think Python is slow there?
  • The fastest tool for querying large JSON files is written in Python (benchmark)
    16 projects | news.ycombinator.com | 12 Apr 2022
    json: 113.79130696877837 ms

    While `orjson`, is faster than `ujson`/`json` here, it's only ~6% faster (in this benchmark). `simdjson` and `msgspec` (my library, see https://jcristharif.com/msgspec/) are much faster due to them avoiding creating PyObjects for fields that are never used.

    If spyql's query engine can determine the fields it will access statically before processing, you might find using `msgspec` for JSON gives a nice speedup (it'll also type check the JSON if you know the type of each field). If this information isn't known though, you may find using `pysimdjson` (https://pysimdjson.tkte.ch/) gives an easy speed boost, as it should be more of a drop-in for `orjson`.

  • How I cut GTA Online loading times by 70%
    7 projects | /r/programming | 28 Feb 2021
    I don't think JSON is really the problem - parsing 10MB of JSON is not so slow. For example, using Python's json.load takes about 800ms for a 47MB file on my system, using something like simdjson cuts that down to ~70ms.

marshmallow

Posts with mentions or reviews of marshmallow. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-10-25.
  • Help making draggable items for Flask app.
    1 project | /r/flask | 21 Aug 2023
    Somehow get a serializer going for your database models. I used marshmallow and flask-marshmallow
  • Faster time-to-market with API-first
    12 projects | dev.to | 25 Oct 2022
    Uses a robust data validation library: validating payloads is a complex business. Your data validation library must handle optional and required properties, string formats like ISO dates and UUIDs (both dates and UUIDs are string types in OpenAPI), and strict vs loose type validation (should a string pass as an integer if it can be casted?). Also, in the case of Python, you need to make sure 1 and 0 don’t pass for True and False when it comes to boolean properties. In my experience, the best data validation libraries in the Python ecosystem are pydantic and marshmallow. From the above-mentioned libraries, flasgger and flask-smorest work with marshmallow.
  • What's best library for swagger + flask?
    6 projects | /r/Python | 25 Sep 2022
    I also came across things like Marsmallow and Blueprints, but don't know what these are, still reading about this as I write.
  • pydantic VS marshmallow - a user suggested alternative
    2 projects | 21 Sep 2022
    Pydantic is a data validation library, marshmallow is a data validation library. None of the other libraries in the list of pydantic alternatives is a data validation library.
  • Yet another object serialization framework!
    2 projects | /r/Python | 5 Sep 2022
    I have been working on a package that is very similar in concept to marshmallow (https://marshmallow.readthedocs.io), but which adds a versioning mechanism to track changes in object structure across time, allowing you to migrate objects between different versions.
  • How to implement conditional model
    1 project | /r/flask | 6 Jul 2022
    Either using meta programming: https://github.com/marshmallow-code/marshmallow/issues/585
  • Should I use SQLAlchemy for a side project?
    2 projects | /r/Python | 15 Jun 2022
    You might be surprised how much I agree - I recently opened an issue there hoping to discuss something like this (still awaiting response). https://github.com/marshmallow-code/marshmallow/issues/2000
  • The Pocket Guide To API Request Validation You Wish You Had Earlier
    2 projects | dev.to | 6 Jan 2022
    Marshmallow
  • Project Althaia - looking for performance/accuracy feedback on my shallow fork of marshmallow
    2 projects | /r/Python | 3 Jan 2022
    I created a shallow fork of everyone's favourite marshmallow, to work around some performance issues while dumping data. The performance gain I measured is around 45%, but since it's a bad idea to rely on one's own testing, I was hoping that there are some folks here who use marshmallow in their projects, and who would be willing to try it out. Doubly so if your project has some unit tests in it, to confirm that nothing is broken due to my patches.
  • What's the fastest way to parse JSON to output?
    1 project | /r/flask | 21 Feb 2021
    I was looking at https://github.com/marshmallow-code/marshmallow That's a nice library to use to parsing?

What are some alternatives?

When comparing pysimdjson and marshmallow you can also consider the following projects:

orjson - Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

Fast JSON schema for Python - Fast JSON schema validator for Python.

cysimdjson - Very fast Python JSON parsing library

cattrs - Composable custom class converters for attrs.

ultrajson - Ultra fast JSON decoder and encoder written in C with Python bindings

serpy - ridiculously fast object serialization

WTForms - A flexible forms validation and rendering library for Python.

lupin is a Python JSON object mapper - Python document object mapper (load python object from JSON and vice-versa)

jsonschema - JSON Schema validation library

PyValico - Small python wrapper around https://github.com/rustless/valico