JSON in data science projects: tips & tricks

This page summarizes the projects mentioned and recommended in the original post on dev.to

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • orjson

    Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

  • orjson is the fastest JSON library available for python. It natively manages dataclass objects, datetime, numpy and UUID objects.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • NumPy

    The fundamental package for scientific computing with Python.

  • Data science projects often use numpy. However, numpy objects are not JSON-serializable and therefore require conversion to standard python objects in order to be saved:

  • jsonlines

    Documentation for the JSON Lines text file format

  • This can be remedied by using the [JSON Lines] format (https://jsonlines.org/). This involves nothing more and nothing less than placing one JSON object per line, so that you can browse the objects without having to parse the entire collection all at once.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • JSON dans les projets data science : Trucs & Astuces

    3 projects | dev.to | 7 Mar 2024
  • Can someone help me understand PyO3? I'm not sure how it works.

    2 projects | /r/rust | 24 Feb 2021
  • NumPy 2.0.0

    13 projects | news.ycombinator.com | 16 Jun 2024
  • NumPy 2.0.0 release – first major release since 2006

    1 project | news.ycombinator.com | 17 Jun 2024
  • NumPy 2.0.0 Release Notes

    1 project | news.ycombinator.com | 16 Jun 2024