[D] Question: Do you enforce a data format in Pandas? When collecting data over a long period of time, wouldn't it be useful to use a system with versioned schemas that specify how various data entries must be formatted? Give me feedback on this Open Source idea:

• dataenforce

  2 208 0.0 Python

  Python package to enforce column names & data types of pandas DataFrames

https://github.com/CedricFR/dataenforce enforces column names and types, no versioning though. My first instinct is that important data should be stored in databases which enforce schemas, and that should be separate from the python code that reads it.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project