I'm trying to compress data with Python and Zstd library but can't figure out what I'm doing wrong. Any Help?

This page summarizes the projects mentioned and recommended in the original post on /r/learnpython

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • python-zstandard

    Python bindings to the Zstandard (zstd) compression library

    • I'm working on file formats called tif file which are on average a gigabyte of size. A middle step is to compress those files and I looked it up and found this and tried to use it. But unfortunately, the size of the compressed file is barely 100MB less than the original one and it takes like 1.5 minutes to compress it. I'm reading the entire file in memory instead of streaming it but I don't really think that could result in compression size. I'm also using high enough level of compression(20 level) but it still won't give me good results.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts