Python – Create large ZIP archives without memory inflation

1. ZipZap

   1 2 1,222 0.0 Objective-C

   zip file I/O library for iOS, macOS and tvOS

   

   Streaming zip file is going to have issues when compression ratio is not 0 for some implementations (such as ZipFileStream from Java / Android). I fixed this a few years ago for ZipZap: https://github.com/pixelglow/ZipZap/pull/155

   Particularly, the local header (per file) is written before the file content, and you cannot get accurate compressed size prior to actual compression. Central file header is at the end of the file, so there is no problem to get accurate compressed size, but some zip reader implementations (such as ZipFileStream) cannot use central file header (because it is at the end), and will use the wrong compressed size.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. zipstream

   2 1 40 0.0 Python

   Simple python library for streaming zip files which are created dynamically, without using any temporary files

   

   How does it compares to https://github.com/kbbdy/zipstream?

4. zipfly

   3 11 526 4.0 Python

   Python Zip Stream

   

   The code is perplexing. Why do you need to say int('0x1', 16) and int('0x2', 16)? Why not just write 0x1 and 0x2? Or just plain 1 and 2?

   I'm also perplexed by the goal as this seems to just call zipfile.write under the hood, which already does what this tries to accomplish?

   [0] https://github.com/BuzonIO/zipfly/blob/master/zipfly/zipfly....

Suggest a related project