stream-unzip
StreamingUnzip
| stream-unzip | StreamingUnzip | |
|---|---|---|
| 3 | 1 | |
| 253 | 2 | |
| 2.8% | - | |
| 7.0 | 10.0 | |
| 13 days ago | over 10 years ago | |
| Python | Python | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
stream-unzip
- Show HN: stream-unzip – now with an async interface
-
Python – Writing large ZIP archives without memory inflation
Looks good! I've been thinking about making a writable version of https://github.com/uktrade/stream-unzip, but looks like you beat me to it!
(Full disclosure: I'm the main developer of stream-unzip)
- uktrade/stream-unzip Python function to stream unzip all the files in a ZIP archive, without loading the entire ZIP file into memory or any of its uncompressed files.
StreamingUnzip
-
Python – Writing large ZIP archives without memory inflation
Interesting, for the read (decompression) case I wrote this a while back:
https://github.com/d136o/StreamingUnzip
Basically, if you have a big zip file with many files in it (csvs for example), you can pipe out the decompressed data…
It’s a bit obtuse to use since it calls for the end chunk of a zip archive (it may come from s3 for example).
What are some alternatives?
python-zipstream - Like Python's ZipFile module, except it works as a generator that provides the file in many small chunks.
python-zipstream - Like Python's ZipFile module, except it works as a generator that provides the file in many small chunks.
zipstreamer - Zip File Streaming Microservice - stream zip files on the fly
spilo - Highly available elephant herd: HA PostgreSQL cluster using Docker
zipfly - Python Zip Stream
datasette - An open source multi-tool for exploring and publishing data
iterable-subprocess - Python context manager to communicate with a subprocess using iterables: for when data is too big to fit in memory and has to be streamed
Nakadi - A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues