stream-unzip
zipfly
| stream-unzip | zipfly | |
|---|---|---|
| 3 | 11 | |
| 253 | 519 | |
| 2.8% | 0.2% | |
| 7.0 | 4.0 | |
| 10 days ago | 8 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
stream-unzip
- Show HN: stream-unzip – now with an async interface
-
Python – Writing large ZIP archives without memory inflation
Looks good! I've been thinking about making a writable version of https://github.com/uktrade/stream-unzip, but looks like you beat me to it!
(Full disclosure: I'm the main developer of stream-unzip)
- uktrade/stream-unzip Python function to stream unzip all the files in a ZIP archive, without loading the entire ZIP file into memory or any of its uncompressed files.
zipfly
- ZipFly 6.0.5
- GitHub - sandes/zipfly: Writing large ZIP archives without memory inflation
- Python3 – Writing large ZIP archives without memory inflation
- Python – Writing large ZIP archives without memory inflation
-
Help me understand working with streams in Python
If you get that far then you'll have a decent understanding on how zip and io can work. My advice then would be to hop in a time machine and check out https://github.com/BuzonIO/zipfly.
- GitHub - BuzonIO/zipfly: Writing large ZIP archives without memory inflation
- Zipfly - Write large ZIP archives without memory inflation in Python
-
Python – Create large ZIP archives without memory inflation
The code is perplexing. Why do you need to say int('0x1', 16) and int('0x2', 16)? Why not just write 0x1 and 0x2? Or just plain 1 and 2?
I'm also perplexed by the goal as this seems to just call zipfile.write under the hood, which already does what this tries to accomplish?
[0] https://github.com/BuzonIO/zipfly/blob/master/zipfly/zipfly....
What are some alternatives?
python-zipstream - Like Python's ZipFile module, except it works as a generator that provides the file in many small chunks.
python-zipstream - Like Python's ZipFile module, except it works as a generator that provides the file in many small chunks.
zipstream - Simple python library for streaming zip files which are created dynamically, without using any temporary files
spilo - Highly available elephant herd: HA PostgreSQL cluster using Docker
zipstreamer - Zip File Streaming Microservice - stream zip files on the fly
datasette - An open source multi-tool for exploring and publishing data
www - Generic www flask server with phinka module
iterable-subprocess - Python context manager to communicate with a subprocess using iterables: for when data is too big to fit in memory and has to be streamed
StreamingUnzip - Given the (end) chunk of a zip file (where you can find the zip file's "table of contents") you will be able to zip in a zip file and have this utility pipe the files out unzipped.