s3-parallel-put
Parallel uploads to Amazon AWS S3 (by mishudark)
subpar
Subpar is a utility for creating self-contained python executables. It is designed to work well with Bazel. (by google)
| s3-parallel-put | subpar | |
|---|---|---|
| 1 | 2 | |
| 312 | 566 | |
| - | - | |
| 10.0 | 10.0 | |
| over 3 years ago | over 1 year ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
s3-parallel-put
Posts with mentions or reviews of s3-parallel-put.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-07.
-
Gcloud storage: up to 94% faster data transfers for Cloud Storage
We often have to sync hundreds of thousands of files to S3 and we use this which often hits 300 files a second on a 1Gbps link:
https://github.com/mishudark/s3-parallel-put
subpar
Posts with mentions or reviews of subpar.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-03.
-
Best way to package Python binaries for deployment in 2023
I know that Buck outputs nice .pex files with everything included, but I'm missing the same functionality in Bazel. However, bazel_rules_pex seems to have had its last commit in 2018, so it appears it is no longer being maintained. The situation is similar for Subpar (https://github.com/google/subpar).
-
Gcloud storage: up to 94% faster data transfers for Cloud Storage
par- I assume this is the open sourced version https://github.com/google/subpar
What are some alternatives?
When comparing s3-parallel-put and subpar you can also consider the following projects:
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
rules_pycross - Bazel + Python rules for cross-platform external dependencies
dropbox-style-python-repo - 🌿💚 Learning how the github.com/dropbox/dbx_build_tools work for Python monorepos.
s5cmd - Parallel S3 and local filesystem execution tool.
bzd - Fullstack, lightweight and flexible framework for IoT applications