tusd
rclone
tusd | rclone | |
---|---|---|
15 | 963 | |
2,885 | 44,201 | |
2.0% | 1.9% | |
9.1 | 9.8 | |
12 days ago | 4 days ago | |
Go | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tusd
-
Ask HN: Best modern file transfer/synchronization protocol?
If it’s one way (that wasn’t quite clear from the requirements to me).
take a look at https://tus.io/
-
Azure App Service web application - scaled out - how to collect Prometheus metrics?
We have an application tus - resumable file uploads we are deploying to Azure as an Azure App Service; a custom linux container. TusD exposes an endpoint /metrics that Prometheus is meant to scrape. Our App Service plan is set to rules-based scaling between 2 and 30 instances depending on load and traffic. The Azure Firewall is configured to not allow inbound connections to anything except via the load balancer (API management?).
- Tus: Open protocol for resumable File Uploads
-
Introduction to HTTP Multipart
HTTP/1 requests (uploads in this case) are also separate to some degree (though there are fairly stringent limits on connections per domain iirc which HTTP/2 resolves via the mentioned streams/multiplexing of connections).
The problem they have specifically would be that in a single request (form post for example) those uploads will be linear.
Solution really boils down to paralellizing the upload, using protocols/standards like https://tus.io/ or S3-compatible APIs to push the data up then syncronize with a record/document on the server.
-
Supabase Storage v3: Resumable Uploads with support for 50GB files
hey hn, supabase ceo here
This release introduces a few new features to Supabase Storage: Resumable Uploads , Quality Filters, Next.js support, and WebP support.
As a reminder, Supabase Storage is for file storage, not to be confused with Postgres Storage. Resumable Uploads is the biggest update because it means that you can build more resilient apps: your users can continue uploading a file if their internet drops or if they accidentally close a browser tab
This implementation uses TUS[0], which is an open source protocol. We opted for this over s3's protocol to support the open source ecosystem. This means you can use several existing libraries and frameworks (like Uppy.js[1]) for multi-part uploads.
It also has some neat technical details, using Postgres Advisory Locks to solve concurrency issues.
The Storage team will be in the comments to cover any technical questions.
[0] TUS: https://tus.io/
[1] Uppy: https://uppy.io/docs/tus/
-
Uploading files to ASP.NET rest API
If you're going to upload semi large files (100 MB) and want resumability for that upload (i.e. it can resume if the connection breaks down) I would recommend using https://tus.io and tusdotnet . It's an open protocol, clients exist for a large range of languages and tusdotnet supports customizing the storage to send files directly to Azure blob storage using Xtensible.TusDotNet.Azure
-
A new open-source file uploader with progress display
I'm a huge fan of https://tus.io/ because of the multiple backends and frontends
-
How to upload large files (1GB+) through a RestAPI
I usually use https://tus.io/ as the base protocol. Not too difficult to implement.
-
Images lost during server upload
Have a look at https://tus.io the resumable file upload protocol.
-
Possible risks of uploading large videos through Blazor Server
We use https://tus.io/ to upload large files, but it's pure JS + ASP.NET, not through Blazor. You can easily do this in Blazor Server app, but it will have JS.
rclone
-
Supabase Storage: now supports the S3 protocol
rclone: a command-line program to manage files on cloud storage.
- World Backup Day
-
S3 Client against disasters (hacks, fires, catastrophes)
Synchronise buckets with Sclone or Rclone
- Show HN: Query Your Sheets with SheetSQL
-
Rclone syncs your files to cloud storage
Says that Apple doesn't provide a multi platform API. It doesn't provide any official supported way to access iCloud from Windows, Linux.
There's a ticket covering everything you might ever want to know:
https://github.com/rclone/rclone/issues/1778
-
Ask HN: Best modern file transfer/synchronization protocol?
seconding rsync and syncthing.
the server could expose an smb or nfs share, the client could mount it, and then sync to that mount.
rsync over ssh also works, if you do not want to run smb/nfs.
this is also a cool tool https://rclone.org/
-
Ask HN: How do you do personal backups in 2023? (Google and Dropbox issues)
rclone [1] to dropbox. works since years without problems
[1] https://rclone.org/
-
Which synchronization tool are you using together with the pCloud Crypto Folder?
rclone provides a special pCloud config option, which makes the setup straight forward. rclone can encrypt the data it uploads with its own encryption but not with the pCloud encryption. Therefore it can only upload data to the unencrypted pCloud folders, not to the Crypto Folder.
- Backup of Google Drive (and photos?) to local disk (not to Google Drive)
-
All I want for Christmas is
The arkclone project impliments rclone in ArkOS to achieve cloud saves. Not yet built in to ArkOS yet, and not a lot of recent traction on the pull request to get it added, but it can be installed manually.
What are some alternatives?
tusdotnet - .NET server implementation of the Tus protocol for resumable file uploads. Read more at https://tus.io
syncthing - Open Source Continuous File Synchronization
tus-node-server - Node.js tus server, standalone or integrable in any framework, with disk, S3, and GGC stores.
Cryptomator - Multi-platform transparent client-side encryption of your files in the cloud
Xtensible.TusDotNet.Azure
rsync - An open source utility that provides fast incremental file transfer. It also has useful features for backup and restore operations among many other use cases.
OkHttp - Square’s meticulous HTTP client for the JVM, Android, and GraalVM.
s3fs-fuse - FUSE-based file system backed by Amazon S3
Uppy - The next open source file uploader for web browsers :dog:
Duplicati - Store securely encrypted backups in the cloud!
tus-php - 🚀 A pure PHP server and client for the tus resumable upload protocol v1.0.0
aws-cli - Universal Command Line Interface for Amazon Web Services