tusd VS Redis

If it’s one way (that wasn’t quite clear from the requirements to me).

take a look at https://tus.io/

We have an application tus - resumable file uploads we are deploying to Azure as an Azure App Service; a custom linux container. TusD exposes an endpoint /metrics that Prometheus is meant to scrape. Our App Service plan is set to rules-based scaling between 2 and 30 instances depending on load and traffic. The Azure Firewall is configured to not allow inbound connections to anything except via the load balancer (API management?).

HTTP/1 requests (uploads in this case) are also separate to some degree (though there are fairly stringent limits on connections per domain iirc which HTTP/2 resolves via the mentioned streams/multiplexing of connections).

The problem they have specifically would be that in a single request (form post for example) those uploads will be linear.

Solution really boils down to paralellizing the upload, using protocols/standards like https://tus.io/ or S3-compatible APIs to push the data up then syncronize with a record/document on the server.

hey hn, supabase ceo here

This release introduces a few new features to Supabase Storage: Resumable Uploads , Quality Filters, Next.js support, and WebP support.

As a reminder, Supabase Storage is for file storage, not to be confused with Postgres Storage. Resumable Uploads is the biggest update because it means that you can build more resilient apps: your users can continue uploading a file if their internet drops or if they accidentally close a browser tab

This implementation uses TUS[0], which is an open source protocol. We opted for this over s3's protocol to support the open source ecosystem. This means you can use several existing libraries and frameworks (like Uppy.js[1]) for multi-part uploads.

It also has some neat technical details, using Postgres Advisory Locks to solve concurrency issues.

The Storage team will be in the comments to cover any technical questions.

[0] TUS: https://tus.io/

[1] Uppy: https://uppy.io/docs/tus/

If you're going to upload semi large files (100 MB) and want resumability for that upload (i.e. it can resume if the connection breaks down) I would recommend using https://tus.io and tusdotnet . It's an open protocol, clients exist for a large range of languages and tusdotnet supports customizing the storage to send files directly to Azure blob storage using Xtensible.TusDotNet.Azure

I'm a huge fan of https://tus.io/ because of the multiple backends and frontends

I usually use https://tus.io/ as the base protocol. Not too difficult to implement.

Have a look at https://tus.io the resumable file upload protocol.

We use https://tus.io/ to upload large files, but it's pure JS + ASP.NET, not through Blazor. You can easily do this in Blazor Server app, but it will have JS.

Hi there! I want to show off a little feature I made using hanami, htmx and a little bit of redis + sidekiq.

Data Handling: Utilizes Windmill for data pipelines, with a primary database powered by PostgreSQL. Auxiliary data storage is handled by MongoDB, with Redis for caching to optimize performance

One of the challenges Redis labs here have is that there's very little reason for their userbase to stay loyal to them.

antirez retired from Redis development a few years ago.

From https://github.com/redis/redis/graphs/contributors it looks like activity since he left has been mostly from people who didn't overlap with him much.

Redis Labs have not shown themselves to be outstanding stewards of the project as far as I can tell. Why shouldn't people support the fork?

Redis

Redis - real time data storage with different data structures in a cache

[0] https://github.com/redis/redis/blob/unstable/CONTRIBUTING.md

Cache: a Redis cache