mutagen VS qobuz-dl

Hey HN, I wanted to share a Docker Desktop extension that uses Mutagen (the open-source[0] file sync tool for developers) to improve bind mount performance in Docker Desktop. It allows you to create synchronized filesystem caches inside the Docker Desktop VM that can automatically replace bind mounts. This gives you ext4 filesystem performance inside the Docker Desktop VM, with low-latency synchronization to-and-from the host filesystem.

Docker themselves actually shipped this functionality in Docker Desktop back in 2020, but they decided to pivot back to virtual filesystems with gRPC FUSE and Virtiofs. While these work fairly well, there are still substantial gains to be had for workflows that are readdir(), stat(), read(), and write()-heavy. This includes things like package installs (e.g. npm and Composer), dynamic language runtimes (e.g. PHP or Node.js), and compiling code.

This new implementation is significantly more performant[1], offers a more detailed UI, and gives you the option of setting the user and group IDs for files sync'd into the VM. You can even create multiple caches of the same files with different UIDs/GIDs, allowing containers with different UIDs/GIDs to access the same files without permissions conflicts.

This extension is closed-source and requires a subscription for some functionality, but that money helps to support the corresponding open-source project.

I'd be keen to hear your feedback. There are a few minor limitations (mostly SDK limitations), but nothing too significant. The next step is probably going to be adding support for remote Docker engines, but I'd be interested to know if there are other pressing features that people would like to see.

Disclaimer: I am a Docker Captain, though this tool is not developed, sponsored, or endorsed by Docker, Inc.

---

[0]: https://github.com/mutagen-io/mutagen

[1]: The Docker Desktop EULA prevents me from publishing benchmarks, but the performance difference will be the same as the difference between gRPC FUSE or Virtiofs and a "native" ext4 volume inside the VM. This will differ between hardware and virtualization frameworks. The best option is testing your own workflow.

I can't predict ultra far into the future (who can these days... :|), but Mutagen has been under active development for about 6 years now[0]. At the moment I have enough funding to work on it full-time until at least the middle of next year, though I also do Mutagen-related contracting and consulting work to support the project. Mutagen's Docker Desktop extension is going to be a freemium product designed to support the project more directly, which will hopefully allow development to continue indefinitely.

[0]: https://github.com/mutagen-io/mutagen/graphs/contributors

It's pretty bad. The Docker for Mac team tested something called Mutagen to speed things up, but then removed it again, and the difference was drastic.

There's Qobuz-dl and QobuzDownloaderX. You can also use the Slavart bot which is available on Divolt and Discord. The bot occasionally goes down though.

Qobuz is more expensive but i think it is better. And yes, you can sign up with vpn (i dont do that, but read some people talking about that in the subreddit). And there is also a downloader for Qobuz (https://github.com/vitiko98/qobuz-dl)

I notice there is a qobuz-dl equivalent which is great. Will test that out.

If you can find a way to download the files driectly from the streamin service's servers, suing something like qobuz-dl, you can then perfoma null test to verify that they are bit perfect copies or not.

So far all I have found is this a) Qobuz-DL (console application requiring Python) https://github.com/vitiko98/qobuz-dl

Nice and nice. If you ever run across this issue and know your way around Python, look at this git repo https://github.com/vitiko98/qobuz-dl. Does require a Qobuz subscription. I think Tidal has similar open source workarounds but I use Qobuz.