dotmesh
dotmesh | repo.macintoshgarden.org-fileset | |
---|---|---|
1 | 2 | |
537 | 0 | |
-0.4% | - | |
0.0 | 0.0 | |
9 months ago | 8 months ago | |
Go | Shell | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dotmesh
-
SnowFS – a fast, scalable version control file storage for graphic files
This is great, well done. While at (now defunct) Dotscience we did a lot of work on Dotmesh which you might find interesting: https://github.com/dotmesh-io/dotmesh
I would also look at data science/ML as a potential use for the tool as there are real issues with using Git for training data.
Last point which is more of a tip: Show don’t tell. If you did some side by side workflow walkthroughs showing the difficulties with other tools it will make it easier for people to see that this problem is real (which it definitely is)
repo.macintoshgarden.org-fileset
- Show HN: We scaled Git to support 1 TB repos
-
SnowFS – a fast, scalable version control file storage for graphic files
Sure, how would you like to get in touch? You have a discord, right? I actually was looking at your project and was thinking of opening a simple PR and Issue. (same username)
I have some more examples git-annex repos:
This is an annex repo I made of this popular abandonware website:
https://github.com/unqueued/repo.macintoshgarden.org-fileset
https://github.com/unqueued/ratholeradio-archive
What's cool is that people can use standard pull requests to add files to the repo. And the repo itself is small, but it can represent huge filesets. Datalad has some really fascinating medical imaging data repos that are massive (https://www.datalad.org/datasets.html).
If you wanna see a really good example of a repo with versioned binary files, check this out the git annex repo of previous git-annex binary releases:
https://downloads.kitenet.net/.git/
You can just use standard git workflows to see previous revisions of a file (well, previous hashes) but it is really easy to hook into.
I actually have thought about making a special remote specifically to diff images. But yeah, git-annex does a really amazing job at bridging the bag between binary and git.
What are some alternatives?
snowfs - SnowFS - a fast, scalable version control file storage for graphic files :art:
dvc - 🦉 ML Experiments and Data Management with Git
sso-wall-of-shame - A list of vendors that treat single sign-on as a luxury feature, not a core security requirement.