Our great sponsors
| dupver | wcp | |
|---|---|---|
| 8 | 3 | |
| 13 | 191 | |
| - | - | |
| 0.0 | 0.0 | |
| over 1 year ago | almost 3 years ago | |
| Go | C | |
| BSD 2-clause "Simplified" License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dupver
-
Data Version Control
I work with a lot of uncompressed structured binary files so I finally broke down and wrote my own system based on the Restic chunker: https://github.com/akbarnes/dupver
-
Write Plain Text Files
I wound up writing dupver https://github.com/akbarnes/dupver after getting frustrated with the lack of versioning tools for binary files. One neat thing about .docx files and their ilk is that they are "just" zip files so it isn't hard to add special handling to pull out their contents and run deduplication over that.
- Dupver - Deduplicating VCS for large binary files in Go
- Show HN: Deduplicating VCS for large binary files in Go
- Dupver: deduplicating version control for large-ish binary files
-
Ask HN: Show me your Half Baked project
DupVer https://github.com/akbarnes/dupver is a deduplicating version control system for large binary files. It's designed to keep state in a repository on the local machine separate from the working directory so it plays nice with cloud synchronization software.
I started it after constant headaches involving Git LFS and the corporate proxy. It's based around the Restic chunker library, with inspiration from both the Duplicacy backup software and Boar, another binary version control system for large binary files.
-
What comes after Git? It's been 15 years since it was created
https://github.com/akbarnes/dupver
wcp
-
Show HN: fcp – A significantly faster alternative to cp(1), written in Rust
Not a question, but I made a similar tool in c++[1], for Linux only using io_uring, and a blog post explaining its internals [2]. I'll definitely have a look some time soon, I'd be interested to see how performance compares (I gathered from some other comments here that you're using blocking io in threads?)
1: https://github.com/wheybags/wcp
-
Show HN: Wcp – a reimplementation of cp using io_uring. With a nice progress bar
The chart is over NFS, but the listed speeds in the blog, and on github[1] are from a copy on a local SSD. That is a bit confusing though, maybe I should make it more clear. I used the network copy for ETA calculation because it was an easy way to make the transfer take longer -.if the whole copy is only a few seconds long it's difficult to meaningfully compare ETA estimation accuracy between two approaches. I would like to have more performance data though.
1: https://github.com/wheybags/wcp/#how-fast
-
Ask HN: Show me your Half Baked project
Unix cp, but with a proper progress bar, and much faster:
https://github.com/wheybags/wcp
Getting close now but not ready for real use. io_uring is awesome.
What are some alternatives?
pgsink - Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
pcopy - pcopy is a temporary file host, nopaste and clipboard across machines. It can be used from the Web UI, via a CLI or without a client by using curl.
qrono - Qrono time-ordered queue server
morphy - A simple static site generator
UsTaxes - Tax filing web application
abs_cd - CI/CD for the Arch build system with webinterface.
mymusic-dl - Download music using web scraping and youtube-dl no API keys required
xact - Model based design for developers
tinyjam - A radically simple, zero-configuration static site generator in JavaScript
ML-auto-baseball-pitching-overlay - ⚾🤖⚾ Automatic baseball pitching overlay in realtime
godbledger - Accounting Software with GRPC endpoints and SQL Backends
hacn - A "monad" or DSL for creating React components using Fable and F# computation expressions