brain-plasma
dupver
brain-plasma | dupver | |
---|---|---|
1 | 8 | |
82 | 13 | |
- | - | |
0.0 | 0.0 | |
over 1 year ago | over 1 year ago | |
Python | Go | |
MIT License | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
brain-plasma
-
Ask HN: Show me your Half Baked project
https://github.com/russellromney/brain-plasma
I had a speed problem repeatedly loading large dataframes into memory for a Dash project - threads can’t share object updates and Redis gets slow with large objects. So I built brain-plasma: a fast Python dictionary interface to the Plasma shared memory store (py arrow project). It lets you keep objects in memory, but separate from service memory - need to read data into memory over and over. Fast access and arbitrary namespaces. It’s not perfect but it works well.
dupver
-
Data Version Control
I work with a lot of uncompressed structured binary files so I finally broke down and wrote my own system based on the Restic chunker: https://github.com/akbarnes/dupver
-
Write Plain Text Files
I wound up writing dupver https://github.com/akbarnes/dupver after getting frustrated with the lack of versioning tools for binary files. One neat thing about .docx files and their ilk is that they are "just" zip files so it isn't hard to add special handling to pull out their contents and run deduplication over that.
- Dupver - Deduplicating VCS for large binary files in Go
- Show HN: Deduplicating VCS for large binary files in Go
- Dupver: deduplicating version control for large-ish binary files
-
Ask HN: Show me your Half Baked project
DupVer https://github.com/akbarnes/dupver is a deduplicating version control system for large binary files. It's designed to keep state in a repository on the local machine separate from the working directory so it plays nice with cloud synchronization software.
I started it after constant headaches involving Git LFS and the corporate proxy. It's based around the Restic chunker library, with inspiration from both the Duplicacy backup software and Boar, another binary version control system for large binary files.
-
What comes after Git? It's been 15 years since it was created
https://github.com/akbarnes/dupver
What are some alternatives?
go-live - 🗂️ go-live is an ultra-light server utility that serves files, HTML or anything else, over HTTP.
pgsink - Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
thgtoa - The Hitchhiker’s Guide to Online Anonymity
wcp - Experimental file copy tool using io_uring
ws-monitoring - A simple & lightweight realtime monitoring web UI + server in Node.js
qrono - Qrono time-ordered queue server
pcopy - pcopy is a temporary file host, nopaste and clipboard across machines. It can be used from the Web UI, via a CLI or without a client by using curl.
UsTaxes - Tax filing web application
observable-state-tree - An observable state tree is a normal object except that listeners can be bound to any subtree of the state tree.
mymusic-dl - Download music using web scraping and youtube-dl no API keys required
pyodide - Pyodide is a Python distribution for the browser and Node.js based on WebAssembly
tinyjam - A radically simple, zero-configuration static site generator in JavaScript