telemetry-python
dupver
| telemetry-python | dupver | |
|---|---|---|
| 1 | 8 | |
| 3 | 13 | |
| - | - | |
| 2.6 | 0.0 | |
| 8 months ago | over 1 year ago | |
| Python | Go | |
| Apache License 2.0 | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
telemetry-python
-
Data Version Control
VS Code, etc
> I think the challenge I have is that since you’re getting IP address that will be an opportunity to abuse.
Yes! And we are migrating to the new package / infrastructure because of this - https://github.com/iterative/telemetry-python (DVC's sister tool MLEM is already on it and it's not sending (saving) IP addresses, nor using GA or any other third-party tools, data is saved into BigQuery and eventually we'll make publicly accessible - https://mlem.ai/doc/user-guide/analytics to be fully GDPR compatible). It's a legacy system that DVC had in place. There was no intention to use those IP addresses in some way.
> I think perhaps the only other way would be to support an automated distro that doesn’t include it so users are at least able to easily choose a version.
Thanks. To some extent brew-like policy (not sending anything significant before there is a chance to disable it and there is clear explicit message) should be mitigating this, but I'll check if it works this way now and if it can be improved.
dupver
-
Data Version Control
I work with a lot of uncompressed structured binary files so I finally broke down and wrote my own system based on the Restic chunker: https://github.com/akbarnes/dupver
-
Write Plain Text Files
I wound up writing dupver https://github.com/akbarnes/dupver after getting frustrated with the lack of versioning tools for binary files. One neat thing about .docx files and their ilk is that they are "just" zip files so it isn't hard to add special handling to pull out their contents and run deduplication over that.
- Dupver - Deduplicating VCS for large binary files in Go
- Show HN: Deduplicating VCS for large binary files in Go
- Dupver: deduplicating version control for large-ish binary files
-
Ask HN: Show me your Half Baked project
DupVer https://github.com/akbarnes/dupver is a deduplicating version control system for large binary files. It's designed to keep state in a repository on the local machine separate from the working directory so it plays nice with cloud synchronization software.
I started it after constant headaches involving Git LFS and the corporate proxy. It's based around the Restic chunker library, with inspiration from both the Duplicacy backup software and Boar, another binary version control system for large binary files.
-
What comes after Git? It's been 15 years since it was created
https://github.com/akbarnes/dupver
What are some alternatives?
Estranged.Lfs - A Git LFS server implementation in C# designed to run in a serverless environment.
pgsink - Logically replicate data out of Postgres into sinks (files, Google BigQuery, etc)
Mimic - We use the actual live data from the International Space Station to control a 3D-printed model that moves the solar arrays and radiators to track the real ISS in real time. We also host two pages that display ALL of the public ISS telemetry below::
wcp - Experimental file copy tool using io_uring
dud - A lightweight CLI tool for versioning data alongside source code and building data pipelines.
qrono - Qrono time-ordered queue server
rudolfs - A high-performance, caching Git LFS server with an AWS S3 and local storage back-end.
UsTaxes - Tax filing web application
mymusic-dl - Download music using web scraping and youtube-dl no API keys required
tinyjam - A radically simple, zero-configuration static site generator in JavaScript
godbledger - Accounting Software with GRPC endpoints and SQL Backends
stdnum-js - A JavaScript library to provide functions to handle, parse and validate standard numbers.