mldht
aquatic
mldht | aquatic | |
---|---|---|
2 | 16 | |
144 | 457 | |
- | - | |
10.0 | 9.5 | |
over 2 years ago | 18 days ago | |
Java | Rust | |
Mozilla Public License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mldht
-
Bitmagnet Allows People to Run Their Own Decentralized Torrent Indexer Locally
Another alternative is https://github.com/the8472/mldht which, contrary to magnetico, strives to be a nice citizen (its author is active in the bittorrent community AFAIU)
-
Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
Oh, I already have implemented something[0] like that. It doesn't need lambdas or anything "cloud scale" like that. You "just" need a few dozen to a hundred IP addresses assigned to one machine and run a multi-homed DHT node on that to passively observe traffic from multiple points in the keyspace.
But neither of these approaches is what I'd call a "super simple DHT crawler CLI tool" that the initial comment was asking about. BEP51 is intended to make crawling simple enough that it can run on a single home internet connection, but a proper implementation still isn't trivial.
[0] https://github.com/the8472/mldht
aquatic
-
Bitmagnet Allows People to Run Their Own Decentralized Torrent Indexer Locally
How does Bitmagnet compare to Aquatic? https://github.com/greatest-ape/aquatic
-
Hey Rustaceans! Got a question? Ask here (22/2023)!
I have a question on UnsafeCell usage that popped up while implementing io_uring support for aquatic_udp. I find the docs slightly confusing (in particular the part that I've marked in bold):
-
aquatic_udp (UDP BitTorrent tracker) performance improvements: up to 2.25 million responses per second
I've done a new round of benchmarking of open UDP BitTorrent tracker implementations. Results were great for aquatic_udp, achieving double the throughput of opentracker when running on 8 CPU cores:
-
WebTorrent
If you run your tracker on Linux and an info hash whitelist approach would work for your use case, it might be worthwhile having a look at aquatic_ws [0]. It relies on tungstenite [1] for websockets and achieves around 20x the throughput of the reference implementation when running with four threads.
[0] https://github.com/greatest-ape/aquatic
- Aquatic: High-performance open BitTorrent tracker
-
Official /r/rust "Who's Hiring" thread for job-seekers and job-offerers [Rust 1.60]
aquatic, a multithreaded BitTorrent tracker with world-leading performance
-
aquatic_ws (WebTorrent tracker) rewritten with glommio, achieves up to 1.6 million responses a second in load tests
But aquatic_udp doesn't use glommio.. https://github.com/greatest-ape/aquatic/pull/29
- aquatic: extremely performant BitTorrent tracker software (UDP, HTTP, WebTorrent) achieving up to 1.6 million responses per second
-
aquatic: extremely performant open BitTorrent tracker software (UDP, HTTP, WebTorrent)
aquatic is a Apache 2.0-licensed BitTorrent tracker written in Rust that I have developed over the last couple of years. It focuses on correctness, stability and high performance.
-
Torrust, a lightweight but incredibly powerful and feature-rich (private) BitTorrent Tracker + Torrent Index written in Rust.
The udp request parsing code seems to have been copied from aquatic. Please note that the Apache 2.0 license requires attribution.
What are some alternatives?
dhtcrawler2 - dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword
openwebtorrent-tracker - Fast and simple Webtorrent tracker implementation in C++
DHT-Torrent-database-Worker - I was learning to code. No bully. Old project built sometime in 2012. Crawls the DHT network, downloads torrent metadata from peers and uploads that torrent information into a database.
wt-tracker - High-performance WebTorrent tracker
bitmagnet - A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI, GraphQL API and Servarr stack integration.
webtorrent - ⚡️ Streaming torrent client for the web
content-seeder
OctaSine - Frequency modulation synthesizer plugin (VST2, CLAP). Runs on macOS, Windows and Linux.
rarbg-selfhosted - A self-hosted Torznab API for the RARBG backup, compatible with Prowlarr, Radarr, Sonarr etc.
glommio - Glommio is a thread-per-core crate that makes writing highly parallel asynchronous applications in a thread-per-core architecture easier for rustaceans.
Magnetico - Autonomous (self-hosted) BitTorrent DHT search engine suite.
bittorrent-tracker - 🌊 Simple, robust, BitTorrent tracker (client & server) implementation