mldht
mldht | content-seeder | |
---|---|---|
2 | 2 | |
144 | 2 | |
- | - | |
10.0 | 10.0 | |
over 2 years ago | over 1 year ago | |
Java | Java | |
Mozilla Public License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mldht
-
Bitmagnet Allows People to Run Their Own Decentralized Torrent Indexer Locally
Another alternative is https://github.com/the8472/mldht which, contrary to magnetico, strives to be a nice citizen (its author is active in the bittorrent community AFAIU)
-
Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
Oh, I already have implemented something[0] like that. It doesn't need lambdas or anything "cloud scale" like that. You "just" need a few dozen to a hundred IP addresses assigned to one machine and run a multi-homed DHT node on that to passively observe traffic from multiple points in the keyspace.
But neither of these approaches is what I'd call a "super simple DHT crawler CLI tool" that the initial comment was asking about. BEP51 is intended to make crawling simple enough that it can run on a single home internet connection, but a proper implementation still isn't trivial.
[0] https://github.com/the8472/mldht
content-seeder
-
Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
I wrote a project to do this using libtorrent a while ago, but unfortunately libtorrent crashes when seeding thousands of torrents at once, which is the current blocker. I haven't been working on it since.
https://github.com/chhs1/content-seeder
- How to Become a Pirate Archivist
What are some alternatives?
dhtcrawler2 - dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword
DHT-Torrent-database-Worker - I was learning to code. No bully. Old project built sometime in 2012. Crawls the DHT network, downloads torrent metadata from peers and uploads that torrent information into a database.
bitmagnet - A self-hosted BitTorrent indexer, DHT crawler, content classifier and torrent search engine with web UI, GraphQL API and Servarr stack integration.
ZAP - The ZAP core project
rarbg-selfhosted - A self-hosted Torznab API for the RARBG backup, compatible with Prowlarr, Radarr, Sonarr etc.
Magnetico - Autonomous (self-hosted) BitTorrent DHT search engine suite.
shiny-adventure - Torrent database project. The torrent database is populated by crawling the DHT network. Old POC Project.