WCDB
Magnetico
DISCONTINUED
Our great sponsors
WCDB | Magnetico | |
---|---|---|
2 | 14 | |
10,013 | 2,665 | |
0.8% | - | |
9.7 | 1.7 | |
18 days ago | about 2 years ago | |
C | Go | |
GNU General Public License v3.0 or later | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
WCDB
-
Awesome macOS Libraries List
WCDB - WCDB is a cross-platform database framework developed by WeChat. Language: C.
-
Cross-Database Queries in SQLite
SQLite is so ubiquitous you'd be hard pressed to find an app or service that doesn't use it.
Look through the licenses for the software included as part of your phone's OS. You'll find SQLite in there.
Search GitHub for sqlite, there are several projects with thousands of stars that use SQLite. Here's one: https://github.com/Tencent/wcdb
Magnetico
-
Bitmagnet: A self-hosted BitTorrent indexer, DHT crawler, and torrent search
This is really neat. I'll need to check it out. A couple years ago I ran my own instance of Magnetico (https://github.com/boramalper/magnetico), but this project looks a lot more polished.
-
DHT crawler
This is likely your best bet, but I'd recommend you use postgres over sqlite, this is however where development died so some features like search or stats aren't implemented while using pg as the db.
-
Ask HN: I've Built a DHT Torrent Sniffer and Search Engine. Should I Release?
https://github.com/boramalper/magnetico
Someone else did this a while back, universe continues to exist.
-
Popcorn Time Is Back
I just get a rickroll gif on your link. Did you mean this project?
"Autonomous (self-hosted) BitTorrent DHT search engine suite."
-
Self Hosted Open Source Torrent Scraper!
Although I admit, that I would love to see a maintained DHT search solution (like magnetico or dhtcrawler2).
- What does a 'good' GitHub page like? (Q for the Professionals)
-
I2P applications wish list?
A magnet search is easy enough to self-host, I can provide you with instructions to self-host a clearnet magnet search engine over I2P in the meantime, but you can probably figure it out from this: https://github.com/boramalper/magnetico which is an easy to self-host DHT search engine.
-
Privacy using our Tor-inspired onion routing
> you can passively collect info from the DHT swarm and build up an index over time
For anyone wanting to pursue this, I feel like I can share, I used this recently https://github.com/boramalper/magnetico, people share database dumps regular. I found ~4 dumps and merged them for ~1x,xxx,xxx entries.
-
Show HN: Torrentinim – low memory-footprint, API-only torrent search engine
Magnetico[1] is an easy-to-use, self-hosted DHT crawler. It has a web UI that shows statistics and gives you a search engine (it uses sqlite full-text search).
It needs quite a bit of bandwidth and some storage space, but worked well so far, for me. I've been running it for a couple of years and it indexed around 12.5M torrents (36GB of uncompressed database).
-
Cross-Database Queries in SQLite
I'm using magnetico (https://github.com/boramalper/magnetico), a selfhosted bittorrent DHT scraper. After a few months of running I now have a little bit under 1M magnets in a ~3G database. SQLite is useful not just because I can query it with the full power of a relational database, but because I'm using its FTS capability for searching.
If I had to install a typical database or some search engine I would never have used it. It is more than enough for what I'm using it for.
What are some alternatives?
torrent-paradise - Decentralized DHT search site for IPFS
dhtcrawler2 - dhtcrawler is a DHT crawler written in erlang. It can join a DHT network and crawl many P2P torrents. The program save all torrent info into database and provide an http interface to search a torrent by a keyword
torrentinim - A very low memory-footprint, self hosted API-only torrent search engine. Sonarr + Radarr Compatible, native support for Linux, Mac and Windows.
GRDB.swift - A toolkit for SQLite databases, with a focus on application development
Realm - Realm is a mobile database: a replacement for Core Data & SQLite
MMKV - An efficient, small mobile key-value storage framework developed by WeChat. Works on Android, iOS, macOS, Windows, and POSIX.
cloud-torrent - ☁️ Cloud Torrent: a self-hosted remote torrent client
peerflix-server - Streaming torrent client for Node.js with web ui.
SQLite.swift - A type-safe, Swift-language layer over SQLite3.
bittorrent-tracker - 🌊 Simple, robust, BitTorrent tracker (client & server) implementation
magnetissimo - Web application that indexes all popular torrent sites, and saves it to the local database.
FMDB - A Cocoa / Objective-C wrapper around SQLite