torrent-net
edgesearch
Our great sponsors
| torrent-net | edgesearch | |
|---|---|---|
| 12 | 5 | |
| 1,019 | 464 | |
| - | - | |
| 0.0 | 0.0 | |
| 4 months ago | about 2 years ago | |
| C | Rust | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
torrent-net
- Database-Less Torrent Website
-
distributed internet search
Another suggestion, sqltorrent has been used to do something like this...torrent-net
-
How to circumvent Sci-Hub ISP block
I believe this is the project mentioned
https://github.com/lmatteis/torrent-net
- torrent-net - distributed search engines using BitTorrent and SQLite
- Distributed search engines using BitTorrent and SQLite
edgesearch
-
Lifetime Annotations for C++
From https://westurner.github.io/hnlog/#comment-30603322 re https://en.wikipedia-on-ipfs.org/wiki/Database_index :
https://github.com/wilsonzlin/edgesearch :
> * Serverless full-text search with Cloudflare Workers, WebAssembly, and Roaring Bitmaps *
> "Edgesearch builds a reverse index by mapping terms to a compressed bit set (using Roaring Bitmaps) of IDs of documents containing the term, and creates a custom worker script and data to upload to Cloudflare Workers"
WASM or [C++] to WASM?
TIL about Roaring Bitmaps: /?q=roaring+bitmap https://medium.com/@amit.desai03/roaring-bitmaps-fast-data-s...
-
How does database indexing work?
https://en.wikipedia-on-ipfs.org/wiki/Database_index
https://news.ycombinator.com/item?id=28021766 re: edgesearch, HTTP/3 (QUIC (UDP))
> Serverless full-text search with Cloudflare Workers, WebAssembly, and Roaring Bitmaps https://github.com/wilsonzlin/edgesearch
>> How it works: Edgesearch builds a reverse index by mapping terms to a compressed bit set (using Roaring Bitmaps) of IDs of documents containing the term, and creates a custom worker script and data to upload to Cloudflare Workers
- Abusing AWS Lambda to Make an Aussie Search Engine
-
Serverless SQLite
I've also tried full-text-search in worker by pre-indexing the content, works very fast even with a JS engine - less than 5ms to make a search in 5MB of text.
It runs out of CPU-time at 6MB of text though.
There's someone that made a WASM for the same thing too, it's definitely faster and can handle a bit more text.
https://github.com/wilsonzlin/edgesearch
- Serverless Full-Text Search with Cloudflare Workers WebAssembly Roaring Bitmaps
What are some alternatives?
torrent-paradise - Decentralized DHT search site for IPFS
edge-sql - Cloudflare Workers providing a SQL API
sql.js - A javascript library to run SQLite on the web.
GreenTunnel - GreenTunnel is an anti-censorship utility designed to bypass the DPI system that is put in place by various ISPs to block access to certain websites.
fatcow-icons - FatCow icons v3.9.2 (I was given a permission to host these on GitHub by FatCow support.)
PyO3 - Rust bindings for the Python interpreter
IPSQL - InterPlanetary SQL
dqlite - Embeddable, replicated and fault-tolerant SQL engine.
sqltorrent
llvm-project - The home of the clang-based implementation of lifetime safety warnings.