edgesearch
fatcow-icons
| edgesearch | fatcow-icons | |
|---|---|---|
| 5 | 1 | |
| 464 | 5 | |
| - | - | |
| 0.0 | 5.5 | |
| about 2 years ago | 12 months ago | |
| Rust | JavaScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
edgesearch
-
Lifetime Annotations for C++
From https://westurner.github.io/hnlog/#comment-30603322 re https://en.wikipedia-on-ipfs.org/wiki/Database_index :
https://github.com/wilsonzlin/edgesearch :
> * Serverless full-text search with Cloudflare Workers, WebAssembly, and Roaring Bitmaps *
> "Edgesearch builds a reverse index by mapping terms to a compressed bit set (using Roaring Bitmaps) of IDs of documents containing the term, and creates a custom worker script and data to upload to Cloudflare Workers"
WASM or [C++] to WASM?
TIL about Roaring Bitmaps: /?q=roaring+bitmap https://medium.com/@amit.desai03/roaring-bitmaps-fast-data-s...
-
How does database indexing work?
https://en.wikipedia-on-ipfs.org/wiki/Database_index
https://news.ycombinator.com/item?id=28021766 re: edgesearch, HTTP/3 (QUIC (UDP))
> Serverless full-text search with Cloudflare Workers, WebAssembly, and Roaring Bitmaps https://github.com/wilsonzlin/edgesearch
>> How it works: Edgesearch builds a reverse index by mapping terms to a compressed bit set (using Roaring Bitmaps) of IDs of documents containing the term, and creates a custom worker script and data to upload to Cloudflare Workers
- Abusing AWS Lambda to Make an Aussie Search Engine
-
Serverless SQLite
I've also tried full-text-search in worker by pre-indexing the content, works very fast even with a JS engine - less than 5ms to make a search in 5MB of text.
It runs out of CPU-time at 6MB of text though.
There's someone that made a WASM for the same thing too, it's definitely faster and can handle a bit more text.
https://github.com/wilsonzlin/edgesearch
- Serverless Full-Text Search with Cloudflare Workers WebAssembly Roaring Bitmaps
fatcow-icons
-
Serverless SQLite
Hm, interesting. I made this, if you want to take a look: https://github.com/TomasHubelbauer/sqlite-javascript. You can test it using the Demo link in the readme and then use the prefilled value in the Load from URL prompt. Based on this I find your idea to be very doable. I didn't do it yet, but while working on this I had async fetching of pages using Range requests on my mind. Shame I didn't get to it when I was working on this project, could be easy to put together a demo. Similar to this I made https://github.com/TomasHubelbauer/fatcow-icons which parses a big ZIP file piece-wise on demand. As you scroll, new parts of the archive are fetched and icons extracted so you don't need to download the whole thing.
What are some alternatives?
edge-sql - Cloudflare Workers providing a SQL API
torrent-net - Distributed search engines using BitTorrent and SQLite
iconicicons - Free “do wtf you want with” pixel-perfect icons.
sql.js - A javascript library to run SQLite on the web.
PyO3 - Rust bindings for the Python interpreter
icons-flat-osx - Free Flat icons For OSX
dqlite - Embeddable, replicated and fault-tolerant SQL engine.
llvm-project - The home of the clang-based implementation of lifetime safety warnings.