edge-sql
edgesearch
| edge-sql | edgesearch | |
|---|---|---|
| 2 | 5 | |
| 555 | 464 | |
| - | - | |
| 1.8 | 0.0 | |
| over 3 years ago | about 2 years ago | |
| C | Rust | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
edge-sql
- Abusing AWS Lambda to Make an Aussie Search Engine
-
Serverless SQLite
edge-sql [1] allows arbitrary SQLite queries to be executed over an immutable external data set. The demo uses a Forex data set stored in Workers KV.
Client issued arbitrary queries is one of the use cases for GraphQL and publishing immutable data sets on the web is the main use case for Simon Wilson’s Datasette [2].
In-memory SQLite compiled to WASM works in the browser and Node.js too. In the future, we can expect proper ACID operations on any WASM runtime that supports fsync in WASI [3], a POSIX-like API.
[1] https://github.com/lspgn/edge-sql
[2] https://datasette.io/
[3] https://wasi.dev/
edgesearch
-
Lifetime Annotations for C++
From https://westurner.github.io/hnlog/#comment-30603322 re https://en.wikipedia-on-ipfs.org/wiki/Database_index :
https://github.com/wilsonzlin/edgesearch :
> * Serverless full-text search with Cloudflare Workers, WebAssembly, and Roaring Bitmaps *
> "Edgesearch builds a reverse index by mapping terms to a compressed bit set (using Roaring Bitmaps) of IDs of documents containing the term, and creates a custom worker script and data to upload to Cloudflare Workers"
WASM or [C++] to WASM?
TIL about Roaring Bitmaps: /?q=roaring+bitmap https://medium.com/@amit.desai03/roaring-bitmaps-fast-data-s...
-
How does database indexing work?
https://en.wikipedia-on-ipfs.org/wiki/Database_index
https://news.ycombinator.com/item?id=28021766 re: edgesearch, HTTP/3 (QUIC (UDP))
> Serverless full-text search with Cloudflare Workers, WebAssembly, and Roaring Bitmaps https://github.com/wilsonzlin/edgesearch
>> How it works: Edgesearch builds a reverse index by mapping terms to a compressed bit set (using Roaring Bitmaps) of IDs of documents containing the term, and creates a custom worker script and data to upload to Cloudflare Workers
- Abusing AWS Lambda to Make an Aussie Search Engine
-
Serverless SQLite
I've also tried full-text-search in worker by pre-indexing the content, works very fast even with a JS engine - less than 5ms to make a search in 5MB of text.
It runs out of CPU-time at 6MB of text though.
There's someone that made a WASM for the same thing too, it's definitely faster and can handle a bit more text.
https://github.com/wilsonzlin/edgesearch
- Serverless Full-Text Search with Cloudflare Workers WebAssembly Roaring Bitmaps
What are some alternatives?
dqlite - Embeddable, replicated and fault-tolerant SQL engine.
torrent-net - Distributed search engines using BitTorrent and SQLite
lsqlite - lua sqlite module
sql.js - A javascript library to run SQLite on the web.
fatcow-icons - FatCow icons v3.9.2 (I was given a permission to host these on GitHub by FatCow support.)
sqlite-gui - Lightweight SQLite editor for Windows
PyO3 - Rust bindings for the Python interpreter
dark - C practice - basic roguelike in SDL2 that compiles both for desktop and Emscripten
llvm-project - The home of the clang-based implementation of lifetime safety warnings.