sqlite-ecosystem
portable-hnsw
| sqlite-ecosystem | portable-hnsw | |
|---|---|---|
| 2 | 2 | |
| 119 | 78 | |
| - | - | |
| 4.7 | 7.3 | |
| 10 months ago | 27 days ago | |
| TypeScript | HTML | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlite-ecosystem
-
I'm writing a new vector search SQLite Extension
I definitely plan to! I have a much larger list of SQLite extensions I've built here: https://github.com/asg017/sqlite-ecosystem
Here's a few other references you may enjoy if you wanna learn more about SQLite extensions:
- The single source file for sqlite-vec: https://github.com/asg017/sqlite-vec/blob/main/sqlite-vec.c
- sqlean, a project from Anton Zhiyanov which is good base of great SQLite extensions: https://github.com/nalgeon/sqlean
- The official SQLite docs: https://www.sqlite.org/loadext.html
- The "hello world" SQLite extension example: https://www.sqlite.org/src/file/ext/misc/rot13.c
-
SQLite Extension for Efficient Vector Search
Author here, happy to answer any questions! My "Introducing sqlite-vss: A SQLite Extension for Vector Search" [0] blog post has more details about the motivations behind this extensions, along with a demo. Includes a semantic search engine hosted on Datasette, build with sqlite-vss and sentence-transformers, on fly.io. Simple and cheap!
Though my favorite part about this extension (and all my other SQLite extensions[1]): you can `pip install sqlite-vss` for Python, `npm install sqlite-vss` for Node.js, or use https://deno.land/x/sqlite_vss for Deno! The underlying SQLite extension has been compiled on different platforms and uploaded to pip/npm/deno.land/x to make distribution easier. There's also pre-compiled extensions on each Github release if you just want to use it with the sqlite3 CLI.
Currently working on getting Mac M1 arm builds, hopefully by end of this week [2]
[0] https://observablehq.com/@asg017/introducing-sqlite-vss
[1] https://github.com/asg017/sqlite-ecosystem
[2] https://github.com/asg017/sqlite-vss/issues/13
portable-hnsw
-
I'm writing a new vector search SQLite Extension
This is exciting!
This could really simplify a little CDN-based HNSW project I did (https://github.com/jasonjmcghee/portable-hnsw)
Seems like with duckdb vss you could just embed, store as duckdb format, then execute sql against it (in the CDN).
-
Show HN: HNSW-Based Search, in the Browser
Had so much fun making this.
So, I had a crazy idea.
What if you could search a vector store, in the browser, without a server?
As in, natural language search directly in the browser.
And what if you didn't need to load the entire thing in memory, so you could search a massive index without using a bunch of ram?
Anyway, I hope others enjoy it.
All the code is open source here: https://github.com/jasonjmcghee/portable-hnsw
What are some alternatives?
sqlite-vss - A SQLite extension for efficient vector search, based on Faiss!