sqlite-ecosystem
sqlite-vss
sqlite-ecosystem | sqlite-vss | |
---|---|---|
2 | 17 | |
119 | 1,529 | |
- | - | |
4.7 | 6.8 | |
10 months ago | 26 days ago | |
TypeScript | C++ | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sqlite-ecosystem
-
I'm writing a new vector search SQLite Extension
I definitely plan to! I have a much larger list of SQLite extensions I've built here: https://github.com/asg017/sqlite-ecosystem
Here's a few other references you may enjoy if you wanna learn more about SQLite extensions:
- The single source file for sqlite-vec: https://github.com/asg017/sqlite-vec/blob/main/sqlite-vec.c
- sqlean, a project from Anton Zhiyanov which is good base of great SQLite extensions: https://github.com/nalgeon/sqlean
- The official SQLite docs: https://www.sqlite.org/loadext.html
- The "hello world" SQLite extension example: https://www.sqlite.org/src/file/ext/misc/rot13.c
-
SQLite Extension for Efficient Vector Search
Author here, happy to answer any questions! My "Introducing sqlite-vss: A SQLite Extension for Vector Search" [0] blog post has more details about the motivations behind this extensions, along with a demo. Includes a semantic search engine hosted on Datasette, build with sqlite-vss and sentence-transformers, on fly.io. Simple and cheap!
Though my favorite part about this extension (and all my other SQLite extensions[1]): you can `pip install sqlite-vss` for Python, `npm install sqlite-vss` for Node.js, or use https://deno.land/x/sqlite_vss for Deno! The underlying SQLite extension has been compiled on different platforms and uploaded to pip/npm/deno.land/x to make distribution easier. There's also pre-compiled extensions on each Github release if you just want to use it with the sqlite3 CLI.
Currently working on getting Mac M1 arm builds, hopefully by end of this week [2]
[0] https://observablehq.com/@asg017/introducing-sqlite-vss
[1] https://github.com/asg017/sqlite-ecosystem
[2] https://github.com/asg017/sqlite-vss/issues/13
sqlite-vss
-
I'm writing a new vector search SQLite Extension
I guess this is an answer to the GitHub issue I opened against SQLite-vss a couple of months ago?
https://github.com/asg017/sqlite-vss/issues/124
-
Embeddings are a good starting point for the AI curious app developer
Perhaps sqlite-vss? It adds vector searches to sqlite.
https://github.com/asg017/sqlite-vss
-
How to Enhance Content with Semantify
Utilizing sqlite-vss to store and query vector embeddings managed by a local SQLite database, Semantify conducts fast, precise vector searches within these embeddings to find and recommend relevant content, ensuring readers are presented with articles that truly match their interests.
-
SQLite vs. Chroma: A Comparative Analysis for Managing Vector Embeddings
Whether you’re navigating through well-known options like SQLite, enriched with the sqlite-vss extension, or exploring other avenues like Chroma, an open-source vector database, selecting the right tool is paramount. This article compares these two choices, guiding you through the pros and cons of each, helping you choose the right tool for storing and querying vector embeddings for your project.
-
Vector database is not a separate database category
Here is a SQLite extension that uses Faiss under the hood.
https://github.com/asg017/sqlite-vss
Not associated with the project, just love SQLite and find it very useful.
- SQLite-Vss: A SQLite Extension for Vector Search
-
Introduction to Vector Search and Embeddings
Vector Databases: As your data grows, efficiently searching through millions of vectors can become a challenge. Specialized vector databases like FAISS, Annoy, or Elasticsearch's vector search capabilities can be explored to manage and search through large-scale vector data. Your sentence is grammatically correct. In addition, databases like SQLite and PostgreSQL have extensions, such as sqlite-vss and pgvector, that can be used to store and query vector embeddings, respectively.
-
The Problem with LangChain
I had a go at one of those a few months ago: https://datasette.io/plugins/datasette-faiss
Alex Garcia built a better one here as a SQLite Rust extension: https://github.com/asg017/sqlite-vss
-
Every request, every microsecond: scalable machine learning at Cloudflare
Since the problem domain is that of anomaly detection from constructed request feature embeddings, I wonder if an ANN-search methodology using an embedded database (such as https://github.com/asg017/sqlite-vss or similar) was explored.
-
Disrupting the AI Scene with Open Source and Open Innovation
As I searched for "sqlite vector plugin" I didn't find any results, before a couple of weeks ago. Two weeks ago I found Alex' SQLite VSS plugin for SQLite. The library was an amazing piece of engineering from an "idea perspective". However, as I started playing around with it, I realised it was ipso facto like "Titanic". Beautiful and amazing, but destined to leak water and sink to the bottom of the ocean because of what we software engineers refers to as "memory leaks".
What are some alternatives?
semantic-kernel - Integrate cutting-edge LLM technology quickly and easily into your apps
chroma - the AI-native open-source embedding database
pgvector-go - pgvector support for Go
milvus-lite - A lightweight version of Milvus
typesense-instantsearch-semantic-search-demo - A demo that shows how to build a semantic search experience with Typesense's vector search feature and Instantsearch.js
txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
multi-gpt - A Clojure interface into the GPT API with advanced tools like conversational memory, task management, and more
go-faiss - This is a go library for faiss
autofaiss - Automatically create Faiss knn indices with the most optimal similarity search parameters.
gchain - Composable LLM Application framework inspired by langchain
awesome-vector-search - Collections of vector search related libraries, service and research papers
simpleaichat - Python package for easily interfacing with chat apps, with robust features and minimal code complexity.