sqlite-vss VS magic

I guess this is an answer to the GitHub issue I opened against SQLite-vss a couple of months ago?

https://github.com/asg017/sqlite-vss/issues/124

Perhaps sqlite-vss? It adds vector searches to sqlite.

https://github.com/asg017/sqlite-vss

Utilizing sqlite-vss to store and query vector embeddings managed by a local SQLite database, Semantify conducts fast, precise vector searches within these embeddings to find and recommend relevant content, ensuring readers are presented with articles that truly match their interests.

Whether you’re navigating through well-known options like SQLite, enriched with the sqlite-vss extension, or exploring other avenues like Chroma, an open-source vector database, selecting the right tool is paramount. This article compares these two choices, guiding you through the pros and cons of each, helping you choose the right tool for storing and querying vector embeddings for your project.

Here is a SQLite extension that uses Faiss under the hood.

https://github.com/asg017/sqlite-vss

Not associated with the project, just love SQLite and find it very useful.

Vector Databases: As your data grows, efficiently searching through millions of vectors can become a challenge. Specialized vector databases like FAISS, Annoy, or Elasticsearch's vector search capabilities can be explored to manage and search through large-scale vector data. Your sentence is grammatically correct. In addition, databases like SQLite and PostgreSQL have extensions, such as sqlite-vss and pgvector, that can be used to store and query vector embeddings, respectively.

I had a go at one of those a few months ago: https://datasette.io/plugins/datasette-faiss

Alex Garcia built a better one here as a SQLite Rust extension: https://github.com/asg017/sqlite-vss

Since the problem domain is that of anomaly detection from constructed request feature embeddings, I wonder if an ANN-search methodology using an embedded database (such as https://github.com/asg017/sqlite-vss or similar) was explored.

As I searched for "sqlite vector plugin" I didn't find any results, before a couple of weeks ago. Two weeks ago I found Alex' SQLite VSS plugin for SQLite. The library was an amazing piece of engineering from an "idea perspective". However, as I started playing around with it, I realised it was ipso facto like "Titanic". Beautiful and amazing, but destined to leak water and sink to the bottom of the ocean because of what we software engineers refers to as "memory leaks".

I've got an AI chatbot company, and because of that, I have to somehow relate to Google code. Google code is everywhere, and creating a website without using Google code is almost impossible for these reasons. Google Analytics being one reason, and Google reCAPTCHA being another reason. If you've got a website, there's a 99% probability that your site is running some Google code.

As an additional bonus, it completely eliminates all Postman script kiddies, since the client must be able to execute code to create a valid token. It also eliminates reusing the same token for multiple servers, since each server has their own unique public key - In addition to that you get to market your AI chatbot as "powered by Blockchain technology", and you can actually say that out loud with a straight face, without lying ... 🤪

As an AI chatbot provider, we need some serious bot protection to prevent malicious users from creating bots that attacks us. Google reCAPTCHA of course is "the industry standard" here, which I'm sure most readers are aware of.

I just swapped out Google Analytics with Plausible for AINIRO.IO. It’s only been a week, but so far I am super jazzed about it. First of all, Plausible doesn’t use cookies, so I can completely drop all cookie disclaimers and popups I had because of GDPR. Second of all, the site scores significantly better on load time. This results in a 10x better user experience for my website visitors, while making sure the website is still 100% conforming to GDPR laws.

After having owned an AI chatbot company for more than a year, I finally did what I'm supposed to do before I even start a company; I did a Competitor analysis - And o'boy should I have done it earlier.

We've got an AI chatbot for instance. On every single neutral parameter it's 10,000 times better than 99.99% of everything else out there. However, at ProductHunt you will have to go to "page 11,670" before you'll find our AI chatbot.

In addition I've got zero contributions to my primary projects. Some guy contributed to Lizzie a couple of years ago, but my primary project has zero contributions. Notice, I happen to know for a fact that there are a whole range of really, really, really rich companies using Magic for instance, some of whom are cashing in millions of dollars in profit every single year.

In addition Magic Cloud has now become a real business model, with a quite substantial amount of revenue, through our AI and Low-Code hosting provider. So to avoid having leeches exploiting our work for free without contributing in any ways, it's therefor with heavy heart we announce that all future releases of Magic will be in the form of closed source distributions.

I have an open source project myself, and I am building an AI and Low-Code/No-Code platform company on top of it. Contrary to SupaBase though, I have spent 4 years creating real value in my platform. The project solves a real problem, it consists of a lot of real innovations, and I’ve spent a lot of time building it.

Warning - This is not going to make any sense for anyone reading this, including me, so I won't try to make any sense of it - I'll let the reader interpret it in whatever way the reader wants to interpret it. However, when you're building an open source platform, such as our Magic Clouc, the first thing investors will ask you about is how many users you have.