deep-chat VS discourse-ai

Deep Chat has just received a huge update! You can now host entire LLMs on the browser. No servers, no connections, run it all in the comfort of your browser. Supported models include popular LLaMA and Mistral LLMs.

Check out the Open Source project to add it to your website: https://github.com/OvidijusParsiunas/deep-chat

Try it out live in the Deep Chat playground:

You provide examples of a backend endpoint for the major frameworks / languages. Such as PHP/Ruby/Go/.Net/Java/NextJS/Express etc.

Example: https://github.com/OvidijusParsiunas/deep-chat/tree/main/exa...

Check it out here: https://github.com/OvidijusParsiunas/deep-chat

That's super cool, thanks for sharing! I will share this as an easy to follow example of what we can with AI.

> Allowing a Q&A interface using these embeddings over the post contents could speed up research over the community posts (if you know the right questions to ask :P). Let's view some posts similar to this one complaining about function calling

That's indeed a great thing to surface, and that's exactly how the the OpenAI forum selects the "Related Topics" to show at the end of every topic. We use embeddings for this feature, and the entire thing is open-source: https://github.com/discourse/discourse-ai/blob/main/lib/embe...

We also embeddings for suggesting tags, categories, HyDE search and more. It's by far my favorite tech of this new AI/ML gen so far in terms of applicability.

> Using Twitter-roBERTa-base for sentiment analysis, we generated a post_sentiment label (negative, positive, neutral) and post_sentiment_score confidence score for each post.

We do the same, with even the same model, and conveniently show that information on the admin interface of the forum. Again all open source: https://github.com/discourse/discourse-ai/tree/main/lib/sent...

Disclaimer: I'm the tech lead on the AI parts of Discourse, the open source software that powers OpenAI's community forum.

Embedding cost and model choice makes this a very compelling choice. I'm working on leveraging embeddings in https://github.com/discourse/discourse-ai where it powers offering related topics, semantic search, tag and category recommendations among other things.

A cheap offering like this can make it a lot more reasonable for self-hosters.