flask-socketio-llm-com VS joia

https://github.com/russellballestrini/flask-socketio-llm-com...

This project is a chatroom application that allows users to join different chat rooms, send messages, and interact with multiple language models in real-time. The backend is built with Flask and Flask-SocketIO for real-time web communication, while the frontend uses HTML, CSS, and JavaScript to provide an interactive user interface.

demo here supports communication with `vllm/openchat`:

* http://home.foxhop.net:5001

next year I'm focusing on learning more about AI, I bought a $3.5k computer with an nvidia RTX 4090 24G of memory, it arrived today, I plan to extend my playground chat app to use local models for text generation and image generation inference (https://github.com/russellballestrini/flask-socketio-llm-com...)

I'm going to be looking into fine tuning process in some way.

https://github.com/russellballestrini/flask-socketio-llm-com...

I'm building a similar app but uses python/socket.io

I've built an open-source ChatGPT UI designed for team collaboration.

Github Link: https://github.com/joiahq/joia

Benefits vs the original:

Over the past few months, we've been building Joia, an open-source alternative to "ChatGPT for Teams" that allows organizations to provide their people with access to Large Language Models. Joia's Chat UI connects not only to OpenAI but also to any LLM, including popular open-source ones like Llama 2, Mixtral, and Zephyr.

We're thrilled to share our beta with you at https://github.com/joiahq/joia

Why We Built This:

We believe that all organizations, from startups to enterprises, will soon integrate LLMs into their day-to-day operations. And while the AI ecosystem is flourishing with a wide range of models, the current providers like ChatGPT, Bard or Copilot are creating closed environments that limit interactions to their owned models only.

We envision a future where AI is interoperable, and where people will choose the pick best model for their job. We are building Joia to make this freedom of choice a reality, offering an open-source product that is easy to use, organizations-ready and built for collaboration.

Features of Our Beta Version:

User Management: Easily provide user access to LLMs by adding them to a collaborative workspace.

Multi-LLM Access: Interact smoothly with models like GPT-4, Llama 2, Mixtral, Zephyr, Perplexity, Gemini, and others. More to be added soon.

Reusable Chatbots: Create pre-configured chatbots (also known as GPTs within the OpenAI ecosystem) and share them with your teammates.

Bring Your Own API Keys: Connect directly with the LLM provider of your choice by simply inserting their API keys. We currently support OpenAI, Openrouter, and Amazon Bedrock; with more to come soon.

Purchase Credits with Us and Consolidate Payments: In our cloud version, you can buy credits and centralize the billing for all users in the organization.

Open Source License: We offer the software under the Affero license, allowing anyone to self-host the platform.

We're still in the early stages and eagerly welcome your feedback and suggestions. Please feel free to try it out at no cost and tell us what you think.

Our main website: https://joia.so

GitHub: https://github.com/joiahq/joia

[Coming soon] Open source version: We are just preparing the code to make it available to anyone who wants to self host it. We'll also welcome anyone willing to contribute. Check out our Github Repository and star it if you're interested in the project!