flask-socketio-llm-completions VS Spliit

https://github.com/russellballestrini/flask-socketio-llm-com...

This project is a chatroom application that allows users to join different chat rooms, send messages, and interact with multiple language models in real-time. The backend is built with Flask and Flask-SocketIO for real-time web communication, while the frontend uses HTML, CSS, and JavaScript to provide an interactive user interface.

demo here supports communication with `vllm/openchat`:

* http://home.foxhop.net:5001

next year I'm focusing on learning more about AI, I bought a $3.5k computer with an nvidia RTX 4090 24G of memory, it arrived today, I plan to extend my playground chat app to use local models for text generation and image generation inference (https://github.com/russellballestrini/flask-socketio-llm-com...)

I'm going to be looking into fine tuning process in some way.

https://github.com/russellballestrini/flask-socketio-llm-com...

I'm building a similar app but uses python/socket.io

For my expense sharing app [1], I added receipt scanning in a few minutes and a few lines of code by using GPT 4 with Vision. I am aware that LLMs often are a solution looking for a problem, but there are some situations where a bit of magic is just great :)

It is a Next.js application, calling OpenAI’s API using a plain API route.

[1] https://spliit.app

I created the project a couple of years ago to learn Go, but I just rewrote it using a stack I am more comfortable with (Next.js). I also made it open source [1], to feel free to contribute ;)

[1] https://github.com/scastiel/spliit2

I totally rewrote it (migrating the existing data of course) with a technology I am more familiar with (Next.js, React, TailwindCSS, Prisma…), and made the new version open source! Feel free to contribute by creating an issue or even a pull-request if you want 😉.