flask-socketio-llm-com
agenthost
| flask-socketio-llm-com | agenthost | |
|---|---|---|
| 3 | 1 | |
| - | 7 | |
| - | - | |
| - | 9.7 | |
| - | 4 months ago | |
| Rust | ||
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flask-socketio-llm-com
-
Ask HN: What have you built with LLMs?
https://github.com/russellballestrini/flask-socketio-llm-com...
This project is a chatroom application that allows users to join different chat rooms, send messages, and interact with multiple language models in real-time. The backend is built with Flask and Flask-SocketIO for real-time web communication, while the frontend uses HTML, CSS, and JavaScript to provide an interactive user interface.
demo here supports communication with `vllm/openchat`:
* http://home.foxhop.net:5001
-
Ask HN: How to figure out a good direction/goals for the year ahead?
next year I'm focusing on learning more about AI, I bought a $3.5k computer with an nvidia RTX 4090 24G of memory, it arrived today, I plan to extend my playground chat app to use local models for text generation and image generation inference (https://github.com/russellballestrini/flask-socketio-llm-com...)
I'm going to be looking into fine tuning process in some way.
-
Open source alternative to ChatGPT and ChatPDF-like AI tools
https://github.com/russellballestrini/flask-socketio-llm-com...
I'm building a similar app but uses python/socket.io
agenthost
-
Ask HN: What have you built with LLMs?
I started working on a Rust based agent host with the goal of running locally. It has Rhai scripting built in which is what the agent calling function calling is based on. Very rough at the moment. Also on hold for me because I need to do more dirt cheap Upwork projects to scrape by this month.
I think what will be really powerful is to have a registry for plugins and agents that can be easily installed in the system. Sort of like WordPress in that way. Also similar to an open source GPT store.
https://github.com/runvnc/agenthost
I believe the are several variations of this type of idea out there.
What are some alternatives?
danswer - Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
OpenAAC - Open Augmentative and Alternative Communication
flask-socketio-llm-completions - Chatroom app where messages are sent to GPT, Claude, Mistral, Together, Groq AI and streamed to the frontend.
Constrained-Text-Generation-Studio - Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) workshop, jointly held at (COLING 2022)
datadm - DataDM is your private data assistant. Slide into your data's DMs
Modelfiles - Modelfiles pre-engineered for various tasks.
data-analytics - Welcome to the Data-Analytics repository
Language-games - Dead simple games made with word vectors.