AiFilter
flask-socketio-llm-completions
AiFilter | flask-socketio-llm-completions | |
---|---|---|
2 | 6 | |
50 | 31 | |
- | - | |
5.9 | 9.0 | |
3 months ago | 6 days ago | |
JavaScript | Python | |
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AiFilter
-
Ask HN: What have you built with LLMs?
A Twitter filter to take back control of your social media feed from recommendation engines. Put in natural language instructions like "Only show tweets about machine learning, artificial intelligence, and large language models. Hide everything else" and it will filter out all the tweets that you tell it to.
Runs on a local LLM, because even using GPT3 costs would have added up quickly.
Currently requires CUDA and uses a 10.7B model but if anyone wants to try a smaller one and report results let me know on github and I can give some help.
https://github.com/thomasj02/AiFilter
-
Show HN: AI-Powered Twitter Filter
While exploring new applications for local LLMs, I built a Chrome extension that filters your Twitter feed based on natural language instructions.
For instance, you can instruct it to "Hide all tweets, except for tweets about machine learning (ML), artificial intelligence (AI) and large language models (LLMs)."
I've tested it and got good results with a 10B parameter model, but I suspect a high-quality small model like Phi-2 might work almost as well.
It's open source and available at https://github.com/thomasj02/AiFilter
Video demo: https://www.youtube.com/watch?v=CligVVTC5io
flask-socketio-llm-completions
-
Ask HN: What have you built with LLMs?
https://github.com/russellballestrini/flask-socketio-llm-com...
This project is a chatroom application that allows users to join different chat rooms, send messages, and interact with multiple language models in real-time. The backend is built with Flask and Flask-SocketIO for real-time web communication, while the frontend uses HTML, CSS, and JavaScript to provide an interactive user interface.
demo here supports communication with `vllm/openchat`:
* http://home.foxhop.net:5001
-
Ask HN: How to figure out a good direction/goals for the year ahead?
next year I'm focusing on learning more about AI, I bought a $3.5k computer with an nvidia RTX 4090 24G of memory, it arrived today, I plan to extend my playground chat app to use local models for text generation and image generation inference (https://github.com/russellballestrini/flask-socketio-llm-com...)
I'm going to be looking into fine tuning process in some way.
- Alternative Front End to GPT, Claude, or Mistral Flask/Socketio
-
Open source alternative to ChatGPT and ChatPDF-like AI tools
https://github.com/russellballestrini/flask-socketio-llm-com...
I'm building a similar app but uses python/socket.io
- Python Flask-SocketIO Chatroom with OpenAI & Claude Integration | alternative to ChatGPT frontend
- Show HN: Chatroom app to interact with multiple LLMs in real-time
What are some alternatives?
Language-games - Dead simple games made with word vectors.
flask-socketio-llm-com
data-analytics - Welcome to the Data-Analytics repository
Modelfiles - Modelfiles pre-engineered for various tasks.
AutoRAG - RAG AutoML Tool - Find optimal RAG pipeline for your own data.