AiFilter
flask-socketio-llm-com
AiFilter | flask-socketio-llm-com | |
---|---|---|
2 | 3 | |
50 | - | |
- | - | |
5.9 | - | |
3 months ago | - | |
JavaScript | ||
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AiFilter
-
Ask HN: What have you built with LLMs?
A Twitter filter to take back control of your social media feed from recommendation engines. Put in natural language instructions like "Only show tweets about machine learning, artificial intelligence, and large language models. Hide everything else" and it will filter out all the tweets that you tell it to.
Runs on a local LLM, because even using GPT3 costs would have added up quickly.
Currently requires CUDA and uses a 10.7B model but if anyone wants to try a smaller one and report results let me know on github and I can give some help.
https://github.com/thomasj02/AiFilter
-
Show HN: AI-Powered Twitter Filter
While exploring new applications for local LLMs, I built a Chrome extension that filters your Twitter feed based on natural language instructions.
For instance, you can instruct it to "Hide all tweets, except for tweets about machine learning (ML), artificial intelligence (AI) and large language models (LLMs)."
I've tested it and got good results with a 10B parameter model, but I suspect a high-quality small model like Phi-2 might work almost as well.
It's open source and available at https://github.com/thomasj02/AiFilter
Video demo: https://www.youtube.com/watch?v=CligVVTC5io
flask-socketio-llm-com
-
Ask HN: What have you built with LLMs?
https://github.com/russellballestrini/flask-socketio-llm-com...
This project is a chatroom application that allows users to join different chat rooms, send messages, and interact with multiple language models in real-time. The backend is built with Flask and Flask-SocketIO for real-time web communication, while the frontend uses HTML, CSS, and JavaScript to provide an interactive user interface.
demo here supports communication with `vllm/openchat`:
* http://home.foxhop.net:5001
-
Ask HN: How to figure out a good direction/goals for the year ahead?
next year I'm focusing on learning more about AI, I bought a $3.5k computer with an nvidia RTX 4090 24G of memory, it arrived today, I plan to extend my playground chat app to use local models for text generation and image generation inference (https://github.com/russellballestrini/flask-socketio-llm-com...)
I'm going to be looking into fine tuning process in some way.
-
Open source alternative to ChatGPT and ChatPDF-like AI tools
https://github.com/russellballestrini/flask-socketio-llm-com...
I'm building a similar app but uses python/socket.io
What are some alternatives?
Language-games - Dead simple games made with word vectors.
danswer - Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
data-analytics - Welcome to the Data-Analytics repository
flask-socketio-llm-completions - Chatroom app where messages are sent to GPT, Claude, Mistral, Together, Groq AI and streamed to the frontend.
datadm - DataDM is your private data assistant. Slide into your data's DMs
Modelfiles - Modelfiles pre-engineered for various tasks.
agenthost