chainlit
serge
| chainlit | serge | |
|---|---|---|
| 7 | 40 | |
| 5,535 | 5,553 | |
| 7.8% | 0.9% | |
| 9.7 | 9.8 | |
| 3 days ago | 7 days ago | |
| TypeScript | Svelte | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chainlit
-
Chat with your Github Repo using llama_index and chainlit
chainlit is open source project that makes it very easy to build frontend interfaces like chatgpt and other features that are required for conversational ai app, so we can focus on the core part and don't need to worry about basic things, and it is dead simple to work with
- Show HN: I made an app to use local AI as daily driver
- Help with conversational_qa_chain - Streamlit Messages
-
AI Chatbot powered by Amazon Bedrock 🚀🤖
I have created a sample chatbot application that uses Chainlit and LangChain to showcase Amazon Bedrock.
- Chainlit: Create ChatGPT-like UIs on top of Python code
-
Personal movie recommendation agent with GPT4 + Neo4J
For the interface, I'm using chainlit, a new UI library for building LLM apps, with an integration with Langchain.
- Chainlit/chainlit: Build Python LLM apps in minutes ⚡️
serge
- Show HN: I made an app to use local AI as daily driver
- chatgpt alternative
-
Show HN: LlamaGPT – Self-hosted, offline, private AI chatbot, powered by Llama 2
Very cool, this looks like a combination of chatbot-ui and llama-cpp-python? A similar project I've been using is https://github.com/serge-chat/serge. Nous-Hermes-Llama2-13b is my daily driver and scores high on coding evaluations (https://huggingface.co/spaces/mike-ravkine/can-ai-code-resul...).
-
LeCun: Qualcomm working with Meta to run Llama-2 on mobile devices
You might be pleased to hear that nothing really stops you from doing this today. If you ran Serge[0] on a Mac with Tailscale, you could hack together a decently-accelerated Llama chatbot.
[0] https://github.com/serge-chat/serge
-
Chatbot frontend library in Svelte?
Cannot help you with libraries specifically but both Serge and ChatUI are built using SvelteKit, so the code might be of some use to you.
- We’re back and…
-
Best way to use AMD CPU and GPU
Serge made it really easy for me to get started, but it all CPU-based.
-
Need Help
All that said this project probably solves your problem: https://github.com/serge-chat/serge
- Are you selfhosting a ChatGPT alternative?
-
What the hell??
You can play a little bit with more straightforward local models (the simplest to setup is https://github.com/nsarrazin/serge ), to see that any LLM is basically a party trick.
What are some alternatives?
langchain - 🦜🔗 Build context-aware reasoning applications
gpt4all - gpt4all: run open-source LLMs anywhere
nitro - Create apps 10x quicker, without Javascript/HTML/CSS.
langflow - ⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.
web-llm - Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.
llama.cpp - LLM inference in C/C++
dify - Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
open-webui - User-friendly WebUI for LLMs (Formerly Ollama WebUI)
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
react-llm - Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. Just useLLM().
llama-gpt - A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!