llm-package
Roy
llm-package | Roy | |
---|---|---|
1 | 1 | |
13 | 66 | |
- | - | |
7.5 | 8.0 | |
5 months ago | 7 months ago | |
Starlark | Jupyter Notebook | |
MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-package
-
One line local run to spin up model of your choice, parallel runs, chatbot UI and more!
Check it out here: https://github.com/kurtosis-tech/llm-package
Roy
-
My take on Microsoft's `autogen` for multi-agent chat: `Roy`
So, I spent the weekend putting together Roy. I tried to replicate some of its features but in what I hoped would be a simpler, more straightforward way.
What are some alternatives?
lightseq - LightSeq: A High Performance Library for Sequence Processing and Generation
autogen - A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
text-generation-inference - Large Language Model Text Generation Inference
SolidGPT - Developer AI Persona Search Agent
free-ai-chat-sites - 🤖 Several unofficial websites/mirrors for using "Closed"AI's Chat*** for free. We are not endorsing any of the listed services.
hngpt - Collecting my favoritet Hacker News stories by LangChain
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
lora-instruct - Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA
AtomGPT - 中英文预训练大模型,目标与ChatGPT的水平一致
gptq_for_langchain - A guide about how to use GPTQ models with langchain
Local-LLM-Langchain - Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
GPT-Agent - 🚀 Introducing 🐪 CAMEL: a game-changing role-playing approach for LLMs and auto-agents like BabyAGI & AutoGPT! Watch two agents 🤝 collaborate and solve tasks together, unlocking endless possibilities in #ConversationalAI, 🎮 gaming, 📚 education, and more! 🔥