llm-package
AtomGPT
llm-package | AtomGPT | |
---|---|---|
1 | 1 | |
13 | 189 | |
- | - | |
7.5 | 10.0 | |
6 months ago | 10 months ago | |
Starlark | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-package
-
One line local run to spin up model of your choice, parallel runs, chatbot UI and more!
Check it out here: https://github.com/kurtosis-tech/llm-package
AtomGPT
What are some alternatives?
lightseq - LightSeq: A High Performance Library for Sequence Processing and Generation
realtime-bakllava - llama.cpp with BakLLaVA model describes what does it see
text-generation-inference - Large Language Model Text Generation Inference
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
free-ai-chat-sites - 🤖 Several unofficial websites/mirrors for using "Closed"AI's Chat*** for free. We are not endorsing any of the listed services.
chatgpt-extractive-shortener - Shortens a paragraph of text with ChatGPT, using successive rounds of word-level extractive summarization.
Roy - Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.
GoLLIE - Guideline following Large Language Model for Information Extraction
safe-rlhf - Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
ray-llm - RayLLM - LLMs on Ray
pinferencia - Python + Inference - Model Deployment library in Python. Simplest model inference server ever.