| AtomGPT | ray-llm | |
|---|---|---|
| 1 | 4 | |
| 189 | 1,181 | |
| - | 6.8% | |
| 10.0 | 8.6 | |
| 10 months ago | 17 days ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AtomGPT
ray-llm
- Aviary: Compare Open Source LLMs for cost, latency and quality
-
[N] Aviary: Comparing Open Source LLMs for cost, latency and quality
Aviary is a open source utility to compare leading OSS LLMs. https://aviary.anyscale.com/
- Anyscale's Aviary is a dashboard for evaluating Open Source LLMs
- Aviary simplifies OSS LLM eval and deployment
What are some alternatives?
realtime-bakllava - llama.cpp with BakLLaVA model describes what does it see
AutoGPTQ - An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
Cornucopia-LLaMA-Fin-Chinese - 聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)
chatgpt-extractive-shortener - Shortens a paragraph of text with ChatGPT, using successive rounds of word-level extractive summarization.
safe-rlhf - Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
GoLLIE - Guideline following Large Language Model for Information Extraction
HugNLP - CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊
Ray - Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
pinferencia - Python + Inference - Model Deployment library in Python. Simplest model inference server ever.