SaaSHub helps you find the best software and product alternatives Learn more →
Airllm Alternatives
Similar projects and alternatives to airllm
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
supermemory
Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era.
-
-
-
finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
-
Awesome-Nano-Banana-images
A curated collection of fun and creative examples generated with Nano Banana & Nano Banana Pro🍌, Gemini-2.5-flash-image based model. We also release Nano-consistent-150K openly to support the community's development of image generation and unified models(click to website to see our blog)
-
Alpaca-CoT
We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台,我们欢迎开源爱好者发起任何有意义的pr!
-
diagram2graph
An AI Vision Language Model System for extracting structured knowledge graph information(JSON) from images of process diagrams
-
-
-
DocScribe
AI Medical Assistant to help doctors in summarising medical reports, patient history retrieval, and medical Q&A
airllm discussion
airllm reviews and mentions
-
AirLLM 70B inference with single 4GB GPU
For anyone wondering “how slow is this?”
IIUC, Kimi K3 on RTX 6000 Ada (48GB) takes 292 s/token
https://github.com/lyogavin/airllm/releases/tag/v3.1.0
- AirLLM: Kimi K3 (2.8T) inference with single 4GB GPU
- AirLLM Shrinks 70B LLMs to 4GB VRAM; DPO & Supermemory Boost Open Models
- AirLLM optimizes inference memory usage
-
Qwen3-Next: Towards Ultimate Training and Inference Efficiency
I have not used it but this is probably it: https://github.com/lyogavin/airllm
- Show HN: Run Llama3.1 405B on a 8GB VRAM challenge [video]
-
A note from our sponsor - SaaSHub
www.saashub.com | 13 Aug 2026
Stats
lyogavin/airllm is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of airllm is Jupyter Notebook.