Python llama

Open-source Python projects categorized as llama

Top 23 Python llama Projects

  • Chinese-LLaMA-Alpaca

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

    Project mention: Chinese-Alpaca-Plus-13B-GPTQ | /r/LocalLLaMA | 2023-05-30

    I'd like to share with you today the Chinese-Alpaca-Plus-13B-GPTQ model, which is the GPTQ format quantised 4bit models of Yiming Cui's Chinese-LLaMA-Alpaca 13B for GPU reference.

  • LLaVA

    [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

    Project mention: Show HN: I Remade the Fake Google Gemini Demo, Except Using GPT-4 and It's Real | | 2023-12-10

    Update: For anyone else facing the commercial use question on LLaVA - it is licensed under Apache 2.0. Can be used commercially with attribution:


    Learn 300+ open source libraries for free using AI. LearnThisRepo lets you learn 300+ open source repos including Postgres, Langchain, VS Code, and more by chatting with them using AI!

  • LLaMA-Factory

    Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

    Project mention: Show HN: GPU Prices on eBay | | 2024-02-23

    Depends what model you want to train, and how well you want your computer to keep working while you're doing it.

    If you're interested in large language models there's a table of vram requirements for fine-tuning at [1] which says you could do the most basic type of fine-tuning on a 7B parameter model with 8GB VRAM.

    You'll find that training takes quite a long time, and as a lot of the GPU power is going on training, your computer's responsiveness will suffer - even basic things like scrolling in your web browser or changing tabs uses the GPU, after all.

    Spend a bit more and you'll probably have a better time.


  • petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    Project mention: Distributed Inference and Fine-Tuning of Large Language Models over the Internet | | 2024-01-02

    Can check out their project at

  • shell_gpt

    A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.

  • Baichuan-7B

    A large-scale 7B pretraining language model developed by BaiChuan-Inc.

    Project mention: Baichuan 7B reaches top of LLM leaderboard for it's size (New foundation model 4K tokens) | /r/LocalLLaMA | 2023-06-17

    GitHub: baichuan-inc/baichuan-7B: A large-scale 7B pretraining language model developed by BaiChuan-Inc. (

  • Huatuo-Llama-Med-Chinese

    Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草(原名:华驼)模型仓库,基于中文医学知识的大语言模型指令微调

    Project mention: Local medical LLM | /r/LocalLLaMA | 2023-06-09


  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • InternGPT

    InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

    Project mention: How do I use the programs on Github? | /r/github | 2023-06-16

    You can also create an issue and ask the developers for help.

  • xTuring

    Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community:

    Project mention: I'm developing an open-source AI tool called xTuring, enabling anyone to construct a Language Model with just 5 lines of code. I'd love to hear your thoughts! | /r/machinelearningnews | 2023-09-07

    Explore the project on GitHub here.

  • mergekit

    Tools for merging pretrained large language models.

    Project mention: Tools for merging pretrained large language models | | 2024-01-23
  • Video-LLaMA

    [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

    Project mention: Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding | /r/aipromptprogramming | 2023-06-19
  • mPLUG-Owl

    mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model

    Project mention: Unleash the Power of Video-LLaMA: Revolutionizing Language Models with Video and Audio Understanding! | | 2023-06-12

    We extend our deepest gratitude to the extraordinary projects that have influenced and contributed to the development of Video-LLaMA. We're indebted to MiniGPT-4, FastChat, BLIP-2, EVA-CLIP, ImageBind, LLaMA, VideoChat, LLaVA, WebVid, and mPLUG-Owl for their invaluable contributions. Special thanks to Midjourney for creating the stunning Video-LLaMA logo, encapsulating the essence of our groundbreaking project.

  • api-for-open-llm

    Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

    Project mention: FLaNK Stack Weekly for 14 Aug 2023 | | 2023-08-14
  • lightllm

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Project mention: FLaNK Weekly 31 December 2023 | | 2023-12-31
  • Multimodal-GPT


    Project mention: Meet MultiModal-GPT: A Vision and Language Model for Multi-Round Dialogue with Humans | /r/machinelearningnews | 2023-05-19
  • safe-rlhf

    Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

    Project mention: [R] Meet Beaver-7B: a Constrained Value-Aligned LLM via Safe RLHF Technique | /r/MachineLearning | 2023-05-16
  • LLMCompiler

    LLMCompiler: An LLM Compiler for Parallel Function Calling

    Project mention: FLaNK Weekly 18 Dec 2023 | | 2023-12-18
  • GenossGPT

    One API for all LLMs either Private or Public (Anthropic, Llama V2, GPT 3.5/4, Vertex, GPT4ALL, HuggingFace ...) 🌈🐂 Replace OpenAI GPT with any LLMs in your app with one line.

    Project mention: Drop-in replacement for the OpenAI API based on open source LLMs | | 2024-01-17
  • lag-llama

    Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

    Project mention: FLaNK Stack Weekly 19 Feb 2024 | | 2024-02-19
  • kani

    kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023) (by zhudotexe)

    Project mention: Kani: A Lightweight, Highly Hackable Framework for Building LMs with Tool Usage | | 2023-09-12
  • Cornucopia-LLaMA-Fin-Chinese

    聚宝盆(Cornucopia): 中文金融系列开源可商用大模型,并提供一套高效的金融垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

    Project mention: Cornucopia-LLaMA-Fin-Chinese: NEW Textual - star count:263.0 | /r/algoprojects | 2023-07-31
  • code-llama-for-vscode

    Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.

    Project mention: Stable Code 3B: Coding on the Edge | | 2024-01-16

    How are people using codellama and this in their workflows?

    I found one option:

    But I'm guessing there are others, and they might differ in how they provide context to the model.

  • Finetune_LLMs

    Repo for fine-tuning Casual LLMs

  • WorkOS

    The modern API for authentication & user identity. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-23.

Python llama related posts


What are some of the best open-source llama projects in Python? This list will help you:

Project Stars
1 Chinese-LLaMA-Alpaca 16,405
2 LLaVA 14,073
3 LLaMA-Factory 11,688
4 petals 8,408
5 shell_gpt 7,451
6 Baichuan-7B 5,542
7 Huatuo-Llama-Med-Chinese 4,060
8 InternGPT 3,064
9 xTuring 2,466
10 mergekit 2,281
11 Video-LLaMA 2,168
12 mPLUG-Owl 1,779
13 api-for-open-llm 1,636
14 lightllm 1,485
15 Multimodal-GPT 1,359
16 safe-rlhf 1,060
17 LLMCompiler 915
18 GenossGPT 710
19 lag-llama 608
20 kani 515
21 Cornucopia-LLaMA-Fin-Chinese 481
22 code-llama-for-vscode 464
23 Finetune_LLMs 427
The modern API for authentication & user identity.
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.