Python Gpt

Open-source Python projects categorized as Gpt

Top 23 Python Gpt Projects

  • gpt4free

    The official gpt4free repository | various collection of powerful language models

    Project mention: gpt4-openai-api VS gpt4free - a user suggested alternative | | 2024-01-04

    I cant install

  • MetaGPT

    🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo

    Project mention: Can AI replace a co-founder? | | 2024-01-07 :

    > MetaGPT takes a one line requirement as input and outputs user stories / competitive analysis / requirements / data structures / APIs / documents, etc. ; "Co-Founder Equity Calculator"

    "Ask HN: What are your go to SaaS products for startups/MVPs?" (2020) ; FounderKit, StackShare

    > USA Small Business Administration: "10 steps to start your business."

    >> "Startup Incorporation Checklist: How to bootstrap a Delaware C-corp (or S-corp) with employee(s) in California"

  • Onboard AI

    ChatGPT with full context of any GitHub repo. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at

  • MindsDB

    The middleware for building custom AI, enabling smarter organizations.

    Project mention: Fine-tuning a Mistral Language Model with Anyscale | | 2024-02-01

    MindsDB is an open-source AI platform for developers that connects AI/ML models with real-time data. It provides tools and automation to easily build and maintain personalized AI solutions.

  • dify

    An Open-Source Assistants API and GPTs alternative. Dify.AI is an LLM application development platform. It integrates the concepts of Backend as a Service and LLMOps, covering the core tech stack required for building generative AI-native applications, including a built-in RAG engine.

    Project mention: GreptimeAI + Xinference - Efficient Deployment and Monitoring of Your LLM Applications | | 2024-01-24

    Xorbits Inference (Xinference) is an open-source platform to streamline the operation and integration of a wide array of AI models. With Xinference, you’re empowered to run inference using any open-source LLMs, embedding models, and multimodal models either in the cloud or on your own premises, and create robust AI-driven applications. It provides a RESTful API compatible with OpenAI API, Python SDK, CLI, and WebUI. Furthermore, it integrates third-party developer tools like LangChain, LlamaIndex, and Dify, facilitating model integration and development.

  • vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Project mention: Show HN: We got fine-tuning Mistral-7B to not suck | | 2024-02-07

    Great question! scheduling workloads onto GPUs in a way where VRAM is being utilised efficiently was quite the challenge.

    What we found was the IO latency for loading model weights into VRAM will kill responsiveness if you don't "re-use" sessions (i.e. where the model weights remain loaded and you run multiple inference sessions over the same loaded weights).

    Obviously projects like exist but we needed to build out a scheduler that can run a fleet of GPUs for a matrix of text/image vs inference/finetune sessions.

    disclaimer: I work on Helix

  • best-of-ml-python

    🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

  • LLaVA

    [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

    Project mention: Show HN: I Remade the Fake Google Gemini Demo, Except Using GPT-4 and It's Real | | 2023-12-10

    Update: For anyone else facing the commercial use question on LLaVA - it is licensed under Apache 2.0. Can be used commercially with attribution:

  • WorkOS

    The modern API for authentication & user identity. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • DocsGPT

    GPT-powered chat for documentation, chat with your documents

    Project mention: You can earn free shirt by contributing to DocsGPT | /r/hacktoberfest | 2023-10-03
  • LLaMA-Factory

    Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

    Project mention: Show HN: GPU Prices on eBay | | 2024-02-23

    Depends what model you want to train, and how well you want your computer to keep working while you're doing it.

    If you're interested in large language models there's a table of vram requirements for fine-tuning at [1] which says you could do the most basic type of fine-tuning on a 7B parameter model with 8GB VRAM.

    You'll find that training takes quite a long time, and as a lot of the GPU power is going on training, your computer's responsiveness will suffer - even basic things like scrolling in your web browser or changing tabs uses the GPU, after all.

    Spend a bit more and you'll probably have a better time.



    RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

    Project mention: Do LLMs need a context window? | | 2023-12-25 lists a number of implementations of various versions of RWKV. :

    > RWKV: Parallelizable RNN with Transformer-level LLM Performance (pronounced as "RwaKuv", from 4 major params: R W K V)

    > RWKV is an RNN with Transformer-level LLM performance, which can also be directly trained like a GPT transformer (parallelizable). And it's 100% attention-free. You only need the hidden state at position t to compute the state at position t+1. You can use the "GPT" mode to quickly compute the hidden state for the "RNN" mode.

    > So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding (using the final hidden state).

    > "Our latest version is RWKV-6,*

  • petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    Project mention: Distributed Inference and Fine-Tuning of Large Language Models over the Internet | | 2024-01-02

    Can check out their project at

  • promptflow

    Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

    Project mention: Promptflow | | 2023-10-11
  • text-generation-inference

    Large Language Model Text Generation Inference

    Project mention: FLaNK Stack 05 Feb 2024 | | 2024-02-05
  • VALL-E-X

    An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in

    Project mention: FLaNK Stack Weekly 12 February 2024 | | 2024-02-12
  • awesome-open-gpt

    Collection of Open Source Projects Related to GPT,GPT相关开源项目合集🚀、精选🔥🔥

    Project mention: The best free ChatGPT alternatives | /r/ArtificialInteligence | 2023-06-20

    Extract from awesome-open-gpt

  • marvin

    ✨ Build AI interfaces that spark joy

    Project mention: Show HN: Marvin 2.0 – a lightweight, multi-modal AI toolkit | | 2024-01-17

    Hey HN! We just released Marvin 2.0.

    Marvin is an AI toolkit for developers who want to use LLMs with traditional software. We still see significant challenges integrating LLMs because of how difficult it is to get them to reliably accept and return structured data. Marvin consists of independent, functional tools that address this problem in a variety of ways.

    Marvin has always been focused on using LLMs to work with native Python datatypes and Pydantic models. In 2.0 we've expanded this significantly with dedicated APIs for the most common use cases we've seen over the last year: classification, entity extraction, transforming data to types, and generating synthetic data. Marvin 2.0 is also fully multi-modal and supports images as inputs for classification, extraction, and transformation tasks (as well as simple image and speech generation). We've also introduces a Pythonic interface to OpenAI's assistants API, which now powers all of Marvin's interactive components.

    We've tried to make an LLM framework that "sparks joy" and captures that same feeling you had the first time you saw an LLM in action. Try it out and let us know what you think!


  • marqo

    Unified embedding generation and search engine. Also available on cloud -

    Project mention: Are we at peak vector database? | | 2024-01-25

    We (Marqo) are doing a lot on 1 and 2. There is a huge amount to be done on the ML side of vector search and we are investing heavily in it. I think it has not quite sunk in that vector search systems are ML systems and everything that comes with that. I would love to chat about 1 and 2 so feel free to email me (email is in my profile). What we have done so far is here ->

  • awesome-pretrained-chinese-nlp-models

    Awesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合

    Project mention: Tip for people who want to read Chinese non translated novels but can’t stand MTL | /r/MartialMemes | 2023-03-08
  • Baichuan2

    A series of large language models developed by Baichuan Intelligent Technology

    Project mention: Baichuan 2 | | 2023-10-12
  • gpt-code-ui

    An open source implementation of OpenAI's ChatGPT Code interpreter

    Project mention: Should I tell my employer about a product that makes my job irrelevant? | /r/cscareerquestions | 2023-07-11

    Is this of any help?

  • OpenAgents

    OpenAgents: An Open Platform for Language Agents in the Wild

    Project mention: [D] github repositories for ai web search agents | /r/MachineLearning | 2023-12-09
  • InternGPT

    InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

    Project mention: How do I use the programs on Github? | /r/github | 2023-06-16

    You can also create an issue and ask the developers for help.

  • LMOps

    General technology for enabling AI capabilities w/ LLMs and MLLMs

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-23.

Python Gpt related posts


What are some of the best open-source Gpt projects in Python? This list will help you:

Project Stars
1 gpt4free 53,755
2 MetaGPT 34,472
3 MindsDB 19,969
4 dify 15,696
5 vllm 15,141
6 best-of-ml-python 15,098
7 LLaVA 14,073
8 DocsGPT 13,899
9 LLaMA-Factory 11,688
10 RWKV-LM 11,092
11 petals 8,408
12 promptflow 7,417
13 text-generation-inference 7,035
14 VALL-E-X 6,877
15 awesome-open-gpt 4,783
16 marvin 4,417
17 marqo 3,954
18 awesome-pretrained-chinese-nlp-models 3,839
19 Baichuan2 3,640
20 gpt-code-ui 3,430
21 OpenAgents 3,205
22 InternGPT 3,064
23 LMOps 2,958
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.