C++ Gpt

Open-source C++ projects categorized as Gpt
Edit details
Topics: AI llama chatgpt CPP Transformer
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 10 C++ Gpt Projects

  • FasterTransformer

    Transformer related optimization, including BERT, GPT

    • Project mention: Train Your AI Model Once and Deploy on Any Cloud | news.ycombinator.com | 2023-07-08

    https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platfor...

    RIVA: NVIDIA® Riva, a premium edition of NVIDIA AI Enterprise software, is a GPU-accelerated speech and translation AI SDK

    FasterTransformer: https://github.com/NVIDIA/FasterTransformer an

  • lightseq

    LightSeq: A High Performance Library for Sequence Processing and Generation

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • ntfstool

    Forensics tool for NTFS (parser, mft, bitlocker, deleted files)

  • liboai

    A C++17 library to access the entire OpenAI API.

    • Project mention: Revolutionizing Real-Time Alerts with AI, NATs and Streamlit | dev.to | 2024-02-18

    Imagine you have an AI-powered personal alerting chat assistant that interacts using up-to-date data. Whether it's a big move in the stock market that affects your investments, any significant change on your shared SharePoint documents, or discounts on Amazon you were waiting for, the application is designed to keep you informed and alert you about any significant changes based on the criteria you set in advance using your natural language. In this post, we will learn how to build a full-stack event-driven weather alert chat application in Python using pretty cool tools: Streamlit, NATS, and OpenAI. The app can collect real-time weather information, understand your criteria for alerts using AI, and deliver these alerts to the user interface.

  • LlamaGPTJ-chat

    Simple chat program for LLaMa, GPT-J, and MPT models.

    • Project mention: New to this community, most models I download fail and end up in a core dump | /r/LocalLLaMA | 2023-05-23

    If you want to use that model specifically, check out : https://github.com/kuvaus/LlamaGPTJ-chat

  • collider

    Large Model Collider - The Platform for serving LLM models

    • Project mention: Show HN: Collider – the platform for local LLM debug and inference at warp speed | news.ycombinator.com | 2023-11-30

  • cli-gpt

    🔨 command line tool that uses GPT to translate text into executable commands (by filippofinke)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • eigenGPT

    Minimal C++ implementation of GPT2

    • Project mention: C++ GPT-2 inference engine | news.ycombinator.com | 2023-07-01

    From the same twitter thread, a dense implementation in less than 100 lines of plan C!

    https://github.com/davidar/eigenGPT

  • llama-chat

    Simple chat program for LLaMa models (by kuvaus)

    • Project mention: Local vicuna AI for low end pc? | /r/LocalLLaMA | 2023-06-21

  • Quasar

    GPT3-enabled surrogate functions in C++ (by ws-kj)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Gpt related posts

  • WyGPT: Minimal mature GPT model in C++

    2 projects | news.ycombinator.com | 16 Dec 2023

  • Nvidia Introduces TensorRT-LLM for Accelerating LLM Inference on H100/A100 GPUs

    3 projects | news.ycombinator.com | 8 Sep 2023

  • New to this community, most models I download fail and end up in a core dump

    1 project | /r/LocalLLaMA | 23 May 2023

  • GitHub - filippofinke/cli-gpt: 🔨 command line tool that uses GPT to translate text into executable commands

    1 project | /r/ChatGPT | 25 Mar 2023

  • Optimized implementation of training/fine-tuning of LLMs [D]

    1 project | /r/MachineLearning | 5 Mar 2023

  • Why are self attention not as deployment friendly?

    2 projects | /r/deeplearning | 26 Jul 2022

  • [P]wyGPT: improved small GPT model in C++ from scratch

    1 project | /r/MachineLearning | 18 Jun 2021
  • A note from our sponsor - SaaSHub
    www.saashub.com | 8 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Gpt projects in C++? This list will help you:

Project Stars
1 FasterTransformer 5,482
2 lightseq 3,099
3 ntfstool 419
4 liboai 295
5 LlamaGPTJ-chat 208
6 collider 117
7 cli-gpt 74
8 eigenGPT 40
9 llama-chat 7
10 Quasar 7

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com