C++ Transformer

Open-source C++ projects categorized as Transformer

Top 4 C++ Transformer Projects

Transformer
  1. whisper.cpp

    Port of OpenAI's Whisper model in C/C++

    Project mention: Show HN: Galene-stt: automatic captioning for the Galene videconferencing system | news.ycombinator.com | 2024-11-21
  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. FasterTransformer

    Transformer related optimization, including BERT, GPT

  4. lightseq

    LightSeq: A High Performance Library for Sequence Processing and Generation

  5. athena

    an open-source implementation of sequence-to-sequence based speech processing engine (by athena-team)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Transformer discussion

Log in or Post with

C++ Transformer related posts

  • Intel Extension for Transformers

    1 project | news.ycombinator.com | 5 Dec 2023
  • How do you think LLM inference on CPUs?

    1 project | news.ycombinator.com | 2 Nov 2023
  • Train Your AI Model Once and Deploy on Any Cloud

    3 projects | news.ycombinator.com | 8 Jul 2023
  • Optimized implementation of training/fine-tuning of LLMs [D]

    1 project | /r/MachineLearning | 5 Mar 2023
  • Why are self attention not as deployment friendly?

    2 projects | /r/deeplearning | 26 Jul 2022
  • [P] Python library to optimize Hugging Face transformer for inference: < 0.5 ms latency / 2850 infer/sec

    4 projects | /r/MachineLearning | 23 Nov 2021
  • Wenet results on Gigaspeech - on par with best results (Espnet). Pretrained model is available .

    1 project | /r/speechtech | 7 Jul 2021
  • A note from our sponsor - SaaSHub
    www.saashub.com | 18 Jan 2025
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Transformer projects in C++? This list will help you:

# Project Stars
1 whisper.cpp 36,831
2 FasterTransformer 5,980
3 lightseq 3,203
4 athena 952

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that C++ is
the 7th most popular programming language
based on number of references?