C++ Transformer

Open-source C++ projects categorized as Transformer

Top 3 C++ Transformer Projects

  • FasterTransformer

    Transformer related optimization, including BERT, GPT

  • Project mention: Train Your AI Model Once and Deploy on Any Cloud | news.ycombinator.com | 2023-07-08

    https://docs.nvidia.com/ai-enterprise/overview/0.1.0/platfor...

    RIVA: NVIDIA® Riva, a premium edition of NVIDIA AI Enterprise software, is a GPU-accelerated speech and translation AI SDK

    FasterTransformer: https://github.com/NVIDIA/FasterTransformer an

  • lightseq

    LightSeq: A High Performance Library for Sequence Processing and Generation

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • athena

    an open-source implementation of sequence-to-sequence based speech processing engine (by athena-team)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Transformer related posts

  • Intel Extension for Transformers

    1 project | news.ycombinator.com | 5 Dec 2023
  • How do you think LLM inference on CPUs?

    1 project | news.ycombinator.com | 2 Nov 2023
  • Train Your AI Model Once and Deploy on Any Cloud

    3 projects | news.ycombinator.com | 8 Jul 2023
  • Optimized implementation of training/fine-tuning of LLMs [D]

    1 project | /r/MachineLearning | 5 Mar 2023
  • Why are self attention not as deployment friendly?

    2 projects | /r/deeplearning | 26 Jul 2022
  • [P] Python library to optimize Hugging Face transformer for inference: < 0.5 ms latency / 2850 infer/sec

    4 projects | /r/MachineLearning | 23 Nov 2021
  • Wenet results on Gigaspeech - on par with best results (Espnet). Pretrained model is available .

    1 project | /r/speechtech | 7 Jul 2021
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 10 May 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

What are some of the best open-source Transformer projects in C++? This list will help you:

Project Stars
1 FasterTransformer 5,490
2 lightseq 3,099
3 athena 930

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com