Top 9 transformer-architecture Open-Source Projects

VALL-E-X

2 7,219 8.8 Python

An open source implementation of Microsoft's VALL-E X zero-shot TTS model. Demo is available in https://plachtaa.github.io

Project mention: FLaNK Stack Weekly 12 February 2024 | dev.to | 2024-02-12

Awesome-Transformer-Attention

4 4,271 9.8

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
maxvit

1 421 0.0 Jupyter Notebook

[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...
MultiModalMamba

2 398 7.9 Python

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

Project mention: FLaNK 15 Jan 2024 | dev.to | 2024-01-15

a-PyTorch-Tutorial-to-Transformers

1 174 5.3 Python

Attention Is All You Need | a PyTorch Tutorial to Transformers
Coeditor

1 21 5.9 Python

Coeditor: Leveraging Repo-level Diffs for Code Auto-editing

Project mention: Coeditor: an open-source code editing assistant [now available on GitHub] | /r/deeplearning | 2023-05-31

Code: https://github.com/MrVPlusOne/Coeditor

kgpt

4 12 6.7 Python

A custom GPT based on [Zero To Hero](https://karpathy.ai/zero-to-hero.html) utilizing tiktoken with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch.

Project mention: A custom GPT based on Andrej Karpathy's Zero To Hero utilizing tiktoken with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch. | /r/aipromptprogramming | 2023-06-21

SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
transformer-tf

2 6 10.0 Jupyter Notebook

This repository contains the code for the paper "Attention Is All You Need" i.e The Transformer.
falcongpt

1 5 5.4 Python

Simple GPT app that uses the falcon-7b-instruct model with a Flask front-end.

Project mention: Simple GPT app that uses the falcon-7b-instruct model with a Flask front-end. | /r/ChatGPT | 2023-06-22

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

transformer-architecture related posts

Build a project that can be used to translate English to Spanish. In short, Implemented Transformer from scratch in TensorFlow 2.x. 🚀

1 project | /r/programming | 1 Dec 2022

Index

What are some of the best open-source transformer-architecture projects? This list will help you:

	Project	Stars
1	VALL-E-X	7,219
2	Awesome-Transformer-Attention	4,271
3	maxvit	421
4	MultiModalMamba	398
5	a-PyTorch-Tutorial-to-Transformers	174
6	Coeditor	21
7	kgpt	12
8	transformer-tf	6
9	falcongpt	5