Top 23 Python Transformer Projects

Transformer

• Add a project

1. transformers

   1 249 167,499 10.0 Python

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   

   Project mention: Firefox Download Failed at 99%? How to Resume It Instead of Starting Over | dev.to | 2026-10-13

   For Hugging Face, neither curl nor aria2 can fix an expired signature halfway through, because the signed URL they hold just stops working. Use hf download from huggingface_hub, which can request fresh signed URLs when the old ones die. It has its own problems, though. A transformers issue shows a download that hit repeated 403s on signed URLs, refreshed them, and then hung without an error. Setting HF_HUB_DISABLE_XET=1 avoided it. That particular bug was on HF's side and was fixed before the issue was closed, but the Neutree FAQ recommends the same thing for unstable networks, noting the HTTP path is slower but more reliable.

2. AppSignal

   www.appsignal.com sponsored

   Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

   

3. vllm

   2 134 93,864 10.0 Python

   A high-throughput and memory-efficient inference and serving engine for LLMs

   

   Project mention: AI acceptable use policy for employees: what works | dev.to | 2026-10-15

   The production inference layer is powered by vLLM, an open-source, Apache 2.0 licensed serving engine featuring continuous batching, PagedAttention memory management, and an OpenAI-compatible API structure supporting hundreds of model architectures.

4. nn

   3 26 67,548 7.5 Python

   🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

   

5. sglang

   4 22 37,209 10.0 Python

   SGLang is a high-performance serving framework for large language models and multimodal models.

   

   Project mention: SGLang – High-performance serving framework for LLM's and multimodal models | news.ycombinator.com | 2026-10-15

6. heretic

   5 16 35,377 8.9 Python

   Fully automatic censorship removal for language models

   

   Project mention: Heretic removes restrictions from language models | news.ycombinator.com | 2026-09-20

7. fish-speech

   6 8 33,183 7.4 Python

   SOTA Open Source TTS

   

   Project mention: Fish Audio S2-Pro：用自然语言控制语音情感的 TTS 模型 | dev.to | 2026-03-11

   git clone https://github.com/fishaudio/fish-speech.git cd fish-speech pip install uv uv sync

8. mmdetection

   7 24 32,881 5.8 Python

   OpenMMLab Detection Toolbox and Benchmark

   

9. SaaSHub

   www.saashub.com sponsored

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. faster-whisper

    8 36 25,902 3.7 Python

    Faster Whisper transcription with CTranslate2

    

    Project mention: PostCall: a proposal writer that never sends your client calls anywhere (Whisper + Gemma 4, all local) | dev.to | 2026-10-14

    { "url": "https://github.com/SYSTRAN/faster-whisper", "prompt": "Extract: (1) install instructions and whether GPU/Metal is supported on macOS Apple Silicon (CPU only?), any note on Apple Silicon; (2) usage example for WhisperModel (device, compute_type options for CPU such as int8), how to pass beam_size, language auto-detection, word_timestamps, vad_filter; (3) the list of available model sizes including large-v3-turbo / turbo and where models are downloaded from (Hugging Face) and cache dir (download_root); (4) whether system ffmpeg is required (PyAV)." }

11. best-of-ml-python

    9 18 23,846 2.6 Python

    🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

    

12. LaTeX-OCR

    10 22 16,503 5.4 Python

    pix2tex: Using a ViT to convert images of equations into LaTeX code.

    

13. nano-vllm

    11 7 15,858 7.9 Python

    Nano vLLM

    

    Project mention: Inside nano-vLLM: What an RTX 3090 Reveals About LLM Serving | dev.to | 2026-09-06

    nano-vLLM implements an LLM serving engine in roughly 1,200 lines of Python. Its compact codebase makes the core serving concepts clear and easy to follow, making it a useful starting point for learning how an inference engine works.

14. RWKV-LM

    12 86 14,745 8.5 Python

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

    

    Project mention: RWKV-7 beats Llama 3.2 with 3x fewer training tokens and formally exceeds TC^0 | news.ycombinator.com | 2026-02-23

15. lm-evaluation-harness

    13 43 14,242 9.2 Python

    A framework for few-shot evaluation of language models.

    

    Project mention: Rag Evaluation Metrics | dev.to | 2026-06-13

16. PaddleSpeech

    14 6 12,694 5.8 Python

    Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

    

17. petals

    15 109 10,535 7.2 Python

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    

    Project mention: Run large language models at home, BitTorrent‑style | news.ycombinator.com | 2026-07-22

    Hm, looks like this is an old project (2022) associated with HuggingFace (https://huggingface.co/bigscience).

    Doesn't look like it's very active nowadays: https://github.com/bigscience-workshop/petals

    Article with more details: https://techcrunch.com/2022/12/20/petals-is-creating-a-free-...

    > [...] volunteers can donate their hardware power to tackle a portion of a text-generating workload and team up others to complete larger tasks, similar to Folding@home and other distributed compute setups.

18. manga-image-translator

    16 12 10,496 6.6 Python

    Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/ (no longer working)

    

19. mmsegmentation

    17 7 9,908 5.8 Python

    OpenMMLab Semantic Segmentation Toolbox and Benchmark.

    

20. PaddleSeg

    18 17 9,402 2.7 Python

    Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

    

21. LMFlow

    19 10 8,482 6.5 Python

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    

22. bertviz

    20 16 8,198 2.6 Python

    BertViz: Visualize Attention in Transformer Models

    

23. GPT2-Chinese

    21 2 7,601 2.5 Python

    Chinese version of GPT2 training code, using BERT tokenizer.

    

24. vllm-omni

    22 3 7,208 10.0 Python

    A framework for efficient model inference with omni-modality models

    

    Project mention: VoxCPM2 vs ElevenLabs: Self-Hosted AI Voice That Clones, Designs and Speaks 30 Languages (2026) | dev.to | 2026-09-21

    Yes, if you have a GPU box, because the serving story is now boring in the good way. The official-recommended production path is vLLM-Omni: vllm serve openbmb/VoxCPM2 --omni exposes an OpenAI-compatible /v1/audio/speech endpoint with batching and KV-cache management, per the PyPI documentation. That page also reports a real-time factor around 0.13 on an RTX 4090 via the Nano-vLLM-VoxCPM backend, versus roughly 0.3 for the plain PyTorch path - meaning generation runs several times faster than playback.

25. BERT-pytorch

    23 1 6,527 0.0 Python

    Google AI 2018 BERT pytorch implementation

    

26. SaaSHub

    www.saashub.com sponsored

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    

Python Transformer related posts

• AI acceptable use policy for employees: what works

  1 project | dev.to | 15 Oct 2026

• PostCall: a proposal writer that never sends your client calls anywhere (Whisper + Gemma 4, all local)

  5 projects | dev.to | 14 Oct 2026

• Firefox Download Failed at 99%? How to Resume It Instead of Starting Over

  1 project | dev.to | 13 Oct 2026

• vLLM's --api-key leaves /invocations, /tokenize and /pause open. Lock it down with an allowlist proxy

  1 project | dev.to | 12 Oct 2026

• Learning Dad's Garden: From 4 Minutes of Phone Video to a Printed Watering Sheet, Offline

  5 projects | dev.to | 11 Oct 2026

• How vLLM CUDA Kernels Write and Read the Paged KV Cache

  1 project | dev.to | 9 Oct 2026

• Running vLLM natively on Windows

  3 projects | dev.to | 8 Oct 2026
• A note from our sponsor - SaaSHub
  www.saashub.com | 16 Oct 2026

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

Monitoring that respects your time & budget

APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

www.appsignal.com

Do not miss the trending Python projects with our weekly report!