Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 Jupyter Notebook Transformer Projects
-
nn
🧑🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Project mention: Can't remember name of website that has explanations side-by-side with code | /r/learnmachinelearning | 2023-03-28Hey are you talking about https://nn.labml.ai/ ?
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
pytorch-seq2seq
Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
-
tsai
Time series Timeseries Deep Learning Machine Learning Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai
Project mention: Aeon: A unified framework for machine learning with time series | news.ycombinator.com | 2023-06-22 -
-
kernl
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
I have seen models which do something similar but the questions they ask are not in a Yes/No style such as this T5 - based Question Generator. Essentially, I was wondering how I would go about developing such a model.
-
deepsvg
[NeurIPS 2020] Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.
I'd like to start experimenting with image classification in SVG format. I've found the deepsvg library that seems to have a solid basis on how to handle SVG files. Unfortunately it doesn't seem there's a large body of resesarch in the area and I am struggling to find a MNIST-like datset in SVG format.
-
Transformer-MM-Explainability
[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.
-
maxvit
[ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...
-
relora
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
Project mention: ReLoRA: High-Rank Training Through Low-Rank Updates | news.ycombinator.com | 2023-12-21 -
Project mention: Text-to-Audio Generation Using Instruction Tuned LLM and Latent Diffusion Model | news.ycombinator.com | 2023-04-28
Excellent. Some of the theory here goes back to Oct/2021 and beyond [1].
The riffusion.com [2] guys made this practical. Also, my video of high-level overview and examples [3].
1. SpecVQGAN: https://github.com/v-iashin/SpecVQGAN
2. Riffusion: ://www.riffusion.com/
3. Riffusion high-level overview: https://youtu.be/olkLVGcvib8
-
Source: https://colab.research.google.com/github/ArthurFDLR/whisper-youtube/blob/main/whisper_youtube.ipynb
-
TokenCut
(CVPR 2022) Pytorch implementation of "Self-supervised transformers for unsupervised object discovery using normalized cut"
-
-
-
-
vid2cleantxt
Python API & command-line tool to easily transcribe speech-based video files into clean text
-
tf-transformers
State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).
-
gpt-j-fine-tuning-example
Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Jupyter Notebook Transformer related posts
- Looking for Paper about LLM Fine Tuning for specific topic / Alignment Paper
- Magyar Youtube feliratozo v.1.1 (ingyenes colab)
- Telex videón magyar és angol felirat demó (whisper-ctranslate2)
- Text-to-Audio Generation Using Instruction Tuned LLM and Latent Diffusion Model
- Best solution to make static chatbot for a minecraft server?
- We’ve been forever waiting for the rest of the season, my friend doesn’t hear very well, any idea where I can get part 2 subtitles? (I hope it’s ok that I’m posting this here)
- [P] Get 2x Faster Transcriptions with OpenAI Whisper Large on Kernl
-
A note from our sponsor - InfluxDB
www.influxdata.com | 28 Mar 2024
Index
What are some of the best open-source Transformer projects in Jupyter Notebook? This list will help you:
Project | Stars | |
---|---|---|
1 | nn | 46,249 |
2 | nlp-tutorial | 13,596 |
3 | pytorch-seq2seq | 5,112 |
4 | tsai | 4,555 |
5 | ru-dalle | 1,644 |
6 | kernl | 1,446 |
7 | OneFormer | 1,313 |
8 | poolformer | 1,226 |
9 | question_generation | 1,058 |
10 | deepsvg | 855 |
11 | Transformer-MM-Explainability | 695 |
12 | maxvit | 413 |
13 | relora | 383 |
14 | SpecVQGAN | 313 |
15 | whisper-youtube | 312 |
16 | TokenCut | 285 |
17 | BMT | 219 |
18 | mgpt | 192 |
19 | nested-transformer | 190 |
20 | vid2cleantxt | 146 |
21 | tf-transformers | 84 |
22 | gpt-j-fine-tuning-example | 63 |
23 | Transformer-Models-from-Scratch | 58 |