Jupyter Notebook Transformer

Open-source Jupyter Notebook projects categorized as Transformer

Top 23 Jupyter Notebook Transformer Projects

  • nn

    🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

    Project mention: Can't remember name of website that has explanations side-by-side with code | /r/learnmachinelearning | 2023-03-28

    Hey are you talking about https://nn.labml.ai/ ?

  • nlp-tutorial

    Natural Language Processing Tutorial for Deep Learning Researchers

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • pytorch-seq2seq

    Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

  • tsai

    Time series Timeseries Deep Learning Machine Learning Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai

    Project mention: Aeon: A unified framework for machine learning with time series | news.ycombinator.com | 2023-06-22

    Also https://github.com/timeseriesAI/tsai

  • ru-dalle

    Generate images from texts. In Russian

  • kernl

    Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

  • OneFormer

    OneFormer: One Transformer to Rule Universal Image Segmentation, arxiv 2022 / CVPR 2023

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • poolformer

    PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)

  • question_generation

    Neural question generation using transformers

    Project mention: Yes/No style Question and Answer Generation | /r/learnpython | 2023-06-15

    I have seen models which do something similar but the questions they ask are not in a Yes/No style such as this T5 - based Question Generator. Essentially, I was wondering how I would go about developing such a model.

  • deepsvg

    [NeurIPS 2020] Official code for the paper "DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation". Includes a PyTorch library for deep learning with SVG data.

    Project mention: [D] MNIST-like dataset in SVG format | /r/MachineLearning | 2023-07-09

    I'd like to start experimenting with image classification in SVG format. I've found the deepsvg library that seems to have a solid basis on how to handle SVG files. Unfortunately it doesn't seem there's a large body of resesarch in the area and I am struggling to find a MNIST-like datset in SVG format.

  • Transformer-MM-Explainability

    [ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

  • maxvit

    [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

  • relora

    Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

    Project mention: ReLoRA: High-Rank Training Through Low-Rank Updates | news.ycombinator.com | 2023-12-21
  • SpecVQGAN

    Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)

    Project mention: Text-to-Audio Generation Using Instruction Tuned LLM and Latent Diffusion Model | news.ycombinator.com | 2023-04-28

    Excellent. Some of the theory here goes back to Oct/2021 and beyond [1].

    The riffusion.com [2] guys made this practical. Also, my video of high-level overview and examples [3].

    1. SpecVQGAN: https://github.com/v-iashin/SpecVQGAN

    2. Riffusion: ://www.riffusion.com/

    3. Riffusion high-level overview: https://youtu.be/olkLVGcvib8

  • whisper-youtube

    🔉 Youtube Videos Transcription with OpenAI's Whisper

    Project mention: Magyar Youtube feliratozo v.1.1 (ingyenes colab) | /r/hungary | 2023-05-03

    Source: https://colab.research.google.com/github/ArthurFDLR/whisper-youtube/blob/main/whisper_youtube.ipynb

  • TokenCut

    (CVPR 2022) Pytorch implementation of "Self-supervised transformers for unsupervised object discovery using normalized cut"

  • BMT

    Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

  • mgpt

    Multilingual Generative Pretrained Model

  • nested-transformer

    Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf

  • vid2cleantxt

    Python API & command-line tool to easily transcribe speech-based video files into clean text

  • tf-transformers

    State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).

  • gpt-j-fine-tuning-example

    Fine-tuning 6-Billion GPT-J (& other models) with LoRA and 8-bit compression

  • Transformer-Models-from-Scratch

    implementing various transformer models for various tasks

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-12-21.

Jupyter Notebook Transformer related posts

Index

What are some of the best open-source Transformer projects in Jupyter Notebook? This list will help you:

Project Stars
1 nn 46,249
2 nlp-tutorial 13,596
3 pytorch-seq2seq 5,112
4 tsai 4,555
5 ru-dalle 1,644
6 kernl 1,446
7 OneFormer 1,313
8 poolformer 1,226
9 question_generation 1,058
10 deepsvg 855
11 Transformer-MM-Explainability 695
12 maxvit 413
13 relora 383
14 SpecVQGAN 313
15 whisper-youtube 312
16 TokenCut 285
17 BMT 219
18 mgpt 192
19 nested-transformer 190
20 vid2cleantxt 146
21 tf-transformers 84
22 gpt-j-fine-tuning-example 63
23 Transformer-Models-from-Scratch 58
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com