Top 10 Jupyter Notebook gpt-2 Projects

Transformers-Tutorials

7 7,510 8.4 Jupyter Notebook

This repository contains demos I made with the Transformers library by HuggingFace.

Project mention: AI enthusiasm #6 - Finetune any LLM you want💡 | dev.to | 2024-04-16

Most of this tutorial is based on Hugging Face course about Transformers and on Niels Rogge's Transformers tutorials: make sure to check their work and give them a star on GitHub, if you please ❤️

gpt2bot

1 424 0.0 Jupyter Notebook

Your new Telegram buddy powered by transformers
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
mgpt

1 194 3.1 Jupyter Notebook

Multilingual Generative Pretrained Model
REaLTabFormer

5 183 5.5 Jupyter Notebook

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.
prompt-extend

6 174 10.0 Jupyter Notebook

extending stable diffusion prompts with suitable style cues using text generation

Project mention: ArtBot for Stable Diffusion | news.ycombinator.com | 2023-12-17

I've been playing around with DALL-E 3 a lot recently. One of the things they do is to expand a user's prompt in order to add a lot of detail. Via their API, you can see the expanded prompt (whereas, you can't through the ChatGPT interface).
They obviously have the power of their LLM behind them and can generate some really interesting prompts. There is an open source implementation that the creator of Fooocus made which attempts to expand on prompts using some commonly used keywords[1] with some sort of basic context.
e.g., I typed in "Brisket on a table" and got: "Brisket on a table, product photography, Michelin star, award winning photo, 8k, trending, HD. High quality image, highly detailed, stunning lighting, flawless render, masterpiece, still from the movie directed by Denis Villeneuve with art direction"
You get a much better image with that prompt vs just the basic: "Brisket on a table"
[1] https://huggingface.co/spaces/daspartho/prompt-extend

minGPT-TF

1 53 0.0 Jupyter Notebook

A minimal TF2 re-implementation of the OpenAI GPT training
Anees

1 37 3.2 Jupyter Notebook

Multi-turn open-domain Arabic chatbot with a wide set of features.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
TinyStories

1 27 4.9 Jupyter Notebook

code to train a gpt-2 model to train it on tiny stories dataset according to the TinyStories paper

Project mention: [P] Code to config a model similar to TinyStories paper | /r/MachineLearning | 2023-05-19

Take a look: https://github.com/sleepingcat4/TinyStories

RecipeGPT-exp

1 20 1.4 Jupyter Notebook

RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and Evaluation System (TheWebConf'2020; WWW'20)
tensorflow-nanoGPT

1 4 4.1 Jupyter Notebook

Example how to train GPT-2 (XLA + AMP), export to SavedModel and serve with Tensorflow Serving

Project mention: [P] Training and serving GPT-2 using Keras-CV and Tensorflow | /r/MachineLearning | 2023-05-27

Here is the link to my repo: https://github.com/kmkolasinski/tensorflow-nanoGPT

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Jupyter Notebook gpt-2 related posts

ChatGPT
2 projects | /r/u_RazPie | 26 Jan 2023
Dalila.
1 project | /r/StableDiffusion | 11 Jan 2023
[P] Made a text generation model to extend stable diffusion prompts with suitable style cues
2 projects | /r/MachineLearning | 3 Nov 2022
minGPT: a small and educational implementation of GPT by Andrej Karpathy
1 project | /r/learnmachinelearning | 4 Oct 2021

Index

What are some of the best open-source gpt-2 projects in Jupyter Notebook? This list will help you:

	Project	Stars
1	Transformers-Tutorials	7,510
2	gpt2bot	424
3	mgpt	194
4	REaLTabFormer	183
5	prompt-extend	174
6	minGPT-TF	53
7	Anees	37
8	TinyStories	27
9	RecipeGPT-exp	20
10	tensorflow-nanoGPT	4