Top 9 Python gpt2 Projects

bertviz

15 6,377 3.9 Python

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Project mention: StreamingLLM: tiny tweak to KV LRU improves long conversations | news.ycombinator.com | 2024-02-13

This seems only to work cause large GPTs have redundant, undercomplex attentions. See this issue in BertViz about attention in Llama: https://github.com/jessevig/bertviz/issues/128

chatgpt-comparison-detection

1 1,190 4.8 Python

Human ChatGPT Comparison Corpus (HC3), Detectors, and more! 🔥
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Adan

1 726 4.4 Python

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
finetune-gpt2xl

9 421 0.0 Python

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
flaxmodels

1 222 3.1 Python

Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.
more-ane-transformers

4 34 7.0 Python

Run transformers (incl. LLMs) on the Apple Neural Engine.

Project mention: M2 Ultra can run 128 streams of Llama 2 7B in parallel | news.ycombinator.com | 2023-10-11

Extracting-Training-Data-from-Large-Langauge-Models

1 26 5.1 Python

A re-implementation of the "Extracting Training Data from Large Language Models" paper by Carlini et al., 2020
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Neural-Scam-Artist

2 22 0.0 Python

Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.
aitg

1 4 0.0 Python

plug and play many transformers models for http api or command line!

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python gpt2 related posts

M2 Ultra can run 128 streams of Llama 2 7B in parallel
4 projects | news.ycombinator.com | 11 Oct 2023
Is it possible to use ANE(Apple Neural Engine) to run those models?
1 project | /r/LocalLLaMA | 7 May 2023
Anthropic’s $5B, 4-year plan to take on OpenAI
6 projects | news.ycombinator.com | 11 Apr 2023
[self-promotion] A dataset of email scams (Github Link)
1 project | /r/datasets | 30 Oct 2021
Show HN: I trained a neural network to write scam emails
1 project | news.ycombinator.com | 18 Oct 2021
[P] Training StyleGAN2 in Jax (FFHQ and Anime Faces)
2 projects | /r/MachineLearning | 12 Sep 2021
Show HN: Plug-and-play GPT2/3 CLI and HTTP, made for local hacking
1 project | news.ycombinator.com | 27 Aug 2021
A note from our sponsor - SaaSHub
www.saashub.com | 26 Apr 2024

SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source gpt2 projects in Python? This list will help you:

	Project	Stars
1	bertviz	6,377
2	chatgpt-comparison-detection	1,190
3	Adan	726
4	finetune-gpt2xl	421
5	flaxmodels	222
6	more-ane-transformers	34
7	Extracting-Training-Data-from-Large-Langauge-Models	26
8	Neural-Scam-Artist	22
9	aitg	4