cramming
askai
cramming | askai | |
---|---|---|
6 | 2 | |
1,239 | 92 | |
- | - | |
7.3 | 10.0 | |
about 1 month ago | over 1 year ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cramming
- [P] Notes on training BERT from scratch on an 8GB consumer GPU
- Cramming the training of a (BERT-type) language model into limited compute
- NanoGPT
-
New AI Research from the University of Maryland Investigates Cramming Challenge for Training a Language Model on a Single GPU in One Day
Quick Read: https://www.marktechpost.com/2023/01/03/new-ai-research-from-the-university-of-maryland-investigates-cramming-challenge-for-training-a-language-model-on-a-single-gpu-in-one-day/ Paper: https://arxiv.org/pdf/2212.14034.pdf Github: https://github.com/JonasGeiping/cramming
- Lucas Beyer on Twitter: “How Good of a Bert Can One Get in One Day on One GPU?
-
Cramming: Training a Language Model on a Single GPU in One Day - Jonas Geiping and Tom Goldstein University of Maryland 2022
Github: https://github.com/JonasGeiping/cramming
askai
-
Ask HN: How are you using GPT to be productive?
A while back, I wrote a simple CLI-wrapper around OpenAI's API that I'm using daily (https://github.com/maxvfischer/askai). I use it as an addition to Stackoverflow to ask quick programming-related question straight in the terminal.
- Show HN: I built a simple CLI helper integrating with GPT-3
What are some alternatives?
nanoGPT - The simplest, fastest repository for training/finetuning medium-sized GPTs.
KoboldAI-Client
askai - Command Line Interface for OpenAi ChatGPT
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
english-lang - The English Programming Language
llama.cpp - LLM inference in C/C++
aitextgen - A robust Python tool for text-based AI training and generation using GPT-2.
469 - The bonelord language in Tibia
flan-ul2-alpaca
ChatGPT-ProBot - 🤖️ A GPTChat based GitHub robot. dialogue/CR/etc..
extreme-bert - ExtremeBERT is a toolkit that accelerates the pretraining of customized language models on customized datasets, described in the paper “ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT”.
chatgpt-api - Node.js client for the official ChatGPT API. 🔥