Top 3 Python pytorch-transformer Projects

transformers

181 127,531 10.0 Python

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Project mention: How to count tokens in frontend for Popular LLM Models: GPT, Claude, and Llama | dev.to | 2024-05-21

Thanks to transformers.js, we can run the tokenizer and model locally in the browser. Transformers.js is designed to be functionally equivalent to Hugging Face's transformers python library, meaning you can run the same pretrained models using a very similar API.

Scout Monitoring

www.scoutapm.com featured

Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
pytorch-widedeep

7 1,260 8.5 Python

A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
tensor_parallel

3 588 8.5 Python

Automatically split your PyTorch models on multiple GPUs for training & inference

Project mention: How to finetune a LoRA with Data parallelism? | /r/LocalLLaMA | 2023-06-23

I've had some success with the wrappers here: https://github.com/BlackSamorez/tensor_parallel

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).