Transformer-lm Alternatives

Similar projects and alternatives to transformer-lm based on common topics and language

• transformers

  176 125,369 10.0 Python transformer-lm VS transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

• gpt-neo

  82 6,158 7.3 Python transformer-lm VS gpt-neo

  Discontinued An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• RWKV-LM

  84 11,657 8.8 Python transformer-lm VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• LoRA

  34 9,113 4.7 Python transformer-lm VS LoRA

  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  

• xTuring

  31 2,524 8.4 Python transformer-lm VS xTuring

  Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

  

• TextRL

  2 519 5.8 Python transformer-lm VS TextRL

  Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)