Any real competitor to GPT-3 which is open source and downloadable?

This page summarizes the projects mentioned and recommended in the original post on /r/OpenAI

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • transformers

    🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  • 1.) Hugging Face Transformers: Hugging Face is a company that provides an open-source library called "Transformers," which offers various pre-trained language models, including smaller versions of GPT-2 and GPT-3. You can find their repository on GitHub and use the library in your projects. Website: https://huggingface.co/transformers/

  • gpt-2

    Code for the paper "Language Models are Unsupervised Multitask Learners"

  • 2.) OpenAI's GPT-2: OpenAI released GPT-2 in 2019 and later made the code and pre-trained models available to the public. GPT-2 is not as advanced as GPT-3 or GPT-4, but it's still powerful and can be used for various natural language processing tasks. You can find the GPT-2 code and pre-trained models on GitHub: https://github.com/openai/gpt-2

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • gpt-neo

    Discontinued An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

  • 3.) EleutherAI's GPT-Neo and GPT-NeoX: EleutherAI is an independent research organization that aims to promote open research in artificial intelligence. They have released GPT-Neo, an open-source language model based on the GPT architecture, and are developing GPT-NeoX, a highly-scalable GPT-like model. You can find more information on their GitHub repositories: GPT-Neo: https://github.com/EleutherAI/gpt-neo GPT-NeoX: https://github.com/EleutherAI/gpt-neox

  • gpt-neox

    An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

  • 3.) EleutherAI's GPT-Neo and GPT-NeoX: EleutherAI is an independent research organization that aims to promote open research in artificial intelligence. They have released GPT-Neo, an open-source language model based on the GPT architecture, and are developing GPT-NeoX, a highly-scalable GPT-like model. You can find more information on their GitHub repositories: GPT-Neo: https://github.com/EleutherAI/gpt-neo GPT-NeoX: https://github.com/EleutherAI/gpt-neox

  • transformers-bloom-inference

    Fast Inference Solutions for BLOOM

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts