gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library. (by EleutherAI)

Gpt-neox Alternatives

Similar projects and alternatives to gpt-neox

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better gpt-neox alternative or higher similarity.

Suggest an alternative to gpt-neox

Reviews and mentions

Posts with mentions or reviews of gpt-neox. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-04-30.
  • With the release of Eleuther's new 6B model, I decided to rerun a comparison I did a couple weeks ago.
    reddit.com/r/AIDungeon | 2021-06-09
  • How to create a model like BERT or GPT?
    Yes. You can look at open source code on Github. For example, Eleuther AI is trying to replicate GPT3: https://github.com/EleutherAI/gpt-neox
  • 'OpenAI' is a misnomer and a company with way too much power.
    The cat is out of the bag, this tech is not going away, and will very shortly be a regular part of life. OpenAI's pretentious decision to drop their nonprofit status and start charging for a product they received money to develop and release for free is asinine.
  • Thank You! (Petition Update: Day 4) (Too long for change.org)
    AI Dungeon Scenario/Adventure Downloader (save your creations for use with a different AI): https://jtvjan.nl/aidungeon/ GPT-Neo (Google Colab): https://colab.research.google.com/github/EleutherAI/GPTNeo/blob/master/GPTNeo_example_notebook.ipynb GPT-Neo (repository): https://github.com/EleutherAI/gpt-neo GPT-NeoX (repository): https://github.com/EleutherAI/gpt-neox/ New, censorship-free AI Dungeon subreddit: https://www.reddit.com/r/AIDungeon_2/
  • So, is The Infinite Story a viable switch from AI Dungeon until they get their shit together again?
    reddit.com/r/AIDungeon | 2021-04-28
    And this is the GitHub of this AI, I guess.
  • Update to Our Community
    reddit.com/r/AIDungeon | 2021-04-28
    Godspeed to the people at https://github.com/EleutherAI/gpt-neox.
  • Fuck this drama, let's just create our own, open-source AID called "OpenDungeon". Anyone agree?
    reddit.com/r/AIDungeon | 2021-04-28
    Yeah, open-source, OpenAI would have laughed at the idea, but there's something here.
  • This AI Can Generate Convincing Text—and Anyone Can Use It
    'Cept it's under active development.
  • GPT Neo: open-source GPT-3-like model with pretrained weights available
    news.ycombinator.com | 2021-03-21
    GPT-NeoX, which is a model from the same group but using GPUs instead of TPUs, uses techniques from DeepSpeed:

    https://github.com/EleutherAI/gpt-neox/

  • Zero-3 Offload: Scale DL models to trillion parameters without code changes
    news.ycombinator.com | 2021-03-13
    GPT-NeoX is an example project that is using deepspeed and Zero-3 offloading. The wider project intend to train a GPT-3 sized model and release it freely to the world.

    https://github.com/EleutherAI/gpt-neox

    news.ycombinator.com | 2021-03-13
    Looks like they got it working recently https://github.com/EleutherAI/gpt-neox/pull/178
    news.ycombinator.com | 2021-03-13
  • Tom Scott: I asked an AI for video ideas, and they were actually good
    reddit.com/r/videos | 2021-02-23
    They have another GPT project as well. Not sure what the difference between the two are as they are both being updated. https://github.com/EleutherAI/gpt-neox

Stats

Basic gpt-neox repo stats
13
1,194
9.8
3 days ago

EleutherAI/gpt-neox is an open source project licensed under Apache License 2.0 which is an OSI approved license.

Find remote Python jobs at our new job board 99remotejobs.com. There are 10 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.