[D] Is a GPT-J successor in the works?

• YaLM-100B

  35 3,721 0.0 Python

  Pretrained language model with 100B parameters

  

There's been a few different open-source GPT-3 style large language models since GPT-J: ~175B: Bloom from huggingface, ~100B: YaLM from Yandex, and ~20B: GPT NeoX. None of them match GPT-3 performance but since their open source (for commercial use too) theyre worth checking out. I'm not sure if Stability has plans to train a GPT3 size model though.

• gpt-neox

  52 6,569 8.9 Python

  An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

  

There's been a few different open-source GPT-3 style large language models since GPT-J: ~175B: Bloom from huggingface, ~100B: YaLM from Yandex, and ~20B: GPT NeoX. None of them match GPT-3 performance but since their open source (for commercial use too) theyre worth checking out. I'm not sure if Stability has plans to train a GPT3 size model though.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project