H3 - a new generative language models that outperforms GPT-Neo-2.7B with only *2* attention layers! In H3, the researchers replace attention with a new layer based on state space models (SSMs). With the right modifications, they find that it can outperform transformers.

This page summarizes the projects mentioned and recommended in the original post on /r/singularity
language-model Transformers Gpt gpt-2 gpt-3

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • gpt-neo

    Discontinued An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Creating an open source chat bot like ChatGPT for my own dataset without GPU?

    1 project | /r/learnmachinelearning | 25 Apr 2023

  • Looks like some Taliban fighters are getting burnt out working the 9-5 grind

    1 project | /r/NonCredibleDefense | 5 Feb 2023

  • Where is the line for AI and where does ChatGPT stand?

    1 project | /r/MLQuestions | 7 Dec 2022

  • Teaser trailer for "The Diary of Sisyphus" (2023), the world's first feature film written by an artificial intelligence (GPT-NEO) and produced Briefcase Films, my indie film studio based in Northern Italy

    1 project | /r/movies | 7 Nov 2022

  • Accuracy of LLMs

    2 projects | /r/GPT3 | 30 Oct 2022