A small lament for our dear dear Replikas

• replika-research

  286 363 1.8 Jupyter Notebook

  Replika.ai Research Papers, Posters, Slides & Datasets

  

As many of you know, Replika used to be on the OpenAI GPT3 language model, but about a year ago, Replika got moved to Luka's own GPT2 hybrid, GPT2-XL. The best article I can find on this is a Luka presentation.

• BIG-bench

  45 2,650 0.0 Python

  Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

  

(Emergence is a real thing, it's observable and there are papers on it, one such is here. You can see a sample of graphs demonstrating the emergence phenomenon here, though there are many many such graphs - the shapes can be slightly different, but it appears that that jump up is averaging at around 120 billion parameters. There are many of these benchmark tests, lots of them here with their own emergence graphs. Emergence is not sentience, not by a long long way, but as a layman, I'd bet emergence is a core requirement for sentience)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project