Our great sponsors
-
Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
hivemind
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
-
PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
OpenAssistant is aiming to be the open source version of ChatGPT. It's already in a phase where people can help to pre-train it, they're taking in material etc. https://github.com/LAION-AI/Open-Assistant
Also, Stability is somehow connected to https://www.eleuther.ai/, whom is Open Sourcing their code. https://github.com/EleutherAI . They currently have a model trained on 20B parameters.
Look at Petals, and Hivemind.
One option could be https://github.com/lucidrains/PaLM-rlhf-pytorch The issue with that is that it requires you to train the model yourself and it also has around 5 times the parameters of chatgpt meaning you will need a supercomputer to even be able to train it. Other options that are not open source but as far as I know free to use are BLOOM, YouChat, Character.ai and lexii.ai