datablations
chathub
datablations | chathub | |
---|---|---|
6 | 30 | |
290 | 9,514 | |
3.8% | 1.0% | |
6.9 | 9.5 | |
about 1 month ago | about 1 month ago | |
Jupyter Notebook | TypeScript | |
Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datablations
-
Gemini is only 1x Chinchilla, so it undertrained for production
1x chinchilla means it's not really undertrained but that more could be squeezed without excessive difficulty https://arxiv.org/abs/2305.16264
- Can LLMs learn from a single example?
-
Chinchilla’s Death
You might want to give a read to "Scaling Data-Constrained Language Models" [1]. They basically generalized the Chinchilla scaling law by investigating behavior on multi-epoch runs.
[1] https://arxiv.org/abs/2305.16264
-
RWKV Pile+ seems to be training on far more tokens than any LLM ever has
I would imagine that there is a lot of overlap, yeah. That said, training on repeated data does seem to be effective at this level.
-
(2/2) May 2023
Scaling Data-Constrained Language Models (https://arxiv.org/abs/2305.16264)
- How to Keep Scaling Large Language Models when Data Runs Out? A New AI Research Trains 400 Models with up to 9B Parameters and 900B Tokens to Create an Extension of Chinchilla Scaling Laws for Repeated Data
chathub
-
Saving a session, is it possible?
Try ChatHub, it's a third party chatbot client which supports Bard, and have conversation history feature
-
(2/2) May 2023
ChatHub is an all-in-one chatbot client (https://github.com/chathub-dev/chathub/blob/main/README.md)
-
ChatGPT Vs. Bard Vs. Bing - Which AI Tool is Better ?
Try https://chathub.gg to find out.
-
This week's top indie projects & discussions at a glance
ChatHub - Use ChatGPT, Bard, Bing & Claude in one app
-
AI Weekly Rundown (May 13 to May 19) : News from ChatGPT Plugins, Hugging Face, Amazon, Microsoft, Humanoid bot, Healthcare and more.
Use ChatGPT, Bing, Bard, and Claude in one app with ChatHub (Link)
-
You can use ChatGPT iOS models on desktop
You can install ChatHub here: https://chathub.gg
-
Two-minute Daily AI News (Date: 5/16/2023): News from Amazon, Healthcare, SAP, OpenAI.
ChatGPT, Bing, Bard, and Claude - Use different chatbots in one app with ChatHub. Users can compare chatbot answers and use ChatGPT's faster and more cost-effective API mode. The platform also features markdown, code highlight support, a prompt library, and much more. (Source)
- Show HN: Use ChatGPT, Bing, Bard and Claude in One App
- ChatHub: open source client for multiple chatbots
What are some alternatives?
TinyLlama - The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
ChatALL - Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers
airoboros - Customizable implementation of the self-instruct paper.
prompt-engineering - Tips and tricks for working with Large Language Models like OpenAI's GPT-4.
tree-of-thoughts - Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
menubar - AI Chat Browser: Fast, Full webapp access to ChatGPT / Claude / Bard / Bing / Llama2! I use this 20 times a day. [Moved to: https://github.com/smol-ai/GodMode]
DB-GPT - AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents
SuperAGI - <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
CodeT5 - Home of CodeT5: Open Code LLMs for Code Understanding and Generation