AutoLearn-GPT
lora-instruct
AutoLearn-GPT | lora-instruct | |
---|---|---|
1 | 1 | |
24 | 97 | |
- | - | |
6.5 | 7.0 | |
12 months ago | 4 months ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
AutoLearn-GPT
-
Can GPT improve itself?
Has anyone explored whether GPT could improve itself using the data it gathered. I have made a project that might be the first step to explore it, which is justing memorizing everything that it does not know. Here is the link: Reason-Wang/AutoLearn-GPT: ChatGPT learns automatically. (github.com). Of course this is not the real learning for GPT, since it does not update parameters. But it is difficult to generate high quality data suitable for training. Does anyone have ideas about this?
lora-instruct
-
Training a LoRA with MPT Models
Hi, i have created custom data, same format as alphachas json file. And fine tuned mpt-7b-instruct using this link https://github.com/leehanchung/lora-instruct I have also used your patch, the fine tuning got successfull and also the loss got decreased but when am trying to make prediction using the fine tuned model am not getting correct output even on the trained data, it's generating output with lots of nonsense
What are some alternatives?
SuperAGI - <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
FastLoRAChat - Instruct-tune LLaMA on consumer hardware with shareGPT data
GPT-Codemaster - Automatic programming by creating Pull Requests from Issues using LLMs
LMOps - General technology for enabling AI capabilities w/ LLMs and MLLMs
chatGPT-cheatsheet - An ever-evolving introduction to ChatGPT, AI, and machine learning (including prompt examples and Python-built chatbots)
mpt-lora-patch - Patch for MPT-7B which allows using and training a LoRA
searchGPT - Grounded search engine (i.e. with source reference) based on LLM / ChatGPT / OpenAI API. It supports web search, file content search etc.
Roy - Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.
funcchain - ⛓️ build cognitive systems, pythonic
punica - Serving multiple LoRA finetuned LLM as one
GPTDiscord - A robust, all-in-one GPT interface for Discord. ChatGPT-style conversations, image generation, AI-moderation, custom indexes/knowledgebase, youtube summarizer, and more!
py2gpt - Convert Python code into JSON consumable by OpenAI's function API.