airoboros
lmql
airoboros | lmql | |
---|---|---|
8 | 30 | |
948 | 3,320 | |
- | 2.9% | |
8.7 | 9.5 | |
about 2 months ago | about 1 month ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
airoboros
- TinyLlama project aims to pretrain a 1.1B Llama model on 3T tokens
- Airoboros: Customizable implementation of the self-instruct paper
-
airoboros (tool) overhaul
Just wanted to drop a note that I overhauled the airoboros tool not the models to have most of the prompts I've been using to build the datasets, plus a couple extras.
-
(2/2) May 2023
airoboros: using large language models to fine-tune large language models (https://github.com/jondurbin/airoboros)
-
Airoboros [7B/13B]
This is a fine-tuned LlaMa model, using completely synthetic training data created by https://github.com/jondurbin/airoboros
-
airobors-13b - 98% eval vs gpt-3.5-turbo
I used airoboros, a python tool I wrote, to generate the synthetic instruction response pairs, and included a jailbreak prompt to attempt to bypass OpenAI censorship. This is the only dataset used to fine-tune the model.
-
[P] airoboros 7b - instruction tuned on 100k synthetic instruction/responses
This is a 7b parameter, fine-tuned on 100k synthetic instruction/response pairs generated by gpt-3.5-turbo using my version of self-instruct airoboros
-
[P] airoboros: a rewrite of self-instruct/alpaca synthetic prompt generation
GitHub Repo
lmql
- Show HN: Fructose, LLM calls as strongly typed functions
-
Prompting LLMs to constrain output
have been experimenting with guidance and lmql. a bit too early to give any well formed opinions but really do like the idea of constraining llm output.
-
[D] Prompt Engineering Seems Like Guesswork - How To Evaluate LLM Application Properly?
the only time i've ever felt like it was anything other than guesswork was using LMQL . not coincidentally, LMQL works with LLMs as autocomplete engines rather than q&a ones.
-
Guidance for selecting a function-calling library?
lqml
-
Show HN: Magentic – Use LLMs as simple Python functions
This is also similar in spirit to LMQL
https://github.com/eth-sri/lmql
- Show HN: LLMs can generate valid JSON 100% of the time
- LangChain Agent Simulation – Multi-Player Dungeons and Dragons
-
The Problem with LangChain
LLM calls are just function calls, so most functional composition is already afforded by any general-purpose language out there. If you need fancy stuff, use something like Python‘s functools.
Working on https://github.com/eth-sri/lmql (shameless plug, sorry), we have always found that compositional abstractions on top of LMQL are mostly there already, once you internalize prompts being functions.
- Is there a UI that can limit LLM tokens to a preset list?
-
Local LLMs: After Novelty Wanes
LMQL is another.
What are some alternatives?
WizardLM - Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath
guidance - A guidance language for controlling large language models.
TinyLlama - The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
WizardVicunaLM - LLM that combines the principles of wizardLM and vicunaLM
simpleaichat - Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
datablations - Scaling Data-Constrained Language Models
NeMo-Guardrails - NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
chain-of-thought-hub - Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
guardrails - Adding guardrails to large language models.
gorilla - Gorilla: An API store for LLMs
basaran - Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.