Open-Llama
promptfoo
| Open-Llama | promptfoo | |
|---|---|---|
| 7 | 20 | |
| 637 | 2,830 | |
| - | 21.2% | |
| 10.0 | 9.9 | |
| almost 1 year ago | 5 days ago | |
| Python | TypeScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Open-Llama
-
(1/2) May 2023
Training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF (https://github.com/s-JoL/Open-Llama)
- Open-Lamam: A “real” open-source project to train LLM not just checkpoints
- Open-Lamam: A real open-source project to train LLM
- Open-Llama: A Open Source Project for Training Language Models
-
OpenLLaMA: An Open Reproduction of LLaMA
Really exciting how fast fully pre-trained new models are appearing.
Here's another repo (with the same "open-llama" name) that has been available on hugging face as well for a few weeks. (different training dataset)
https://github.com/s-JoL/Open-Llama
-
Build your onw LLM 101
Open-Llama
- Open-Llama is an open source project that provides a complete set of training processes for building large-scale language models, from data preparation to tokenization, pre-training, instruction tuning, and reinforcement learning techniques such as RLHF.
promptfoo
- Google CodeGemma: Open Code Models Based on Gemma [pdf]
- AI Infrastructure Landscape
- Promptfoo – Testing and Evaluation for LLMs
-
Show HN: Prompt-Engineering Tool: AI-to-AI Testing for LLM
Super interesting. We've been experimenting with [promptfoo](https://github.com/promptfoo/promptfoo) at my work, and this looks very similar.
- GitHub – promptfoo/promptfoo: Test your prompts
-
I asked 60 LLMs a set of 20 questions
In case anyone's interested in running their own benchmark across many LLMs, I've built a generic harness for this at https://github.com/promptfoo/promptfoo.
I encourage people considering LLM applications to test the models on their _own data and examples_ rather than extrapolating general benchmarks.
This library supports OpenAI, Anthropic, Google, Llama and Codellama, any model on Replicate, and any model on Ollama, etc. out of the box. As an example, I wrote up an example benchmark comparing GPT model censorship with Llama models here: https://promptfoo.dev/docs/guides/llama2-uncensored-benchmar.... Hope this helps someone.
- Ask HN: Prompt Manager for Developers
- DeepEval – Unit Testing for LLMs
- Show HN: Knit – A Better LLM Playground
- Show HN: CLI for testing and evaluating LLM outputs
What are some alternatives?
open_llama - OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
shap-e - Generate 3D objects conditioned on text or images
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
prompt-engineering - Tips and tricks for working with Large Language Models like OpenAI's GPT-4.
My-Medium-Articles-Friendly-Links - Friendly link to all of my medium articles
WizardLM - Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath
AgileRL - Streamlining reinforcement learning with RLOps. State-of-the-art RL algorithms and tools.
chat-ui - Open source codebase powering the HuggingChat app
mlc-llm - Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
litellm - Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
EasyLM - Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
ChainForge - An open-source visual programming environment for battle-testing prompts to LLMs.