open-llms
panml
| open-llms | panml | |
|---|---|---|
| 22 | 25 | |
| 10,168 | 109 | |
| - | 0.0% | |
| 7.7 | 7.3 | |
| about 1 month ago | 10 months ago | |
| Python | ||
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
open-llms
-
7 SAAS ideas 💡 you can steal
Everyone knows about ChatGPT by now, but did you know there are other models like "Mistral" or "Falcon" - you can view a full list of open-source models here or on huggingface.
- eugeneyan/open-llms
-
GPT-4 API general availability
This is the most well-maintained list of commercially usable open LLMs: https://github.com/eugeneyan/open-llms
MPT, OpenLLaMA, and Falcon are probably the most generally useful.
For code, Replit Code (specifically replit-code-instruct-glaive) and StarCoder (WizardCoder-15B) are the current top open models and both can be used commercially.
-
Local LLMs: After Novelty Wanes
There's also MPT, which has a 7B, and Falcon, with a 7B and 40B although they have not had the inference tuning in community projects that the llamas have had. This is a good repo for reviewing what's available atm: https://github.com/eugeneyan/open-llms
- How to keep track of all the LLMs out there?
-
How do I learn AI/Machine Learning?
If I was going to do the same I would at least build off of something, check out https://github.com/eugeneyan/open-llms, you should at least have a decent understanding of artificial neural networks (ANNs) and this link is pretty good on the basic concepts you need inc classification and learning types, good luck friend.
- LLM and privacy
- Local LLM to learn, explore and use for commercial purpose
-
Best instruct model recommendations to use with T4?
This list might help: https://github.com/eugeneyan/open-llms
- [D] What is the best open source LLM so far?
panml
-
Best locally-runnable LLM
This is something I’m looking into as well. Currently built an open source kit to allow this experimentation easily: https://github.com/Pan-ML/panml
- PanML – a high lvl LLM library
- Article on general take of prompt engineering
- PanML - open source python library for LLM tuning and experimentation
-
Prompt Engineering
In terms of prompt approach and design, I’ve written some material on this in the context of sharing some of the directions people can think about. It’s using the open source library PanML, which sits on top of open source and commercial LLMs. GitHub: https://github.com/Pan-ML/panml
-
Alternative to LangChain for Open LLMs?
There are alternatives to langchain when it comes to working with LLMs, some have bit less abstraction involved. One such library is PanML where it's coming at it from a different angle where you can feed in direct HuggingFace parameters: https://github.com/Pan-ML/panml
Regarding your requirements of loading in 4-bit, as I created the library, it's something at we are looking to support - but also keen to get inputs and feedback on it to collaborate. Generally speaking, we use the model_arg to pass in any HuggingFace based parameters to the AutoModel instantiation.
- [P] I got fed up with LangChain, so I made a simple open-source alternative for building Python AI apps as easy and intuitive as possible.
- Python library for open source LLM experimentation and fine tuning
-
Writing direct python functions for programmatic control of prompting LLMs
It is related to this open source library: https://github.com/Pan-ML/panml
- High level library for interfacing with open source and OpenAI LLMs
What are some alternatives?
SillyTavern - LLM Frontend for Power Users.
bcapps
SillyTavern-Extras - Extensions API for SillyTavern.
feste - Feste is a free and open-source framework allowing scalable composition of NLP tasks using a graph execution model that is optimized and executed by specialized schedulers.
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
llm-jeopardy - Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
agency - Agency: Robust LLM Agent Management with Go
azure-search-openai-demo - A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
simpleAI - An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
code-eval - Run evaluation on LLMs using human-eval benchmark
simpleaichat - Python package for easily interfacing with chat apps, with robust features and minimal code complexity.