llm_steer-oobabooga
jan
| llm_steer-oobabooga | jan | |
|---|---|---|
| 4 | 16 | |
| 30 | 18,549 | |
| - | 21.8% | |
| 6.6 | 10.0 | |
| 2 months ago | 4 days ago | |
| Python | TypeScript | |
| MIT License | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm_steer-oobabooga
-
Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?
I agree with you re:extensions. I know something of the extension ecosystem for it - I built one - https://github.com/Hellisotherpeople/llm_steer-oobabooga
Oobabooga the closest thing we have to maximalism. It has exposure for by far the largest number of parameters/settings/backends compared to all others.
My main point is that the world yearns for a proper "Photoshop for text" - and no one has even tried to make this (closest is oobabooga). All VC backed competitors are not even close to the mark on what they should be doing here.
- Sterring vectors for LLMs, now in the largest open source webUI
-
Manipulating the Internal World Model of a Chess Playing Language Model
All of the related work, such as activation/representation engineering, and control/steering vectors is also really neat!
You can play with steering vectors within oobabooga now: https://github.com/Hellisotherpeople/llm_steer-oobabooga
- Steering vectors, now available in the largest open source LLM webUI
jan
-
Introducing Jan
As we continue this blog series, let's explore a fully open-source alternative to LM Studio - Jan, a project from Southeast Asia.
-
AI enthusiasm - episode #2🚀
Jan.ai is a 100% local alternative to ChatGPT: you can download LLMs and run them directly from within the application, or even prompting them and retrieving their response via API.
- Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?
-
Show HN: I made an app to use local AI as daily driver
It would be cool to have the option to use the OpenAI API as well in the same interface. http://jan.ai does this, so that's what I'm using at the moment.
- Jan – Bringing AI to Your Desktop
- FLaNK 15 Jan 2024
-
Why the M2 is more advanced that it seemed
Was it this? I haven’t tried it yet but it does look nice.
https://jan.ai/
- Jan is an open source alternative to ChatGPT that runs 100% offline
- Open-Source ChatGPT Alternative Jan
- Run LLMs Locally with an OpenAI API
What are some alternatives?
unstructured - Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.
chainlit - Build Conversational AI in minutes ⚡️
FLaNK-VectorDB - NiFi and Vector Databases
obsidian-local-llm - Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.
modelfusion-llamacpp-nextjs-starter - Starter examples for using Next.js and the Vercel AI SDK with Llama.cpp and ModelFusion.
VOLlama - An accessible chat client for Ollama
aeon - A toolkit for machine learning from time series
FreedomGPT - This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface
mlx-examples - Examples in the MLX framework
llm - Access large language models from the command-line
deepflow - :rocket: eBPF-powered observability & zero-code distributed tracing :sparkles:
gio - Mirror of the Gio main repository (https://git.sr.ht/~eliasnaur/gio)