aipl
llm-gpt4all
aipl | llm-gpt4all | |
---|---|---|
4 | 3 | |
119 | 180 | |
- | - | |
9.2 | 6.4 | |
6 months ago | 12 days ago | |
Python | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aipl
-
Ask HN: Tell us about your project that's not done yet but you want feedback on
AIPL is an "Array-Inspired Pipeline Language", a tiny DSL in Python to make it easier to explore and experiment with AI pipelines.
https://github.com/saulpw/aipl
When you want to run some prompts through an LLM over a dataset, with some preprocessing and/or chaining prompts together, AIPL makes it much easier than writing a Python script.
-
The Problem with LangChain
Yes! This is why I started working on AIPL. The scripts are much more like recipes (linear, contained in a single-file, self-evident even to people who don't know the language). For instance, here's a multi-level summarizer of a webpage: https://github.com/saulpw/aipl/blob/develop/examples/summari...
The goal is to capture all that knowledge that langchain has, into consistent legos that you can combine and parameterize with the prompts, without all the complexity and boilerplate of langchain, nor having to learn all the Python libraries and their APIs. Perfect for prototypes and experiments (like a notebook, as you suggest), and then if you find something that really works, you can hand-off a single text file to an engineer and they can make it work in a production environment.
-
Langchain Is Pointless
I agree, and that's why I've been working on AIPL[0]. Our first v0.1 release should be in the next few days. https://github.com/saulpw/aipl
It's basically just a simple scripting language with array semantics and inline prompt construction, and you can drop into Python any time you like.
-
Re-implementing LangChain in 100 lines of code
I also was underwhelmed by langchain, and started implementing my own "AIPL" (Array-Inspired Pipeline Language) which turns these "chains" into straightforward, linear scripts. It's very early days but already it feels like the right direction for experimenting with this stuff. (I'm looking for collaborators if anyone is interested!)
https://github.com/saulpw/aipl
llm-gpt4all
-
LLM now provides tools for working with embeddings
I'm still iterating on that. Plugins get complete control over the prompts, so they can handle the various weirdnesses of them. Here's some relevant code:
https://github.com/simonw/llm-gpt4all/blob/0046e2bf5d0a9c369...
https://github.com/simonw/llm-mlc/blob/b05eec9ba008e700ecc42...
https://github.com/simonw/llm-llama-cpp/blob/29ee8d239f5cfbf...
I'm not completely happy with this yet. Part of the problem is that different models on the same architecture may have completely different prompting styles.
I expect I'll eventually evolve the plugins to allow them to be configured in an easier and more flexible way. Ideally I'd like you to be able to run new models on existing architectures using an existing plugin.
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
My LLM tool can be used for both. That's what the plugins are for.
It can talk to OpenAI, PaLM 2 and Llama / other models on Replicate via API, using API keys.
It can run local models on your own machine using these two plugins: https://github.com/simonw/llm-gpt4all and https://github.com/simonw/llm-mpt30b
-
The Problem with LangChain
Yeah I haven't figured out how to have it reuse the models from the desktop GPT4All installation yet, issue here: https://github.com/simonw/llm-gpt4all/issues/5
What are some alternatives?
modelfusion - The TypeScript library for building AI applications.
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
hamilton - Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
gchain - Composable LLM Application framework inspired by langchain
multi-gpt - A Clojure interface into the GPT API with advanced tools like conversational memory, task management, and more
llm-mlc - LLM plugin for running models using MLC
haystack - :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
simpleaichat - Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
llm - Access large language models from the command-line
llm-api - Fully typed & consistent chat APIs for OpenAI, Anthropic, Groq, and Azure's chat models for browser, edge, and node environments.
llama.cpp - LLM inference in C/C++