Show HN: Route your prompts to the best LLM

1. dspy

   1 41 24,263 9.9 Python

   DSPy: The framework for programming—not prompting—language models

   

   I agree this is an interesting direction, I think this is on the roadmap for DSPy [https://github.com/stanfordnlp/dspy], but right now they mainly focus on optimizing the in-context examples.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. llama_index

   2 78 41,736 9.9 Python

   LlamaIndex is the leading framework for building LLM-powered agents over your data.

   

4. openrouter-runner

   3 36 916 5.2 Python

   Inference engine powering open source models on OpenRouter

   

5. semantic-router

   4 5 2,594 9.8 Python

   Superfast AI decision making and intelligent processing of multi-modal data.

   

   Thanks for sharing! These are useful toos, but they are a bit different, more based on similarity search in prompt space (a bit like semantic router: https://github.com/aurelio-labs/semantic-router). Our router uses a neural network for the routing decisions, and it can be trained on your own prompts [https://youtu.be/9JYqNbIEac0]. We're also working on adding support for on-prem deployment :)

6. RAG

   5 1 - -

   Discontinued [GET https://api.github.com/repos/Anteemony/RAG: 404 - Not Found // See: https://docs.github.com/rest/repos/repos#get-a-repository] (by Anteemony)

   https://unify.ai/docs/demos/demos/LangChain/RAG_playground/R... under "Usage" step 2.

   > "Input your Unify APhttps://github.com/Anteemony/RAG"

   Your product looks good in my view, although I have only spend about 10min thus far. The docs look pretty easy to follow along.

   I'll probably give this a try soon!

7. gateway

   6 17 7,886 9.9 TypeScript

   A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

   

   Great to know this!

   I have come across Portkey's Open-source AI Gateway which kind of does the same.

   https://github.com/portkey-ai/gateway

   It looks like with more LLM adoption, resiliency and cost related aspects take off sooner than expected unlike other technological trends in the past.

   I'm also thinking that there is a chance if something like this could help build a better RAG pipeline or evals for the GenAI App. Because end of the day you want to reduce hallucinations but still get good generative responses.

Suggest a related project