UA-EdgeTranslator
gateway
| UA-EdgeTranslator | gateway | |
|---|---|---|
| 1 | 8 | |
| 24 | 4,940 | |
| - | 8.0% | |
| 7.9 | 9.8 | |
| 14 days ago | 5 days ago | |
| C# | Jupyter Notebook | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
UA-EdgeTranslator
gateway
-
How to create LLM fallback from Gemini Flash to GPT-4o?
To demonstrate fallbacks feature, we'll be building a sample Node.js application and integrating Google's Gemini. We'll be using the OpenAI SDK and Portkey's open-source AI Gateway to demonstrate the fallback to GPT.
-
Show HN: Route your prompts to the best LLM
Great to know this!
I have come across Portkey's Open-source AI Gateway which kind of does the same.
https://github.com/portkey-ai/gateway
It looks like with more LLM adoption, resiliency and cost related aspects take off sooner than expected unlike other technological trends in the past.
I'm also thinking that there is a chance if something like this could help build a better RAG pipeline or evals for the GenAI App. Because end of the day you want to reduce hallucinations but still get good generative responses.
- Adding a streaming run function to the Assistants API
- FLaNK Stack Weekly 22 January 2024
-
We open sourced our AI gateway written in TS
Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.
- Show HN: A lightweight AI gateway to 100 models, in TS
- Open Source AI Gateway
What are some alternatives?
rebuff - LLM Prompt Injection Detector
fill - Generative fill in 3D.
llmflows - LLMFlows - Simple, Explicit and Transparent LLM Apps
promptfoo - Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. [Moved to: https://github.com/promptfoo/promptfoo]
VulnerableApp-facade - VulnerableApp-facade is probably most modern lightweight distributed farm of Vulnerable Applications built for handling wide range of vulnerabilities across tech stacks.
agenta - The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
renovate - Home of the Renovate CLI: Cross-platform Dependency Automation by Mend.io
OpenPipe - Turn expensive prompts into cheap fine-tuned models
ml-ferret
OutRun - OutRun is an open-source, privacy oriented, outdoor fitness tracker.
gateway.
speedbump - TCP proxy for simulating variable, yet predictable network latency :globe_with_meridians::hourglass_flowing_sand: