llmflows
gateway
llmflows | gateway | |
---|---|---|
1 | 6 | |
621 | 4,710 | |
- | 10.6% | |
8.6 | 9.8 | |
about 1 month ago | 4 days ago | |
Python | TypeScript | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llmflows
gateway
- Adding a streaming run function to the Assistants API
- FLaNK Stack Weekly 22 January 2024
-
We open sourced our AI gateway written in TS
Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.
- Show HN: A lightweight AI gateway to 100 models, in TS
- Open Source AI Gateway
What are some alternatives?
llm-app - LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,β‘in sync with your data sources.
rebuff - LLM Prompt Injection Detector
GPT-4-Prompt-Library - Advanced Code and Text Manipulation Prompts for Various LLMs. Suitable for GPT-4, Claude, Llama2, Falcon, Bard, and other high-performing open-source LLMs. [Moved to: https://github.com/abilzerian/LLM-Prompt-Library]
fill - Generative fill in 3D.
AutoPR - Run AI-powered workflows over your codebase
VulnerableApp-facade - VulnerableApp-facade is probably most modern lightweight distributed farm of Vulnerable Applications built for handling wide range of vulnerabilities across tech stacks.
llm-vscode-inference-server - An endpoint server for efficiently serving quantized open-source LLMs for code.
promptfoo - Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality. [Moved to: https://github.com/promptfoo/promptfoo]
generative-ai-for-beginners - 18 Lessons, Get Started Building with Generative AI π https://microsoft.github.io/generative-ai-for-beginners/
agenta - The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
openai-multi-client - Making your requests to the OpenAI API go fast!
renovate - Universal dependency automation tool.