llmflows
llm-app
llmflows | llm-app | |
---|---|---|
1 | 12 | |
624 | 2,526 | |
- | 13.7% | |
8.6 | 8.9 | |
about 1 month ago | 15 days ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llmflows
llm-app
-
How to use LLMs for real-time alerting
Answering queries and defining alerts: Our application running on Pathway LLM-App exposes the HTTP REST API endpoint to send queries and receive real-time responses. It is used by the Streamlit UI app. Queries are answered by looking up relevant documents in the index, as in the Retrieval-augmented generation (RAG) implementation. Next, queries are categorized for intent: an LLM probes them for natural language commands synonymous with notify or send an alert.
- Open Source Project showcasing Real-time intent detection + alerting via LLMs using Pathway LLM App and Streamlit, both open-source Pythonic frameworks. Can be used in LLMOps for monitoring, PII detection, and in BizOps to notify teams of critical changes by others in their documents.
-
Show HN: Alerting in realtime RAG: spot changes to LLM answers, using few tokens
(used in https://github.com/pathwaycom/llm-app/blob/69709a2cf58cdf6ea...)
-
How to build a custom GPT enabled full-stack app for real-time data
In this case, you need to build a custom LLM (Language Learning Model) app efficiently to give context to the answer process. A promising approach you find on the internet is utilizing LLMs with vector databases that come with costs like increased prep work, infrastructure, and complexity. Keeping source and vectors in sync is painful. Instead, you can use an open-source LLM App library in Python to implement real-time in-memory data indexing directly reading data from any compatible storage and showing this data on Streamlit UI.
- Python library to build LLM App
-
Privacy-preserving LLM App for real-time data
π - Here's the repo link: https://github.com/pathwaycom/llm-app.
- LLM (Large Language Model) App is an innovative AI Chat Bot
-
Show HN: LLM App β build a realtime LLM app in 30 lines, with no vector database
To quickly get to the application sources please go to:
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the simplest contextless app
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the default app that builds a reactive index of context documents
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the contextful app reading data from s3
- https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the app using locally available models
-
LLM(Large Language Models) for better developer learning of your product
This article explores how LLMs(Large Language Models) and LLM apps such as Pathway can be leveraged for effective and efficient developer education, which can boost the utilization of your product.
What are some alternatives?
GPT-4-Prompt-Library - Advanced Code and Text Manipulation Prompts for Various LLMs. Suitable for GPT-4, Claude, Llama2, Falcon, Bard, and other high-performing open-source LLMs. [Moved to: https://github.com/abilzerian/LLM-Prompt-Library]
pathway - Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with β€οΈ for Python & ML/AI developers.
AutoPR - Run AI-powered workflows over your codebase
llm-prompt-testing - Prompt Testing framework for LLMs (specifically OpenAI models). Compute NLP and Responsible AI metrics for each model-generated answer.
gateway - A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.
falcongpt - Simple GPT app that uses the falcon-7b-instruct model with a Flask front-end.
llm-vscode-inference-server - An endpoint server for efficiently serving quantized open-source LLMs for code.
chatgpt-api-python-sales - Find real-time sales with AI-powered Python API using ChatGPT and LLM (Large Language Model) App.
generative-ai-for-beginners - 18 Lessons, Get Started Building with Generative AI π https://microsoft.github.io/generative-ai-for-beginners/
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
openai-multi-client - Making your requests to the OpenAI API go fast!
askai - Command Line Interface for OpenAi ChatGPT