Show HN: LLM App – build a realtime LLM app in 30 lines, with no vector database

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • llm-app

    LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.

  • To quickly get to the application sources please go to:

    - https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the simplest contextless app

    - https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the default app that builds a reactive index of context documents

    - https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the contextful app reading data from s3

    - https://github.com/pathwaycom/llm-app/blob/main/llm_app/path... for the app using locally available models

  • pathway

    Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.

  • Pathway (https://github.com/pathwaycom/pathway) is a data processing framework we are developing that unifies stream and batch processing of large datasets. It lets developers concentrate on writing the data processing logic, without worrying about tracking changes to data and updating the results. The same code can then be run on batch data (e.g. during testing) or on real-time data streams (i.e. online query processing)

    In the LLM app, Pathway allows concentrating on prompt building and querying the LLM APIs as if the corpus of documents were static, while all updates to it are handled by the framework itself.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Live Plotting and Transformations with Jupyter using Python

    1 project | /r/Python | 5 Dec 2023
  • How to build a custom GPT enabled full-stack app for real-time data

    5 projects | dev.to | 5 Sep 2023
  • How to use LLMs for real-time alerting

    3 projects | dev.to | 20 Nov 2023
  • Open Source Project showcasing Real-time intent detection + alerting via LLMs using Pathway LLM App and Streamlit, both open-source Pythonic frameworks. Can be used in LLMOps for monitoring, PII detection, and in BizOps to notify teams of critical changes by others in their documents.

    1 project | /r/Python | 17 Nov 2023
  • Show HN: Alerting in realtime RAG: spot changes to LLM answers, using few tokens

    2 projects | news.ycombinator.com | 17 Nov 2023