Launching UpTrain - an open-source LLM testing tool to help check the performance of your LLM applications

This page summarizes the projects mentioned and recommended in the original post on /r/datascience
concept-drift data-drift edge-cases Machine Learning ml-observability

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
WorkOS - The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
featured

  • uptrain

    UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

    • You can check out the project - https://github.com/uptrain-ai/uptrain and would love to hear feedback from the community

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Integrating Spade: Synthesizing Assertions for LLMs into My OSS Project

    2 projects | news.ycombinator.com | 23 Jan 2024

  • Sharing learnings from evaluating Million+ LLM responses

    1 project | news.ycombinator.com | 1 Nov 2023

  • Show HN: UpTrain (YC W23) – open-source tool to evaluate LLM response quality

    1 project | news.ycombinator.com | 22 Aug 2023

  • Introducing UpTrain - Open-source LLM evaluator 🔎

    1 project | /r/LanguageTechnology | 13 Jul 2023

  • [P] A Practical Guide to Enhancing Models for Custom Use-cases

    1 project | /r/MachineLearning | 5 Apr 2023