-
uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
P.S. I am building an open-source project UpTrain (https://github.com/uptrain-ai/uptrain), which helps data scientists to do so. We just wrote a blog on how this principle can be applied to fine-tune an LLM for a conversation summarization task. Check it out here: https://github.com/uptrain-ai/uptrain/tree/main/examples/coversation_summarization
Related posts
-
Integrating Spade: Synthesizing Assertions for LLMs into My OSS Project
-
Sharing learnings from evaluating Million+ LLM responses
-
Show HN: UpTrain (YC W23) – open-source tool to evaluate LLM response quality
-
Introducing UpTrain - Open-source LLM evaluator 🔎
-
Launching UpTrain - an open-source LLM testing tool to help check the performance of your LLM applications