openlit

OpenLIT: Complete Observability and Evals for the Entire GenAI Stack, from LLMs to GPUs. Improve your LLM apps from playground to production 📈. Supports 20+ monitoring integrations like OpenAI & LangChain. Collect and Send GPU performance, costs, tokens, user activity, LLM traces and metrics to any OpenTelemetry endpoint in just one line of code. (by openlit)

Openlit Alternatives

Similar projects and alternatives to openlit based on common topics and language

  • langfuse

    16 openlit VS langfuse

    🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • semantic-conventions

    3 openlit VS semantic-conventions

    Defines standards for generating consistent, accessible telemetry across a variety of domains

  • openllmetry

    Open-source observability for your LLM application, based on OpenTelemetry

  • pezzo

    18 openlit VS pezzo

    🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

  • spacy-llm

    🦙 Integrating LLMs into structured NLP pipelines

  • BricksLLM

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better openlit alternative or higher similarity.

openlit discussion

Log in or Post with

openlit reviews and mentions

Posts with mentions or reviews of openlit. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-05-28.
  • Unlocking Seamless GenAI & LLM Observability with OpenLIT
    2 projects | dev.to | 28 May 2024
    View on GitHub
  • Show HN: All you need is Prometheus and Jaeger for LLM Observability
    1 project | news.ycombinator.com | 28 May 2024
    OpenLIT simplifies the process of adding observability to your LLM applications through OpenTelemetry (OTel). Just a single line of code and you can start monitoring key attributes like costs, token usage, user interactions, and performance metrics.

    And it doesn't stop at Prometheus and Jaeger! OpenLIT is also compatible with other backends like Grafana Tempo, or any OTel-compatible system, giving you the flexibility to store and visualize data just the way you like it.

    Head over to our guide to get started. Oh, and we've set you up with a Grafana dashboard that's pretty much plug-and-play. You're going to love the visibility it offers.

    We're super keen to see how OpenLIT integrates into what you’re doing! Give it a go and share your thoughts. Your feedback is super valuable and will help us make OpenLIT even better. Swing by and star our project on GitHub here -> https://github.com/openlit/openlit

    Can’t wait to see OpenLIT in action in your LLM applications!

    Cheers!

  • Should I add CLA to my Open-source project?
    2 projects | news.ycombinator.com | 4 May 2024
    Last week we showcased our open-source project, OpenLIT (https://github.com/openlit/openlit), here, and thanks to this incredible community, we hit 300 stars in just a couple of days!

    One of my mentors, a core lead on OpenTelemetry, suggested we consider adding a Contributor License Agreement (CLA) to our project, similar to what has been done with OpenTelemetry.

    I understand the potential legal benefits a CLA offers, such as ensuring contributions can be freely used and distributed, which could be crucial for the project's long-term viability and to avoid legal complications.

    However, I’m equally concerned about the potential downsides, especially regarding community contributions. I worry that a CLA might stop new contributors who prefer to avoid legal hurdles or are reluctant to sign documents. Since OpenLIT aims to be truly open-source and community-driven, keeping the contribution process as straightforward as possible is essential to me.

    So, I’m turning to you, HN community, for guidance:

    - Have you implemented a CLA for your project? What impact did it have on contributions?

  • Show HN: OpenLIT – Open-Source LLM Observability with OpenTelemetry
    1 project | news.ycombinator.com | 27 Apr 2024
  • Doku: Open-source LLM observability platform
    1 project | news.ycombinator.com | 25 Mar 2024
  • Show HN: Open-Source LLM Observability and Export to Grafana, Datadog etc.
    2 projects | news.ycombinator.com | 22 Mar 2024
  • Show HN: LLM Observability Platform
    1 project | news.ycombinator.com | 11 Mar 2024
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 20 Sep 2024
    InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards. Learn more →

Stats

Basic openlit repo stats
8
720
9.6
4 days ago

openlit/openlit is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of openlit is Python.


Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com