langtrace

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊 (by Scale3-Labs)

Langtrace Alternatives

Similar projects and alternatives to langtrace based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better langtrace alternative or higher similarity.

langtrace reviews and mentions

Posts with mentions or reviews of langtrace. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-04-30.
  • Pydantic Logfire
    7 projects | news.ycombinator.com | 30 Apr 2024
    +1 to this. Langtrace core maintainer here. We are building a SDK and a client for automatic instrumentation of LLM based applications using OTEL standards. The OpenLLMetry team along with the CNCF OpenTelemetry working group has been doing some great work standardizing semantic naming conventions and we are starting to adopt the same set of standards.

    [1] https://github.com/Scale3-Labs/langtrace

  • Show HN: Langtrace – OpenTelemetry Based LLM App Observability
    2 projects | news.ycombinator.com | 29 Apr 2024
    Ola and Karthik here. We are working on Langtrace(https://github.com/Scale3-Labs/langtrace), an open source, open telemetry based SDK and monitoring/evaluations client for LLM based applications. The SDK generates OTEL standard spans and traces for popular LLMs like OpenAI, Anthropic and Cohere, popular frameworks like Langchain and LlamaIndex and vectorDBs like ChromaDB and Pinecone.

    The LLM monitoring/evaluations space has seen a number of products off late, both open source and closed source ones. But, a couple of things we have observed are: lack of standard spans and traces that creates vendor lock in, different tools are optimized for solving different pain points - Evaluations, Prompt management, Datasets etc.

    We believe that adopting open telemetry(OTEL) standard tracing not only lets teams use our SDK without having to switch their observability client, but will also enable developers to develop tooling for any custom needs such as capturing datasets, prompts, evaluations etc.

    A quick note on what we have built so far:

    [1] We have a Python and a TypeScript SDK and we have broken down the support for the LLM layer into 3 groups, LLMs, Frameworks and VectorDBs. Our SDKs are open telemetry compatible, can be installed and used independently and we also provide an option to pass custom exporters to export the traces and spans to any observability tool of your choice.

    [2] An observability client that is hyper optimized for solving the unique pain points and challenges that come with LLM based apps like Evaluations, prompt iteration, datasets etc. We are SOC2 compliant and the client can also be self hosted if you have strict data privacy and protection requirements.

    [3] Both the SDK and the client are fully open source. We are leaning on the community to try it out and provide feedback.

    A note about Open Telemetry semantic conventions for LLMs - We would like to converge on standard names for trace attributes that follow the OTEL rules and are looking for feedback from experts here - https://github.com/Scale3-Labs/langtrace/discussions/71

    We recognize that this project is early and there is a lot of room for improvement. Would love to hear your thoughts and feedback. Thanks!

    Links:

    [1] https://langtrace.ai/

    [2] https://github.com/Scale3-Labs/langtrace

    [3] https://docs.langtrace.ai/introduction

  • Show HN: Langtrace – OpenTelemetry-Based LLM App Observability
    2 projects | news.ycombinator.com | 25 Apr 2024
    [1] We have a Python and a TypeScript SDK and we have broken down the support for the LLM layer into 3 groups, LLMs, Frameworks and VectorDBs. Our SDKs are open telemetry compatible, can be installed and used independently and we also provide an option to pass custom exporters to export the traces and spans to any observability tool of your choice.

    [2] An observability client that is hyper optimized for solving the unique pain points and challenges that come with LLM based apps like Evaluations, prompt iteration, datasets etc. We are SOC2 compliant and the client can also be self hosted if you have strict data privacy and protection requirements.

    [3] Both the SDK and the client are fully open source. We are leaning on the community to try and provide us with feedback.

    A note about Open Telemetry semantic conventions for LLMs. We would like to converge on standard names for trace attributes that follow the OTEL rules and are looking for feedback from experts here - https://github.com/Scale3-Labs/langtrace/discussions/71

    We recognize that this project is early and there is a lot of room for improvement. Would love to hear your thoughts and feedback. Thanks!

    Links:

    [1] https://langtrace.ai/

  • Langtrace – OpenTelemetry-Based Client and SDK for LLM App Observability
    1 project | news.ycombinator.com | 25 Apr 2024
  • A note from our sponsor - SurveyJS
    surveyjs.io | 4 May 2024
    With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js. Learn more →

Stats

Basic langtrace repo stats
6
87
8.8
5 days ago

Scale3-Labs/langtrace is an open source project licensed under GNU Affero General Public License v3.0 which is an OSI approved license.

The primary programming language of langtrace is TypeScript.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com