langfuse
hyperdx
langfuse | hyperdx | |
---|---|---|
11 | 18 | |
3,681 | 6,198 | |
30.4% | 7.8% | |
9.9 | 9.6 | |
7 days ago | 4 days ago | |
TypeScript | TypeScript | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
langfuse
-
Top Open Source Prompt Engineering Guides & Tools🔧🏗️🚀
Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.
- Roast My Docs
-
Show HN: Open-Source LLM Observability and Export to Grafana, Datadog etc.
Congrats on the Show! How’s this different from https://github.com/langfuse/langfuse? The exports seems really interesting
-
RAG observability in 2 lines of code with Llama Index & Langfuse
Thus, we started working on Langfuse.com (GitHub) to establish an open source LLM engineering platform with tightly integrated features for tracing, prompt management, and evaluation. In the beginning we just solved our own and our friends’ problems. Today we are at over 1000 projects which rely on Langfuse, and 2.3k stars on GitHub. You can either self-host Langfuse or use the cloud instance maintained by us.
-
langfuse VS agenta - a user suggested alternative
2 projects | 22 Nov 2023
-
Ask HN: Who is hiring? (November 2023)
- We want to build a tool that is recommended here on HN: you can build a tool you would want to use yourself.
Please see more details here: https://langfuse.com/careers or reach out directly to me: [email protected]
[1] https://github.com/langfuse/langfuse
[2] https://create.t3.gg/
-
How are generative AI companies monitoring their systems in production?
We struggled with this ourselves while building LLM-based products and then open-sourced our observability/monitoring tool [1]. Many use it to track RAG and agents in production, run custom evals on the production traces (focused on hallucination), and track how metrics are different across releases or customers. Feel free to dm if there is something specific you are looking to solve, happy to help.
[1] https://github.com/langfuse/langfuse
-
LLM Analytics 101 - How to Improve your LLM app
Visit us on Discord and Github to engage with our project.
-
Ask HN: Any tools or frameworks to monitor the usage of OpenAI API keys?
Maybe try https://github.com/langfuse/langfuse
It was recently shared on HN
- Show HN: Langfuse – Open-source observability and analytics for LLM apps
hyperdx
-
Show HN: HyperDX Local – Open-source Datadog alternative for local debugging/dev
Hi HN, Mike and Warren here! We’ve been building an open source local-dev-friendly mode for HyperDX (hyperdx.io). It's a single Docker container that lets you view logs, metrics, and traces for local development in a similar way you can use them for production (live tail, filter/correlate logs & spans, build charts, flamegraph, etc.) Basically, imagine you can run Datadog in a single container for local development. We does this by spinning up an OpenTelemetry collector, Clickhouse DB and HyperDX UI all in a single container - it only takes a few seconds to start and lets you start live tailing your local logs and traces immediately (and graph metrics of course).
README (w/ demo gif): https://github.com/hyperdxio/hyperdx/blob/main/LOCAL.md
We started building local mode as it became one of our most loved [1] community issue after sharing HyperDX. It made sense - as we constantly use HyperDX to debug our own issues locally, and have found it to be a huge productivity boost for things like…
1. Tailing multiple container logs (and grepping/isolating them) without a ton of different terminal splits open at the same time.
2. Be able to sensibly view structured logs and correlated traces to debug local issues (because you’re using structured logging and tracing right?) instead of adding ad-hoc console statements that print out exactly what I could’ve gotten from tracing.
3. Testing telemetry are actually emitting/correlating as expected, before shipping it all the way out to prod and realizing I accidentally created a very expensive high-cardinality metric or a span that has the wrong properties.
We spent some time packaging & tuning our existing OSS stack to run in a single container with less memory/space requirements by staring at `dive` to slim down the image and applied incantations from documentation until memory usage improved. Additionally we removed a few non-local-friendly things like authentication requirements and extraneous services.
It still has all the goodness you’d want - so you can full text search your logs/traces, live tail all your events, view spans correlated with logs (and vice versa), create dashboards based on logs, metrics, traces, and is fully OpenTelemetry compatible - just point your Otel SDK/collector to http://localhost:4318 (or 4317 for the grpc folks) and you’re already good to go.
I’m excited to share what we’ve been working on and would love to hear your feedback and opinions!
Spin up the container yourself to try it out:
docker run -p 8000:8000 -p 4318:4318 -p 4317:4317 -p 8080:8080 -p 8002:8002 hyperdx/hyperdx-local
Main Open Source Repo: https://github.com/hyperdxio/hyperdx
Hosted Demo (in case you want to play around in a cloud sandbox instead): https://api.hyperdx.io/login/demo
HyperDX Landing Page: https://hyperdx.io
[1]: https://github.com/hyperdxio/hyperdx/issues/7
- Show HN: Ellipsis – Automatic pull request reviews
-
How We Stopped Our ClickHouse DB From Exploding
ClickHouse also excels at storing and querying semi-structured data, like event logs. Previously, many engineering teams used Elasticsearch in a similar niche to ClickHouse, building applications like Kibana. Increasingly, developers are choosing ClickHouse over Elasticsearch for its unparalleled performance characteristics. For example, our friends at hyperdx.io are using ClickHouse to build an open-source OpenTelemetry provider!
-
14 DevOps and SRE Tools for 2024: Your Ultimate Guide to Stay Ahead
HyperDX
-
Migrating to OpenTelemetry
Biased as a founder in the space [1] but I think with OpenTelemetry + OSS extensible observability tooling, the holy grail of one tool is more realizable than ever.
Vendor lock in with Otel now is hopefully a thing of the past - but now that more obs solutions are going open source, hopefully it's not necessarily true that one tool would be mediocre over all use cases (since DD and the likes are inherently limited by their own engineering teams, vs OSS products can have community/customer contributions to improve the surface area over time on top of the core maintainer's work).
[1] https://github.com/hyperdxio/hyperdx
-
Ask HN: Who is hiring? (November 2023)
HyperDX (YC S22) | Founding Engineer | SF Bay Area HQ | REMOTE
We're building an open source, dev friendly observability tool (think Datadog, but something developers actually love to use and companies can actually afford).
We're in the intersection of needing to build rock solid infrastructure ingesting TBs of data, searching it incredibly quickly and scalably, and layering on top a buttery smooth DX from our language-specific SDKs, APIs and web app.
We're super early and hiring our first founding engineer. We already have a cloud product customers pay for and love, loads of runway regardless of the wider economy, 5k+ Github stars weeks after our OSS launch, and tons of hard technical problems.
The vast majority of our work is open source, so you can get a sense of what you'd be working with here: https://github.com/hyperdxio/hyperdx
Our job listing is here as well: https://www.ycombinator.com/companies/hyperdx/jobs/zFXTbzl-f...
Come by our discord as well if you just want to talk shop: https://discord.gg/FErRRKU78j
I'm Mike, one of the cofounders. If you love shipping quickly and want to help us build from the ground up an open source developer tool (that devs won't hate when they're on-call), let me know! mike [at] hyperdx.io
-
Vendor lock-in is in the small details
Oh huh! What would you do with span start independent of stops?
A tangent on logcat - local observability to me is a really intriguing area, I think there's a story of Otel for local as well if someone can build a good enough local DX for consuming them (we've been told a number of times about this https://github.com/hyperdxio/hyperdx/issues/7 as an example)
-
HyperDX – open-source dev-friendly Datadog alternative
Hi HN, Mike and Warren here! We’ve been building HyperDX (hyperdx.io). HyperDX allows you to easily search and correlate logs, traces, metrics (alpha), and session replays all in one place. For example, if a user reports a bug “this button doesn’t work," an engineer can play back what the user was doing in their browser and trace API calls back to the backend logs for that specific request, all from a single view. Github Repo: https://github.com/hyperdxio/hyperdx
- FLaNK Stack for 25 September 2023
-
Cisco Acquires Splunk
We're building the OSS equivalent when it comes to the observability side of Splunk/DD, on Clickhouse naturally of course but believe in the same end goal of lowering cost via separation of compute and storage.
https://github.com/hyperdxio/hyperdx
What are some alternatives?
trulens - Evaluation and Tracking for LLM Experiments
openobserve - 🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces, RUM, Error tracking, Session replay).
llama_index - LlamaIndex is a data framework for your LLM applications
highlight - highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.
langchain - 🦜🔗 Build context-aware reasoning applications
omnigres - Postgres as a Platform
agenta - The all-in-one LLM developer platform: prompt management, evaluation, human feedback, and deployment all in one place.
SeaGOAT - local-first semantic code search engine
opentelemetry-instrument-openai-py - OpenTelemetry instrumentation for the OpenAI Python library
GlobalMLBuildingFootprints - Worldwide building footprints derived from satellite imagery
examples - Your one-stop-shop to try Xata out. From packages to apps, whatever you need to get started.
zincobserve - 🚀 10x easier, 🚀 140x lower storage cost, 🚀 high performance, 🚀 petabyte scale - Elasticsearch/Splunk/Datadog alternative for 🚀 (logs, metrics, traces). [Moved to: https://github.com/openobserve/openobserve]