fourkeys
openllmetry
| fourkeys | openllmetry | |
|---|---|---|
| 11 | 2 | |
| 2,048 | 1,271 | |
| - | 14.3% | |
| 0.0 | 9.8 | |
| 3 months ago | 2 days ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fourkeys
-
🦊 GitLab: A Python Script Calculating DORA Metrics
Four Keys is an open source alternative by Google employees that has been halted earlier this year (but forks-friendly).
- Team is trying to build an entirely custom service to calculate DORA metrics for our company. Is this normal or are we over-stretching ourselves?
-
“If Elon Musk wanted to destroy his developer teams, the quickest way to do it was stack-ranking developers and measuring lines of code” 1,000%. Only team-based metrics make sense.
DORA metrics
-
"The Pushgateway is not an event store. [...] tracking something like release events has to happen with some event-logging framework."
We began tracking Dora metrics by saving all events from our SCM and CI/CD systems into postres DB. Guidance: https://github.com/GoogleCloudPlatform/fourkeys
-
How do you measure DORA Metrics
For starters, there a number of tools such as Sleuth (disclaimer: am co-founder) that will measure the metrics for you. There are also open source options like Four Keys and many vendors like Gitlab also provide some or all metrics as well, though make sure they are measuring things as you expect.
- How do you measure DORA Metrics?
-
DORA metrics: a Google open source tool for tracking them
I looked a lot for a tool that could help my team track these metrics. I knew that Jira, Gitlab, and some other tools implement these features but I was looking for something with a high level of customization, and not so coupled to a specific product (we use different systems for deployment, change, and incident) and one day I incidentally discovered FourKeys.
-
Effective Metrics for Development Teams
GoogleCloudPlatform/fourkeys is a software tool built by Google to generate insights from data based on the four core metrics mentioned above.
-
How to boost your Engineering Speed & Quality with the right Metrics
One solution we would recommend is the Four Keys project by Google.
-
How is success measured in your DevOps team? Is anyone using these 4 key metrics?
Yep, in the process of productising Google’s Four Keys pattern. Pretty quick to stand up if you’re already on GCP.
openllmetry
-
Pydantic Logfire
I’m also aware of other OSS initiatives doing similar initiatives, so I wouldn’t say no one has ever done what your doing.
[1] https://github.com/traceloop/openllmetry
-
Show HN: You don't need to adopt new tools for LLM observability
So why should it be different when the app you're building happened to be using LLMs?
So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js
A few months ago we launched the python flavor here (https://news.ycombinator.com/item?id=37843907) and we've now built a compatible one for Node.js.
Would love to hear your thoughts and opinions!
Check it out -
Docs: https://www.traceloop.com/docs/openllmetry/getting-started-t...
Github:
What are some alternatives?
DevOpsMetrics - A project to extract and process high performing DevOps metrics (DORA) from GitHub and Azure DevOps
ludwig - Low-code framework for building custom LLMs, neural networks, and other AI models
pushgateway - Push acceptor for ephemeral and batch jobs.
openlit - OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics in a single application 🔥 🖥 . 👉 Open source GenAI and LLM Application Performance Monitoring (APM) & Observability tool
www-gitlab-com
reliza-cli - CLI to interact with Reliza Hub