tempo
go_serialization_benchmarks
tempo | go_serialization_benchmarks | |
---|---|---|
7 | 8 | |
3,644 | 1,529 | |
1.9% | - | |
9.7 | 4.4 | |
4 days ago | 4 days ago | |
Go | Go | |
GNU Affero General Public License v3.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tempo
-
OpenTelemetry in 2023
Grafana Tempo also switched from Protobuf storage format to Apache Parquet last year. It's fully open source, and the proposal is here: https://github.com/grafana/tempo/blob/main/docs/design-propo...
disclosure: I work for Grafana!
-
Monitoring and Testing Cloud Native APIs with Grafana
By combining Grafana Tempo with Tracetest, you can create a robust solution for monitoring and testing APIs with distributed tracing.
-
Introducing Tempo: low latency, cross-platform, end-to-end typesafe APIs
Last point: There's already a major open source project in the backend space called Tempo. You may want to reconsider the name.
-
Waffles, Fries, Beer and Developers; Notes from FOSDEM 2023
I started the day with some Rust and spent the rest of the day in the Monitoring and Observability DevRoom. Most of the talks I attended were about OpenTelemetry and were very Grafana Labs-heavy. I knew Grafana and, to a less extent, Loki, and I had never seen Tempo (distributed tracing) and Phlare (profiling), and Mimir (backend for metrics, more backend-y than Prometheus?).
-
Thoughts on Opentelemetry?
Grafana Tempo yes. Integrates seamlessly with Grafana (the dashboarding)
go_serialization_benchmarks
-
Rob Pike: Gobs of data (2011)
Someone made a benchmark of serialization libraries in go [1], and I was surprised to see gobs is one of the slowest ones, specially for decoding. I suspect part of the reason is that the API doesn't not allow reusing decoders [2]. From my explorations it seems like both JSON [3], message-pack [4] and CBOR [5] are better alternatives.
By the way, in Go there are a like a million JSON encoders because a lot of things in the std library are not really coded for maximum performance but more for easy of usage, it seems. Perhaps this is the right balance for certain things (ex: the http library, see [6]).
There are also a bunch of libraries that allow you to modify a JSON file "in place", without having to fully deserialize into structs (ex: GJSON/SJSON [7] [8]). This sounds very convenient and more efficient that fully de/serializing if we just need to change the data a little.
--
1: https://github.com/alecthomas/go_serialization_benchmarks
2: https://github.com/golang/go/issues/29766#issuecomment-45492...
--
3: https://github.com/goccy/go-json
4: https://github.com/vmihailenco/msgpack
5: https://github.com/fxamacker/cbor
--
6: https://github.com/valyala/fasthttp#faq
--
7: https://github.com/tidwall/gjson
8: https://github.com/tidwall/sjson
-
Introducing Tempo: low latency, cross-platform, end-to-end typesafe APIs
The bebop definition specifies fixed-width types inside a struct. The format of structs cannot be changed, but there are efficiency gains by omitting all of the indices and header data. It's useless as the root message, but it's small and fast for a benchmark.
-
mus-go - the fastest Golang serializer today
Hey everyone! Let me introduce you to mus-go - the fastest Golang serializer today. If you look at benchmarks (https://github.com/alecthomas/go_serialization_benchmarks), you can see that it could be almost twice as fast as its closest "competitor":
-
What is the fastest way to encode the arbitrary struct into bytes?
This might be of interest: https://github.com/alecthomas/go_serialization_benchmarks
- 80x improvements in caching by moving from JSON to gob
-
gRPC Is Easy to Misconfigure
The protobuf vs msgpack benchmarks are not too bad. Msgpack performs very decently.
https://github.com/alecthomas/go_serialization_benchmarks
-
Bebop encoding in Go
Maybe submit a PR against https://github.com/alecthomas/go_serialization_benchmarks? That covers a ton of serialization formats already, so adding your library would be cool and avoid wheel reinvention.
What are some alternatives?
jaeger - CNCF Jaeger, a Distributed Tracing Platform
bebop - bebop wire format in Go
blog - SZÉKELYDATA | Erdély, Székelyföld és a nagyvilág a Big Data korszakában
encoding - Go package containing implementations of efficient encoding, decoding, and validation APIs.
jaeger-client-go - 🛑 This library is DEPRECATED!
bebop - 🎷No ceremony, just code. Blazing fast, typesafe binary serialization.
mimir - Grafana Mimir provides horizontally scalable, highly available, multi-tenant, long-term storage for Prometheus.
msgpack - MessagePack is an extremely efficient object serialization library. It's like JSON, but very fast and small.
SwiftyTimer - Swifty API for NSTimer
grpc-web - gRPC for Web Clients
apm-server - APM Server
msgp - A Go code generator for MessagePack / msgpack.org[Go]