kube
vector
Our great sponsors
kube | vector | |
---|---|---|
18 | 96 | |
2,685 | 16,512 | |
4.0% | 5.7% | |
9.0 | 9.9 | |
2 days ago | 2 days ago | |
Rust | Rust | |
Apache License 2.0 | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kube
-
kftray - cross-platform utility to port-forward kubernetes services
https://github.com/kube-rs/kube/blob/main/kube-client/src/api/portforward.rs ill create an issue and start working on implementing it. Thanks for the feedback
- Kube-rs – a Rust client for Kubernetes
-
I quit my job to build a Kubernetes GUI, now looking for feedback!
Interesting, I haven't tested that one yet. We use kube-rs (https://github.com/kube-rs/kube) under the hood, which does automatically token refresh when needed. But there might be some edge cases not considered.
-
What's everyone working on this week (45/2022)?
So I used kube-rs and came up with this: https://github.com/mach-kernel/databricks-kube-operator
- kubelog - a graphical log viewer for Kubernetes.
-
[Rust] Is anyone working on any interesting (side-)projects in Rust? (preferably open-source)
Stackable is building k8s operators in Rust for bringing up interconnectable, data crunching applications (being able to bring up a complete data platform on any k8s cluster is the goal). kube-rs is used under the hood and code is open source.
-
Do you use Rust in devops?
yes, we had a very small API to create who created role bindings for a CI. I chose Rust because it was easy and seems easily maintainable with the kube-rs https://github.com/kube-rs/kube-rs crate
- A Rust Client for Kubernetes in the Style of a More Generic Client-Go
-
What is the financial impact migrating from DevOps Engineer to Rust developer ?
I have experiencie on this. I'm a DevOps engineer that started before DevOps was a thing, and I want to write rust for a living. What I'm doing is writting rust for tooling and kubernetes controllers using https://github.com/kube-rs/kube-rs. Rust and DevOps are close specially if you need to write your own tools. My recommendation is if you have some space to solve problems at your job with rust go and do it, if not try some opensource projects that interest you to get more experience.
vector
-
Docker Log Observability: Analyzing Container Logs in HashiCorp Nomad with Vector, Loki, and Grafana
job "vector" { datacenters = ["dc1"] # system job, runs on all nodes type = "system" group "vector" { count = 1 network { port "api" { to = 8686 } } ephemeral_disk { size = 500 sticky = true } task "vector" { driver = "docker" config { image = "timberio/vector:0.30.0-debian" ports = ["api"] volumes = ["/var/run/docker.sock:/var/run/docker.sock"] } env { VECTOR_CONFIG = "local/vector.toml" VECTOR_REQUIRE_HEALTHY = "false" } resources { cpu = 100 # 100 MHz memory = 100 # 100MB } # template with Vector's configuration template { destination = "local/vector.toml" change_mode = "signal" change_signal = "SIGHUP" # overriding the delimiters to [[ ]] to avoid conflicts with Vector's native templating, which also uses {{ }} left_delimiter = "[[" right_delimiter = "]]" data=<
- FLaNK AI Weekly 18 March 2024
- Vector: A high-performance observability data pipeline
-
Hacks to reduce cloud spend
we are doing something similar with OTEL but we are looking at using https://vector.dev/
-
About reading logs
We don't pull logs, we forward logs to a centralized logging service.
-
Self hosted log paraer
opensearch - amazon fork of Elasticsearch https://opensearch.org/docs/latestif you do this an have distributed log sources you'd use logstash for, bin off logstash and use vector (https://vector.dev/) its better out of the box for SaaS stuff.
-
creating a centralize syslog server with elastic search
I have done something similar in the past: you can send the logs through a centralized syslog servers (I suggest syslog-ng) and from there ingest into ELK. For parsing I am advice to use something like Vector, is a lot more faster than logstash. When you have your logs ingested correctly, you can create your own dashboard in Kibana. If this fit your requirements, no need to install nginx (unless you want to use as reverse proxy for Kibana), php and mysql.
-
Show HN: Homelab Monitoring Setup with Grafana
I think there's nothing currently that combines both logging and metrics into one easy package and visualizes it, but it's also something I would love to have.
Vector[1] would work as the agent, being able to collect both logs and metrics. But the issue would then be storing it. I'm assuming the Elastic Stack might now be able to do both, but it's just to heavy to deal with in a small setup.
A couple of months ago I took a brief look at that when setting up logging for my own homelab (https://pv.wtf/posts/logging-and-the-homelab). Mostly looking at the memory usage to fit it on my synology. Quickwit[2] and Log-Store[3] both come with built in web interfaces that reduce the need for grafana, but neither of them do metrics.
- [1] https://vector.dev
-
Retaining Logs generated by service running in pod.
Log to stdout/stderr and collect your logs with a tool like vector (vector.dev) and send it to something like Grafana Loki.
-
Lightweight logging on RPi?
I would recommend that you run vector as a systems service so you don't have to worry about managing it. Here is a basic config to do that - https://github.com/vectordotdev/vector/blob/master/distribution/systemd/vector.service .
What are some alternatives?
k8s-openapi - Rust definitions of the resource types in the Kubernetes client API
graylog - Free and open log management
kubie - A more powerful alternative to kubectx and kubens
Fluentd - Fluentd: Unified Logging Layer (project under CNCF)
sqlparser-rs - Extensible SQL Lexer and Parser for Rust
agent - Vendor-neutral programmable observability pipelines.
winsafe - Windows API and GUI in safe, idiomatic Rust.
syslog-ng - syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
v8-runtime-tutorial - Source code for the tutorial series
OpenSearch - 🔎 Open source distributed and RESTful search engine.
mirrord - Connect your local process and your cloud environment, and run local code in cloud conditions.
tracing - Application level tracing for Rust.