vector
cuetorials.com
Our great sponsors
vector | cuetorials.com | |
---|---|---|
95 | 26 | |
16,366 | 113 | |
4.8% | -0.9% | |
9.9 | 4.1 | |
7 days ago | 18 days ago | |
Rust | CUE | |
Mozilla Public License 2.0 | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
vector
- FLaNK AI Weekly 18 March 2024
- Vector: A high-performance observability data pipeline
-
Hacks to reduce cloud spend
we are doing something similar with OTEL but we are looking at using https://vector.dev/
-
About reading logs
We don't pull logs, we forward logs to a centralized logging service.
-
Self hosted log paraer
opensearch - amazon fork of Elasticsearch https://opensearch.org/docs/latestif you do this an have distributed log sources you'd use logstash for, bin off logstash and use vector (https://vector.dev/) its better out of the box for SaaS stuff.
-
creating a centralize syslog server with elastic search
I have done something similar in the past: you can send the logs through a centralized syslog servers (I suggest syslog-ng) and from there ingest into ELK. For parsing I am advice to use something like Vector, is a lot more faster than logstash. When you have your logs ingested correctly, you can create your own dashboard in Kibana. If this fit your requirements, no need to install nginx (unless you want to use as reverse proxy for Kibana), php and mysql.
-
Show HN: Homelab Monitoring Setup with Grafana
I think there's nothing currently that combines both logging and metrics into one easy package and visualizes it, but it's also something I would love to have.
Vector[1] would work as the agent, being able to collect both logs and metrics. But the issue would then be storing it. I'm assuming the Elastic Stack might now be able to do both, but it's just to heavy to deal with in a small setup.
A couple of months ago I took a brief look at that when setting up logging for my own homelab (https://pv.wtf/posts/logging-and-the-homelab). Mostly looking at the memory usage to fit it on my synology. Quickwit[2] and Log-Store[3] both come with built in web interfaces that reduce the need for grafana, but neither of them do metrics.
- [1] https://vector.dev
-
Retaining Logs generated by service running in pod.
Log to stdout/stderr and collect your logs with a tool like vector (vector.dev) and send it to something like Grafana Loki.
-
Lightweight logging on RPi?
I would recommend that you run vector as a systems service so you don't have to worry about managing it. Here is a basic config to do that - https://github.com/vectordotdev/vector/blob/master/distribution/systemd/vector.service .
-
Monitoring traefik access logs easily
You could have a look at Grafana Loki, it's easy to run (single binary for a small setup). Shipping your logs can be done by Promtail or something like Vector. They're both lightweight log shippers with support for Loki.
cuetorials.com
-
Ask HN: Comment here about whatever you're passionate about at the moment
CUE(lang), because devops & yaml engineering has gotten out of hand
I maintain https://cuetorials.com and am heading up the CUE sig-infra group for the time being
- That's a Lot of YAML
-
Ask HN: Who needs vendors, and vendors, who needs customers?
If you need help with CUE(lang), we maintain https://cuetorials.com and have experience helping others adopt it at their companies
email is in my HN profile, same handle on GitHub and X
- Learn you some CUE for a great good
-
Ask HN: Which Python or Rust-based static site generators to use as of 2023?
If you are more focused on the devops part, and not implementing a static site generator, then go with Python. For our static sites we use Hugo + GH Actions + Kubernetes (since we have a cluster anyway). There is not really any code involved here (example: https://github.com/hofstadter-io/cuetorials.com)
I'm personally interested to try https://docs.dagger.io/sdk/python/ for something. I used the CUE sdk, but it is effectively deprecated at this point. I use a mix of base, make, python, and CUE fro most devops / devex stuff now. Dagger makes it so local & CI stuff runs the same.
- Cue Wins
- Ask HN: Do you have something you continually work on for years?
-
Ask HN: How to find the right tech angel investor for new programming platform?
yup, I'm betting the proverbial ranch on CUE :]
I also maintain https://cuetorials.com
-
hof: The High Code Framework (low-code for devs), a flexible data modeling & code generation system
I also maintain https://cuetorials.com, bet the farm on CUE or something like that :]
-
What programming languages do you use as DevOps?
CUEtorials
What are some alternatives?
graylog - Free and open log management
cue - The home of the CUE language! Validate and define text-based and dynamic configuration
Fluentd - Fluentd: Unified Logging Layer (project under CNCF)
cue - CUE has moved to https://github.com/cue-lang/cue
agent - Vendor-neutral programmable observability pipelines.
hof - Framework that joins data models, schemas, code generation, and a task engine. Language and technology agnostic.
syslog-ng - syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
juicefs - JuiceFS is a distributed POSIX file system built on top of Redis and S3.
OpenSearch - 🔎 Open source distributed and RESTful search engine.
VuePress - 📝 Minimalistic Vue-powered static site generator
tracing - Application level tracing for Rust.
just-the-docs - A modern, high customizable, responsive Jekyll theme for documentation with built-in search.