core
vector
Our great sponsors
core | vector | |
---|---|---|
239 | 95 | |
2,911 | 16,187 | |
4.5% | 5.1% | |
9.9 | 9.9 | |
4 days ago | 6 days ago | |
PHP | Rust | |
BSD 2-clause "Simplified" License | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
core
-
OpenBSD Innovations
BSDs may not have a significant presence on desktops, but they're well known in the networking world for their reliability. They also were the foundation used to build OSes for specific applications. OpnSense and XigmaNAS, for example, are two excellent FreeBSD based applications aimed at firewalling/security and NAS/services.
- OPNsense a true open-source security platform and more
-
Switches That You Actually Own
For switches? OpenWrt supports a few models toward the lower end, and SONiC support a bunch at the higher-end datacenter ToR market, but none of these options are SME production-ready like Linux servers or OPNsense firewalls.
-
Router for a 1.5Gbps connection
One option is Firewalla Gold Plus, or you could buy a mini PC like it and run pfSense/OPNsense yourself.
-
Looking for Recommendations
Another option is Firewalla, or buy a mini PC like it and run pfSense/OPNsense yourself. Two similar concepts, with the cost being either money or your DIY time. A lot of Firewalla users say that it's much easier for home use than pfSense/OPNsense, so you might find it worthwhile to spend a little more on it upfront and have to tinker less.
-
VPN for network filtering
If you want firewall, I think you can use https://www.pfsense.org/ or https://opnsense.org/ , maybe running on an old PC or a Raspberry Pi. Not sure.
-
Looking for Guidance and Advice
I've recently started using OPNsense. It's similar to pfSense, but seems to be considered a little more user-friendly.
-
Bi-Weekly /r/Technology Tech Support / General Discussion Thread. Have you a tech question or want to discuss tech?
For most router issues, I recommend people always put them in to dumb bridge mode and put a proper firewall like pfsense or opnsense as your gateway.
-
Learn from my newbie mistakes
First of all; understand what it is the software you want to use actually does. I know that Proxmox is a Hypervisor and can run multiple VMs (Virtual Machines) and LXCs (Linux Containers) which is great, but there are a lot of options for setting up these things. For example, I really liked the idea of having my router be a VM that ran OpnSense so that I can run multiple router-specific things on the same machine like PiHole and Wireguard. This means I can get away with using fewer individual boxes (physical computers or servers), I have flexibility if I want to run *other* types of VMs that act as services for my router and I can very easily allocate expand, reallocate and change the underlying hardware for each machine. Lots of tweaking.
-
Angry Google employees are mocking CEO Sundar Pichai's pay hike with memes, including one of a 'Shrek' villain, report says
OPNsense
vector
- FLaNK AI Weekly 18 March 2024
-
Vector: A high-performance observability data pipeline
Datadog bought Timber Technologies (creators of Vector) two years ago. https://www.datadoghq.com/blog/datadog-acquires-timber-techn...
Timber definitely intended to just rock out & demolish everything else out there with their agent/forwarder/aggregator tech. But it wasn't a competitive play against OTel, in my humble opinion. Timber's whole shtick is that it integrates with everything, with really flexible/good glue logic in-between. A competent multi-system (logging, metrics, eventually traces) fluentd++. OTel - I want to believe - would have been part of that original vision.
It's just taking a really really long time. One can speculate how direction & velocity might have changed since the Datadog acquisition. The lack of tracing (anywhere except Datadog, so far) materializing has been a hard hard hard & sad thing to see. OG https://github.com/vectordotdev/vector/issues/1444 and newer https://github.com/vectordotdev/vector/issues/17307
Vector is fantastic software. Currently running a multi-GB/s log pipeline with it. Vector agents as DaemonSets collecting pod and journald logs then forwarding w/ vector's protobuf protocol to a central vector aggregator Deployment with various sinks - s3, gcs/bigquery, loki, prom.
The documentation is great but it can be hard to find examples of common patterns, although it's getting better with time and a growing audience.
My pro-tip has been to prefix your searches with "vector dev A recent contribution added an alternative to prometheus pushgateway that handles counters better: https://github.com/vectordotdev/vector/issues/10304#issuecom...
-
About reading logs
We don't pull logs, we forward logs to a centralized logging service.
-
Self hosted log paraer
opensearch - amazon fork of Elasticsearch https://opensearch.org/docs/latestif you do this an have distributed log sources you'd use logstash for, bin off logstash and use vector (https://vector.dev/) its better out of the box for SaaS stuff.
-
Show HN: Homelab Monitoring Setup with Grafana
I think there's nothing currently that combines both logging and metrics into one easy package and visualizes it, but it's also something I would love to have.
Vector[1] would work as the agent, being able to collect both logs and metrics. But the issue would then be storing it. I'm assuming the Elastic Stack might now be able to do both, but it's just to heavy to deal with in a small setup.
A couple of months ago I took a brief look at that when setting up logging for my own homelab (https://pv.wtf/posts/logging-and-the-homelab). Mostly looking at the memory usage to fit it on my synology. Quickwit[2] and Log-Store[3] both come with built in web interfaces that reduce the need for grafana, but neither of them do metrics.
- [1] https://vector.dev
-
Lightweight logging on RPi?
I would recommend that you run vector as a systems service so you don't have to worry about managing it. Here is a basic config to do that - https://github.com/vectordotdev/vector/blob/master/distribution/systemd/vector.service .
-
Monitoring traefik access logs easily
You could have a look at Grafana Loki, it's easy to run (single binary for a small setup). Shipping your logs can be done by Promtail or something like Vector. They're both lightweight log shippers with support for Loki.
- Ask HN: How to build an image search service?
What are some alternatives?
graylog - Free and open log management
Fluentd - Fluentd: Unified Logging Layer (project under CNCF)
agent - Vendor-neutral programmable observability pipelines.
syslog-ng - syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.
OpenSearch - 🔎 Open source distributed and RESTful search engine.
docker-pihole-unbound - Run Pi-Hole + Unbound on Docker
tracing - Application level tracing for Rust.
openwrt - Linux distribution for embedded devices
qryn - qryn is a polyglot, high-performance observability framework for ClickHouse. Ingest, store and analyze logs, metrics and telemetry traces from any agent supporting Loki, Prometheus, OTLP, Tempo, Elastic, InfluxDB and many more formats and query transparently using Grafana or any other compatible client.
thanos - Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.
openNDS - openNDS (open Network Demarcation Service) is a high performance, small footprint, Captive Portal. It provides a border control gateway between a public local area network and the Internet.
UTMFW - UTM Firewall on OpenBSD