libpcap VS Zabbix

As long as your custom service used the rpcap protocol I'd expect it to be possible. You may find this GitHub page informative, since it includes some rpcap source code and one of the main Wireshark developers appears to be a contributor there.

mitmproxy can be used to find the HTTP request with the needed data in addition browser dev tools. At some point, I'll explore tcpdump and wireshark to reverse engineer websites for web scraping and share the learnings with you.

(Of course, this consideration should be appropriately downweighted by YAGNI, as threading memory management through prototype or internal utility code can by itself easily force it into very non-prototype amounts of effort.)

[1] https://github.com/the-tcpdump-group/libpcap/blob/2180b6e56a...

I am working with libpcap, a library that parses packets captured from tcpdump, which I have cIncluded from Zig.

Nmap and Wireshark, tcpdump tools can be used to scan networks and packets.

Also definitely start looking at tcpdump and wireshark. These are invaluable tools for the non-network engineer that is perhaps a sysadmin or analyst to use for network troubleshooting.

For future reference, libpcap is a library that Wireshark and many other network analysis tools use to record network traffic. It has its own file format that it can use to save the recorded network traffic to disk.

A lot is covered here and here, sar might be useful, getfacl and tcpdump and probably hundred more tools I am not even aware of. The easiest to learn those is to have a problem and identify and solve it with those tools, but to do that you need to know roughly what those tools can do.

For example, gopacket uses libpcap by default for capturing the traffic. Libpcap doesn't support network namespaces and we can't ask it to listen to traffic on a different namespace. However, we can change the network namespace of the calling thread and then start libpcap to see the traffic on a different namespace.

Zabbix

Zabbix is a comprehensive open-source monitoring solution designed for real-time monitoring and management of various network components, such as servers, networks, and applications. It excels in data collection and processing, enabling proactive monitoring for early issue detection and resolution.

The PHP core package is offered as pre-compiled binary via Ports packages system. In addition, important softwares such as extensions, Composer and PECL libraries are available. So are frameworks such as NextCloud and Zabbix.

Prometheus is a great way to go, however you need to invest time in writing all the alerts. This was a daunting task for us, because we have too many vendors and device types.. we instead went with zabbix, which is a free open source platform similar to Orion. Quite easy to setup. All the device templates for monitoring alerting are provided by the community. There is a grafana plugin which integrates with Zabbix, so you can build beautiful dashboards in grafana while using the polling and alerting logic in zabbix. You can also use grafana OnCall via a zabbix integration. Phase1: You could move to zabbix. Realize cost savings without investing time. Phase2: learn and work on moving things to Prometheus slowly. edit: added links and some rewording

Setup Zabbix (https://www.zabbix.com/) and use SNMP (search for a template for your switches, chances are someone has created one) to pull throughput data from the switchport your proxies are connected to. This will graph them for you on a continual basis, you can then setup some triggers (alerts) that will flag over-utilization (say >80Mbps) for you, can generate an email or SMS alert based on that or just see it in the dashboard.

Look at setting up Zabbix (https://www.zabbix.com/) you can then do ping and latency tests to key hosts/endpoints and get packet loss and other variables in a graphical format. Also will allow you to setup monitoring to alert when there are known issues.

Check out Zabbix. Similar to something like PRTG (I see was already mentioned) but it is a free solution. Only cost is setup time and infrastructure.

now if its more metric data you are using and want to do APM, prometheus is your man https://prometheus.io/, want to make prometheus your full time job? deploy cortex https://cortexmetrics.io/, honorable mention in the metrics space, Zabbix, https://www.zabbix.com/ I've seen use cases of zabbix going way beyond its intended use its a fantastic tool

- NMS / NPM: NetXMS, Zabbix, LibreNMS, PRTG - NCM, updates, automation: Unimus - IaC / automation: Ansible - DCIM / IPAM: NetBox - IPAM / DDI: Infoblox