flow-pipeline VS goflow2

Many Thanks to Cloudflare and dev.to for giving us this opportunity.

Unlike other providers in this list, Cloudflare is not just a serverless database platform. Instead, it’s a cloud connectivity platform that provides several web services. It’s one of the world's largest networks and serves 55 million HTTP requests per second.

Using a Content Delivery Networks (CDNs) such as Cloudflare, can help absorb large amounts of traffic and mitigate the impact of DoS attacks.

When a user requests a webpage, the CDN delivers the content from the nearest server to the user. As a result, the loading times are faster since the data has to travel a shorter distance. CDNs offer endless benefits like reduced bandwidth usage, scalability, increased reliability, and more. Some well-known CDNs include Cloudflare, Amazon CloudFront, Akamai, and Fastly. They offer several features that help reduce web page sizes and make websites run better.

Cloudflare

Cloudflare offers low/no markup domain name registration with a free DNS service. This will virtually always be your cheapest option for domain name renewals. They don't list prices for all TLDs upfront, so use this list to get your best estimate.

Our site used Cloudflare to handle all our DNS needs. Cloudfare has a number of rewrite options but as we needed to make a decision based on a) the URL path and b) rewriting to a specific domain, the only option (as a non enterprise customer) was to use Cloudflare workers (via worker routes).

Add Cloudflare Cahce & Protection

Cloudflare is a cloud-provider, most-known for their CDN, offering several services to build cloud applications. Among them, Cloudflare Workers is a serverless service that allows you to run serverless functions at edge (like Lambda@Edge if you are an AWS user). This means that your code runs closer to end-users, resulting in blazing fast response times.

I use goflow2 to do something like this. I don't specifically use syslog itself for this, but mtail to generate the metrics.

I've been using this one: https://github.com/netsampler/goflow2

Take a look at goflow2 which is based on Cloudflare's flow analysis pipeline.

I'm not particularly familiar with netflow formats, but this collector emits Prometheus metrics.

GoFlow2 is a high-performance sFlow/IPFIX/NetFlow collector that gathers network information and serializes it in a common format. This fork of CloudFlare's GoFlow provides horizontal scalability, consistent format and the ability to work with raw samples and build aggregation and custom enrichment. Our thanks for this suggestion goes to SuperQue.

You want something like goflow2.

There's goflow2, which is a fork of CloudFlare's goflow netflow collector.

I'd suggest looking at goflow2 before you write something new.

I personally use goflow2, but my needs are pretty simple.