fluent-bit VS Flux

Compare fluent-bit vs Flux and see what are their differences.

Flux

Successor: https://github.com/fluxcd/flux2 (by fluxcd)
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
fluent-bit Flux
35 12
5,266 6,956
2.8% -
9.8 7.6
6 days ago over 1 year ago
C Go
Apache License 2.0 Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

fluent-bit

Posts with mentions or reviews of fluent-bit. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-03-26.
  • Observability at KubeCon + CloudNativeCon Europe 2024 in Paris
    7 projects | dev.to | 26 Mar 2024
    Fluentbit
  • Fluent Bit with ECS: Configuration Tips and Tricks
    4 projects | dev.to | 26 Dec 2023
    $ docker run --rm fluent-bit-dummy WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested Fluent Bit v1.9.10 * Copyright (C) 2015-2022 The Fluent Bit Authors * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd * https://fluentbit.io [2023/12/24 16:06:59] [ info] [fluent bit] version=1.9.10, commit=557c8336e7, pid=1 [2023/12/24 16:06:59] [ info] [storage] version=1.4.0, type=memory-only, sync=normal, checksum=disabled, max_chunks_up=128 [2023/12/24 16:06:59] [ info] [cmetrics] version=0.3.7 [2023/12/24 16:06:59] [ info] [output:stdout:stdout.0] worker #0 started [2023/12/24 16:06:59] [ info] [sp] stream processor started [0] dummy.0: [1703434019.553880465, {"message"=>"custom dummy"}] [0] dummy.0: [1703434020.555768799, {"message"=>"custom dummy"}] [0] dummy.0: [1703434021.550525174, {"message"=>"custom dummy"}] [0] dummy.0: [1703434022.551563050, {"message"=>"custom dummy"}] [0] dummy.0: [1703434023.551944509, {"message"=>"custom dummy"}] [0] dummy.0: [1703434024.550027843, {"message"=>"custom dummy"}] [0] dummy.0: [1703434025.550901801, {"message"=>"custom dummy"}] [0] dummy.0: [1703434026.549279385, {"message"=>"custom dummy"}] ^C[2023/12/24 16:07:08] [engine] caught signal (SIGINT) [0] dummy.0: [1703434027.549678344, {"message"=>"custom dummy"}] [2023/12/24 16:07:08] [ warn] [engine] service will shutdown in max 5 seconds [2023/12/24 16:07:08] [ info] [engine] service has stopped (0 pending tasks) [2023/12/24 16:07:08] [ info] [output:stdout:stdout.0] thread worker #0 stopping... [2023/12/24 16:07:08] [ info] [output:stdout:stdout.0] thread worker #0 stopped
    4 projects | dev.to | 26 Dec 2023
    We can write our own parsers and load them, or we can rely on the ones provided by Fluent Bit itself. It comes with its own pre-configured parser.conf file (https://github.com/fluent/fluent-bit/blob/master/conf/parsers.conf). These parsers support most of the popular log formats, such as Docker, nginx, or syslog.
  • Should You Be Scared of Unix Signals?
    8 projects | news.ycombinator.com | 16 Oct 2023
    > Libc is a lot more tricky about signals, since not all libc functions can be safely called from handlers.

    And this is a huge thing. People do all kinds of operations in signal handlers completely oblivious to the pitfalls. Pitfalls which often do not manifest, making it a great "it works for me" territory.

    I once raised a ticket on fluentbit[1] about it but they have abused signal handlers so thoroughly that I do not think they can mitigate the issue without a major rewriting of the signal and crash handling.

    [1] https://github.com/fluent/fluent-bit/issues/4836

  • Vector: a Rust-based lightweight alternative to Fluentd/Logstash
    2 projects | news.ycombinator.com | 26 Sep 2023
    Fluentbit is Fluentd's lightweight alternative to itself.

    https://fluentbit.io

  • FLaNK Stack Weekly for 14 Aug 2023
    32 projects | dev.to | 14 Aug 2023
  • Ultimate EKS Baseline Cluster: Part 1 - Provision EKS
    17 projects | dev.to | 21 Jul 2023
    From here, we can explore other developments and tutorials on Kubernetes, such as o11y or observability (PLG, ELK, ELF, TICK, Jaeger, Pyroscope), service mesh (Linkerd, Istio, NSM, Consul Connect, Cillium), and progressive delivery (ArgoCD, FluxCD, Spinnaker).
  • Parsing multiline logs using a custom Fluent Bit configuration
    5 projects | dev.to | 25 May 2023
    apiVersion: v1 kind: ConfigMap metadata: name: fluent-bit-config namespace: newrelic labels: k8s-app: newrelic-logging data: # Configuration files: server, input, filters and output # ====================================================== fluent-bit.conf: | [SERVICE] Flush 1 Log_Level ${LOG_LEVEL} Daemon off Parsers_File parsers.conf HTTP_Server On HTTP_Listen 0.0.0.0 HTTP_Port 2020 @INCLUDE input-kubernetes.conf @INCLUDE output-newrelic.conf @INCLUDE filter-kubernetes.conf input-kubernetes.conf: | [INPUT] Name tail Tag kube.* Path ${PATH} Parser ${LOG_PARSER} DB /var/log/flb_kube.db Mem_Buf_Limit 7MB Skip_Long_Lines On Refresh_Interval 10 filter-kubernetes.conf: | [FILTER] Name multiline Match * multiline.parser multiline-regex [FILTER] Name record_modifier Match * Record cluster_name ${CLUSTER_NAME} [FILTER] Name kubernetes Match kube.* Kube_URL https://kubernetes.default.svc.cluster.local:443 Merge_Log Off output-newrelic.conf: | [OUTPUT] Name newrelic Match * licenseKey ${LICENSE_KEY} endpoint ${ENDPOINT} parsers.conf: | # Relevant parsers retrieved from: https://github.com/fluent/fluent-bit/blob/master/conf/parsers.conf [PARSER] Name docker Format json Time_Key time Time_Format %Y-%m-%dT%H:%M:%S.%L Time_Keep On [PARSER] Name cri Format regex Regex ^(?[^ ]+) (?stdout|stderr) (?[^ ]*) (?.*)$ Time_Key time Time_Format %Y-%m-%dT%H:%M:%S.%L%z [MULTILINE_PARSER] name multiline-regex key_content message type regex flush_timeout 1000 # # Regex rules for multiline parsing # --------------------------------- # # configuration hints: # # - first state always has the name: start_state # - every field in the rule must be inside double quotes # # rules | state name | regex pattern | next state # ------|---------------|--------------------------------|----------- rule "start_state" "/(Dec \d+ \d+\:\d+\:\d+)(.*)/" "cont" rule "cont" "/^\s+at.*/" "cont"
  • Tool to scrape (semi)-structured log files (e.g. log4j)
    3 projects | /r/PrometheusMonitoring | 25 Apr 2023
    There are also log forwarding tools like promtail and fluentbit that can be used to both ship logs to something like Loki and produce metrics.
  • How to Deploy and Scale Strapi on a Kubernetes Cluster 2/2
    18 projects | dev.to | 3 Feb 2023
    FluentBit, is a logging processor that can help you to push all of your application logs to a central location like an ElasticSearch or OpenSearch cluster.

Flux

Posts with mentions or reviews of Flux. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-02-05.
  • Weaveworks Is Shuting Down
    5 projects | news.ycombinator.com | 5 Feb 2024
    Right. Flux was a handy little tool[1] that sync'd yaml manifests in git repos to live clusters. The concept was fascinating, and the tool was well done--small and efficient. Easy to learn.

    In 2019, they announced they'd be "merging" with argocd[2]. It seems the merge never really took place, and after that they deprecated flux and announced flux2[3].

    The sudden changes of course were a little confusing and perhaps not too well communicated.

    1: https://github.com/fluxcd/flux

  • Interesting tools?
    30 projects | /r/kubernetes | 23 May 2022
    CI/CD: Tekton Flux
  • What You Should Know Before Setting Up Your First CI/CD Pipeline
    7 projects | dev.to | 18 May 2022
    Use ArgoCD or Flux for Kubernetes, and Serverless Stack for your serverless Lambda applications.
  • Top 200 Kubernetes Tools for DevOps Engineer Like You
    84 projects | dev.to | 15 Jan 2022
    HybridK8s Droid - Intelligence foor your favourite Delivery Platform Devtron - Software Delivery Workflow for Kubernetes Skaffold - Easy and Repeatable Kubernetes Development Apollo - Apollo - The logz.io continuous deployment solution over kubernetes Helm Cabin - Web UI that visualizes Helm releases in a Kubernetes cluster flagger - Progressive delivery Kubernetes operator (Canary, A/B Testing and Blue/Green deployments) Kubeform - Kubernetes CRDs for Terraform providers https://kubeform.com Spinnaker - Spinnaker is an open source, multi-cloud continuous delivery platform for releasing software changes with high velocity and confidence. http://www.spinnaker.io/ werf - GitOps tool to deliver apps to Kubernetes and integrate this process with GitLab and other CI tools Flux - GitOps Kubernetes operator Argo CD - Declarative continuous deployment for Kubernetes Tekton - A cloud native continuous integration and delivery (CI/CD) solution Jenkins X - Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Tekton, Knative, Lighthouse, Skaffold and Helm KubeVela - KubeVela works as an application delivery control plane that is fully decoupled from runtime infrastructure ksonnet - A CLI-supported framework that streamlines writing and deployment of Kubernetes configurations to multiple clusters CircleCI - A cloud-based tool that helps build continuous integration and continuous delivery pipelines to Kubernetes.
  • Automation assistants: GitOps tools in comparison
    28 projects | dev.to | 12 Aug 2021
    The blog post by Weaveworks, which coined the term GitOps in 2017, also names the first GitOps operator: Flux. In the meantime, this has been completely rewritten as Flux v2. In addition to Flux and Flux v2, the associated project "Flux" develops other components. Weaveworks has now handed the project over to the Cloud Native Computing Foundation (CNCF). By now, the project is in the second maturity level: incubator phase.
  • Open source Heroku Like Platform on premises
    4 projects | news.ycombinator.com | 25 Mar 2021
    Looks really neat. We have a not-super-trivial rails app that I want to move to docker one day, but kinda scared to make the jump. We're already using docker for development, plus even have a home-grown docker-compose setup for ephemeral labs, but it's clunky at best.

    This seems like something that might provide a simple jumping board hopefully... Also bumped into fluxCD[0] recently which also looks interesting.

    [0] https://github.com/fluxcd/flux

  • Kubernetes State Checker
    3 projects | news.ycombinator.com | 10 Mar 2021
    > It doesn't make all the other yaml files happen. It doesn't make the yaml files you no longer want happening, stop happening. It doesn't even tell you "these things were created by 'old' yaml files" and should be garbage collected (since it doesn't seem to have a sense of old yaml files).

    This is definitely one piece of Kubernetes that is getting a lot of attention recently. The three tools I've been paying attention to are Argo CD[0], Flux[1], and Config Sync[2].

    All of these allow you to point your repository to a cluster and sync resources from the repo to the cluster, including deletes.

    [0] https://argoproj.github.io/argo-cd/

    [1] https://github.com/fluxcd/flux

    [2] https://cloud.google.com/kubernetes-engine/docs/add-on/confi...

    Disclaimer: I work at GCP, but not on the GKE team. Opinions are my own.

  • Best ways to self-host containers on a personal server
    4 projects | /r/docker | 15 Feb 2021
    Otherwise, Kubernetes would be my suggestion. It doesn't have to be that complicated. I can recommend Flux (https://github.com/fluxcd/flux) for managing deployments. It makes everything a lot easier.
  • The pains of GitOps 1.0
    3 projects | dev.to | 18 Nov 2020
    In all cases, the promotion process is very cumbersome and current GitOps tools do not have an easy answer on what is the correct approach.

What are some alternatives?

When comparing fluent-bit and Flux you can also consider the following projects:

loki - Like Prometheus, but for logs.

fleet - Deploy workloads from Git to large fleets of Kubernetes clusters

argo-cd - Declarative Continuous Deployment for Kubernetes

rsyslog - a Rocket-fast SYStem for LOG processing

syslog-ng - syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.

jaeger - CNCF Jaeger, a Distributed Tracing Platform

keel - Kubernetes Operator to automate Helm, DaemonSet, StatefulSet & Deployment updates

vault-secrets-operator - Create Kubernetes secrets from Vault for a secure GitOps based workflow.

kubernetes-external-secrets - Integrate external secret management systems with Kubernetes

winston - A logger for just about everything.

argo-rollouts - Progressive Delivery for Kubernetes

Bazel - a fast, scalable, multi-language and extensible build system