Simple Apache Log Parser

This page summarizes the projects mentioned and recommended in the original post on /r/linuxadmin

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • Telegraf

    The plugin-driven server agent for collecting & reporting metrics.

  • Telegraf agent scraping your Apache logs with the tail input plugin (parsing each entry into desired metrics at the same time), and saving them to a flat file in CSV format with the file output plugin. Then you could have a script parse the CSV file and upload it to MySQL at your desired cadence. Or, you could even have telegraf execute the script for you at your desired batch interval, with the exec output plugin.

  • jello

    CLI tool to filter JSON and JSON Lines data with Python syntax. (Similar to jq)

  • Yep, you can create a filter in jq to do that. Alternatively, if you prefer Python syntax you could try jello, which works like jq but is really Python under the hood. (I am also the author of jello)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts