The Big Data Game – Because even a simple query can send you on an unexpected journey. Help the 8-bit data engineer to get the data

This page summarizes the projects mentioned and recommended in the original post on /r/programming

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • elasticsearch-mapper-attachments

    Discontinued Mapper Attachments Type plugin for Elasticsearch

  • Another data pipe, in the background Databricks, a data lake (A data lake is a storage repository that holds a vast amount of raw data in its native format until it is needed for analytics applications. While a traditional data warehouse stores data in hierarchical dimensions and tables, a data lake uses a flat architecture to store data, primarily in files or object storage.), and Elastic which is a search tool, you can't use google to search your internal files.

  • Puts Debuggerer

    Ruby library for improved puts debugging, automatically displaying bonus useful information such as source line number and source code.

  • I now have to find the data, in this case the Icons in order are: Microsoft Power BI, Shopify, not sure maybe Git?, Generic Cloud?, not sure again, this is Github, last two I'm unsure. In general its just a source of raw data, places, times, products, purchase information, time of events, state of objects, responses to surveys, etc... Anything can be a source of information. But these are common ones I suppose, although i don't know the logos of some. In the background you have dbt, which sort of allows you to manipulate and send source data information using SQL like queries to the data pipeline. FiveTran another kind of data pipeline. Firebolt they made this, but they are a data warehouse as far as I am aware.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • dbt-databricks

    A dbt adapter for Databricks.

  • Another data pipe, in the background Databricks, a data lake (A data lake is a storage repository that holds a vast amount of raw data in its native format until it is needed for analytics applications. While a traditional data warehouse stores data in hierarchical dimensions and tables, a data lake uses a flat architecture to store data, primarily in files or object storage.), and Elastic which is a search tool, you can't use google to search your internal files.

  • Snowplow

    The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP

  • Well if you have to structure and create Schema and manage Data Warehouses, you need a tool to do that, so in the background you see SnowPlow, which helps you do just that. Make the data into some kind of sensible structure so that later on business analysts can come see whats up. Want to do a quarterly report on how you performed, go to the application that goes to the data warehouse and builds your report for you. Want to compare to other similar companies in the portfolio to see how they are performing, same story. Data scientists will build and structure the data and store it and manipulate it and extract the value from it so that the analysts and sales people can then come in and do some selling. Show the customers what they got for their money and guarantee the renewal.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • 16 ways software testability can assist manual testing

    2 projects | dev.to | 21 Feb 2022
  • Understanding WebSocket and creating from Scratch with JavaScript

    2 projects | dev.to | 7 May 2024
  • A Beginner's Guide to Front-End Development

    1 project | dev.to | 4 May 2024
  • 5 Free Tools to Boost Developer Productivity

    1 project | dev.to | 3 May 2024
  • End-to-end MLOps CI/CD pipeline with Harness and AWS

    2 projects | dev.to | 1 May 2024