Data Analytics at Potloc I: Making data integrity your priority with Elementary & Meltano

This page summarizes the projects mentioned and recommended in the original post on dev.to

InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    Airflow

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. elementary-ext

    - name: elementary namespace: elementary pip_url: elementary-data[platform]==0.6.3 git+https://github.com/potloc/elementary-ext.git executable: elementary_invoker settings: - name: project_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/ - name: profiles_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ - name: file_path kind: string value: ${MELTANO_PROJECT_ROOT}/path/to/report.html - name: skip_pre_invoke env: ELEMENTARY_EXT_SKIP_PRE_INVOKE kind: boolean value: true description: Whether to skip pre-invoke hooks which automatically run dbt clean and deps - name: slack-token kind: password - name: slack-channel-name kind: string value: elementary-notifs config: profiles-dir: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ file-path: ${MELTANO_PROJECT_ROOT}/path/to/report.html slack-channel-name: your_channel_name skip_pre_invoke: true commands: initialize: args: initialize executable: elementary_extension describe: args: describe executable: elementary_extension monitor-report: args: monitor-report executable: elementary_extension monitor-send-report: args: monitor-send-report executable: elementary_extension

  4. terraform

    Terraform enables you to safely and predictably create, change, and improve infrastructure. It is a source-available tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

    AWS Fargate as our hosting infrastructure, managed through terraform

  5. nodejs-bigquery

    Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.

    Bigquery as our data warehouse

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • How to deploy a Django app to Google Cloud Run using Terraform

    5 projects | dev.to | 1 Jan 2024
  • Evolutionary Data Infrastructure

    5 projects | dev.to | 26 Sep 2022
  • Deploying Django Application on AWS with Terraform. Minimal Working Setup

    3 projects | dev.to | 26 Jul 2022
  • AWS Summit London 2022 day recap

    6 projects | dev.to | 29 Apr 2022
  • Completed my first Data Engineering project with Kafka, Spark, GCP, Airflow, dbt, Terraform, Docker and more!

    13 projects | /r/dataengineering | 2 Apr 2022

Did you know that Python is
the 2nd most popular programming language
based on number of references?