Data Analytics at Potloc I: Making data integrity your priority with Elementary & Meltano

This page summarizes the projects mentioned and recommended in the original post on dev.to

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • Airflow

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  • Airflow

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • elementary-ext

  • - name: elementary namespace: elementary pip_url: elementary-data[platform]==0.6.3 git+https://github.com/potloc/elementary-ext.git executable: elementary_invoker settings: - name: project_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/ - name: profiles_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ - name: file_path kind: string value: ${MELTANO_PROJECT_ROOT}/path/to/report.html - name: skip_pre_invoke env: ELEMENTARY_EXT_SKIP_PRE_INVOKE kind: boolean value: true description: Whether to skip pre-invoke hooks which automatically run dbt clean and deps - name: slack-token kind: password - name: slack-channel-name kind: string value: elementary-notifs config: profiles-dir: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ file-path: ${MELTANO_PROJECT_ROOT}/path/to/report.html slack-channel-name: your_channel_name skip_pre_invoke: true commands: initialize: args: initialize executable: elementary_extension describe: args: describe executable: elementary_extension monitor-report: args: monitor-report executable: elementary_extension monitor-send-report: args: monitor-send-report executable: elementary_extension

  • terraform

    Terraform enables you to safely and predictably create, change, and improve infrastructure. It is a source-available tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

  • AWS Fargate as our hosting infrastructure, managed through terraform

  • nodejs-bigquery

    Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.

  • Bigquery as our data warehouse

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • How to deploy a Django app to Google Cloud Run using Terraform

    5 projects | dev.to | 1 Jan 2024
  • Evolutionary Data Infrastructure

    5 projects | dev.to | 26 Sep 2022
  • Deploying Django Application on AWS with Terraform. Minimal Working Setup

    3 projects | dev.to | 26 Jul 2022
  • AWS Summit London 2022 day recap

    6 projects | dev.to | 29 Apr 2022
  • Completed my first Data Engineering project with Kafka, Spark, GCP, Airflow, dbt, Terraform, Docker and more!

    13 projects | /r/dataengineering | 2 Apr 2022