Data Analytics at Potloc I: Making data integrity your priority with Elementary & Meltano

• Airflow

  169 34,627 10.0 Python

  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  

Airflow

• elementary-ext

  1 1 3.2 Python
  

- name: elementary namespace: elementary pip_url: elementary-data[platform]==0.6.3 git+https://github.com/potloc/elementary-ext.git executable: elementary_invoker settings: - name: project_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/ - name: profiles_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ - name: file_path kind: string value: ${MELTANO_PROJECT_ROOT}/path/to/report.html - name: skip_pre_invoke env: ELEMENTARY_EXT_SKIP_PRE_INVOKE kind: boolean value: true description: Whether to skip pre-invoke hooks which automatically run dbt clean and deps - name: slack-token kind: password - name: slack-channel-name kind: string value: elementary-notifs config: profiles-dir: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ file-path: ${MELTANO_PROJECT_ROOT}/path/to/report.html slack-channel-name: your_channel_name skip_pre_invoke: true commands: initialize: args: initialize executable: elementary_extension describe: args: describe executable: elementary_extension monitor-report: args: monitor-report executable: elementary_extension monitor-send-report: args: monitor-send-report executable: elementary_extension

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• terraform

  501 41,235 9.9 Go

  Terraform enables you to safely and predictably create, change, and improve infrastructure. It is a source-available tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

  

AWS Fargate as our hosting infrastructure, managed through terraform

• nodejs-bigquery

  43 457 8.0 TypeScript

  Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.

  

Bigquery as our data warehouse

Suggest a related project