Data Analytics at Potloc I: Making data integrity your priority with Elementary & Meltano

1. Airflow

   1 187 40,060 10.0 Python

   Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

   

   Airflow

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. elementary-ext

   2 1 1 3.2 Python

   

   - name: elementary namespace: elementary pip_url: elementary-data[platform]==0.6.3 git+https://github.com/potloc/elementary-ext.git executable: elementary_invoker settings: - name: project_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/ - name: profiles_dir kind: string value: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ - name: file_path kind: string value: ${MELTANO_PROJECT_ROOT}/path/to/report.html - name: skip_pre_invoke env: ELEMENTARY_EXT_SKIP_PRE_INVOKE kind: boolean value: true description: Whether to skip pre-invoke hooks which automatically run dbt clean and deps - name: slack-token kind: password - name: slack-channel-name kind: string value: elementary-notifs config: profiles-dir: ${MELTANO_PROJECT_ROOT}/transform/profiles/platform/ file-path: ${MELTANO_PROJECT_ROOT}/path/to/report.html slack-channel-name: your_channel_name skip_pre_invoke: true commands: initialize: args: initialize executable: elementary_extension describe: args: describe executable: elementary_extension monitor-report: args: monitor-report executable: elementary_extension monitor-send-report: args: monitor-send-report executable: elementary_extension

4. terraform

   3 560 45,152 9.9 Go

   Terraform enables you to safely and predictably create, change, and improve infrastructure. It is a source-available tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

   

   AWS Fargate as our hosting infrastructure, managed through terraform

5. nodejs-bigquery

   4 43 485 7.9 TypeScript

   Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.

   

   Bigquery as our data warehouse

Suggest a related project