grai-core
dbt-snowflake-monitoring
Our great sponsors
| grai-core | dbt-snowflake-monitoring | |
|---|---|---|
| 6 | 1 | |
| 269 | 190 | |
| 2.2% | 3.7% | |
| 9.5 | 8.1 | |
| 4 days ago | 25 days ago | |
| Python | PLpgSQL | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
grai-core
-
Launch HN: Grai (YC S22) – Open-Source Data Observability Platform
Elastic v2 if one is interested in such things: https://github.com/grai-io/grai-core/blob/v0.1.33/LICENSE
-
Standalone lineage tool
I’m not sure if this is precisely what you’re looking for but Grai might serve your needs. The backend data model allows you to push any arbitrary metadata you want / need onto the lineage graph and retrieve it either through the rest or graph API. I’m one of the authors so happy to answer any questions you might have.
-
Data Load Diagram
We've been looking at building something like this for Grai specifically to support Airflow but haven't yet prioritized it.
-
Grai, a self-hosted data lineage tool. Test downstream impact of data migration changes
We were frustrated because although we had tests in our data warehouse, they only notified us after an outage occurred. What we needed was a way to detect changes during CI/CD, so we could fix things before they impacted production. So we developed Grai, as an open-source data lineage toolkit pre-built integrations for the most common data stores and designed to work with CI tools, like Github Actions.
dbt-snowflake-monitoring
What are some alternatives?
awesome-data-catalogs - 📙 Awesome Data Catalogs and Observability Platforms.
soda-core - :zap: Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io
jupysql - Better SQL in Jupyter. 📊
dbt-ml-preprocessing - A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.
MindsDB - The platform for customizing AI from enterprise data
data-diff - Compare tables within or across databases
django-pgschemas - Django multi-tenancy through Postgres schemas
automate-dv - A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
sqlparse - A non-validating SQL parser module for Python
Snowflake_tutorial - This repo contains all my snowflake practice queries
ibis - the portable Python dataframe library
elementary - The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.