Top 9 data-lineage Open-Source Projects

elementary

30 1,740 9.8 HTML

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
marquez

1 1,618 9.2 Java

Collect, aggregate, and visualize a data ecosystem's metadata
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
sqllineage

3 1,135 8.6 Python

SQL Lineage Analysis Tool powered by Python

Project mention: FLaNK Stack Weekly for 12 September 2023 | dev.to | 2023-09-12

odd-platform

33 1,115 8.7 Java

First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

Project mention: OpenDataDiscovery 0.15 with Data Deprecation and Metadata Stale | news.ycombinator.com | 2023-08-04

versatile-data-kit

52 410 9.7 Python

One framework to develop, deploy and operate data workflows with Python and SQL.

Project mention: Looking for a data blogger | /r/opensource | 2023-05-19

Here's the project: https://github.com/vmware/versatile-data-kit

dbt-data-reliability

2 343 9.7 Python

dbt package that is part of Elementary, the dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
data-lineage

1 296 2.0 Python

Generate and Visualize Data Lineage from query history
SaaSHub

www.saashub.com featured

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
grai-core

6 270 9.5 Python

Project mention: Launch HN: Grai (YC S22) – Open-Source Data Observability Platform | news.ycombinator.com | 2023-07-17

Elastic v2 if one is interested in such things: https://github.com/grai-io/grai-core/blob/v0.1.33/LICENSE

waltz

1 164 9.8 Java

Enterprise Information Service

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

data-lineage related posts

Looking for a data blogger

1 project | /r/opensource | 19 May 2023
Need advice on ETL tool

1 project | /r/dataengineering | 29 Mar 2023
Open source data observability tools with UI?

4 projects | /r/dataengineering | 18 Mar 2023
If dbt is the "T" part of an "ELT", what do you use for "EL"?

1 project | /r/dataengineering | 2 Mar 2023
Best way to fix errors in my data?

1 project | /r/dataengineering | 1 Feb 2023
What Orchestration Tool do you use for batch ETL/ELT?

1 project | /r/dataengineering | 31 Jan 2023
Dear, pipeline builders! Which step in your role is the most time consuming?

1 project | /r/dataengineering | 16 Jan 2023
A note from our sponsor - InfluxDB
www.influxdata.com | 5 May 2024

Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →