Top 8 data-ops Open-Source Projects

• Prefect

  19 14,829 10.0 Python

  The easiest way to build, run, and monitor data pipelines at scale.

  

Project mention: Prefect: A workflow orchestration tool for data pipelines | news.ycombinator.com | 2024-03-13

• Taipy

  16 8,847 9.9 Python

  Turns Data and AI algorithms into production-ready web applications in no time.

  

Project mention: Python Day 9: Building Interactive Web Apps without HTML/CSS and JavaScript | dev.to | 2024-04-26

Taipy is an open-source Python library that enables data scientists and developers to build robust end-to-end data pipelines.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• cleanlab

  69 8,819 9.4 Python

  The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

  

Project mention: [Research] Detecting Annotation Errors in Semantic Segmentation Data | /r/MachineLearning | 2023-11-05

We have feely open-sourced our new method for improving segmentation data, published a paper on the research behind it, and released a 5-min code tutorial. You can also read more in the blog if you'd like.

• Benthos

  77 7,686 9.7 Go

  Fancy stream processing made operationally mundane

  

Project mention: Benthos – Fancy stream processing made operationally mundane | news.ycombinator.com | 2024-05-15

• marquez

  1 1,636 9.2 Java

  Collect, aggregate, and visualize a data ecosystem's metadata

  

• ActiveWorkflow

  1 792 4.2 Ruby

  Polyglot workflows without leaving the comfort of your technology stack.

  

• dqo

  2 57 10.0 Java

  Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.

Project mention: Launching end-to-end data quality platform | news.ycombinator.com | 2024-03-27

DQOps is an open-source data quality platform (GitHub: https://github.com/dqops/dqo) that supports all stages of building or operating a data platform.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• grant-rs

  1 24 1.2 Rust

  Manage Redshift/Postgres privileges in GitOps style written in Rust

data-ops related posts

• Python Day 9: Building Interactive Web Apps without HTML/CSS and JavaScript

  1 project | dev.to | 26 Apr 2024

• Launching end-to-end data quality platform

  1 project | news.ycombinator.com | 27 Mar 2024

• +10 Resources to Empower Women in Technology

  1 project | dev.to | 6 Mar 2024

• Show HN: Building data and AI apps, an alternative to Streamlit

  1 project | news.ycombinator.com | 12 Feb 2024

• Our open-source project for building AI / Data full-stack apps got funded! 🎉 🎉

  1 project | dev.to | 15 Jan 2024

• Plotting 1,000,000 points on a webpage using only Python

  1 project | /r/bigdata | 11 Dec 2023

• Taipy for Data and AI algos web apps building

  1 project | news.ycombinator.com | 21 Nov 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 22 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com