Introducing Flyte (v1.1.0): Orchestrate Your Machine Learning and Data Pipelines with Ease (2.5K Stars on GitHub, Kubernetes-Native)

This page summarizes the projects mentioned and recommended in the original post on /r/selfhosted
flyte Machine Learning Golang Scale Workflow

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • flyte

    Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

    • GitHub: https://github.com/flyteorg/flyte

  • airflow-provider-flyte

    Flyte Airflow Provider

    • We have integrated Flyte with tools such as Spark, BigQuery, MPI, Sagemaker, Great Expectations, Pandera, etc. I’ve recently worked on building an Airflow provider for Flyte that enables triggering Flyte workflows from within Airflow; this is helpful if you want to build ETL pipelines in Airflow and machine learning pipelines in Flyte and use the two of them together.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Flyte 1.10: Self-hosted solution to build production-grade data and ML pipelines; now ships with monorepo, new agents and sensors, eager workflows and more 🚀 (4.1k stars on GitHub)

    1 project | /r/selfhosted | 1 Nov 2023

  • Flyte: Open-source orchestrator for building production-grade ML pipelines

    1 project | news.ycombinator.com | 5 Jul 2023

  • Flyte: Advanced workflow orchestration alternative to Apache Airflow

    1 project | news.ycombinator.com | 6 Jun 2023

  • Flyte 1.6.0: Self-hosted solution to build production-grade data and ML pipelines; now ships with PyTorch elastic training, image specification without dockerfile, enhanced task execution insights and more 🚀 (3.4k stars on GitHub)

    1 project | /r/selfhosted | 24 May 2023

  • Flyte: Open-Source Kubernetes-Native ML Orchestrator Implemented in Go

    1 project | news.ycombinator.com | 10 Apr 2023