Best job scheduler in 2022? (Airflow / Dagster / Prefect / Luigi / other)

This page summarizes the projects mentioned and recommended in the original post on /r/dataengineering

SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
surveyjs.io
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • metaflow

    :rocket: Build and manage real-life ML, AI, and data science projects with ease!

  • Can I give a plug for Metaflow. It's particularly well suited to data science and ML workflows, with great tooling that's basically just annotations on python functions that gives you: - DAG orchestration - parallelism - cloud integration - data flow through DAGs — very very useful imo for data science teams trying to migrate their existing scripts to (and write new ones on) Metaflow

  • Node RED

    Low-code programming for event-driven applications

  • A bit off the beaten path, but I've been toying with the idea of using Node Red as a job scheduler. There are timer plugins to launch flows at specified times, email plugins that can catch flow errors, automatic version control plugins, an exec command with support for stdout, stderr, error code (you could build a subflow to do the logging automatically). For reading logs you could maybe create a "dashboard" but I've never used that feature. It does support multiple users but I don't know if authentication is as granular as the job/flow level.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Natto.dev – A Canvas for JavaScript

    2 projects | news.ycombinator.com | 13 Apr 2021
  • metaflow VS cascade - a user suggested alternative

    2 projects | 5 Dec 2023
  • Needs advice for choosing tools for my team. We use AWS.

    2 projects | /r/mlops | 25 Mar 2023
  • [OC] Gender diversity in Tech companies

    3 projects | /r/dataisbeautiful | 16 Jan 2023
  • Model artifacts mess and how to deal with it?

    2 projects | /r/mlops | 19 Aug 2022