Nextflow Alternatives

Similar projects and alternatives to nextflow

  1. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  2. ploomber

    121 nextflow VS ploomber

    The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

  3. Kedro

    35 nextflow VS Kedro

    Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

  4. node_crunch

    Discontinued Allows to distribute computations across several nodes

  5. huey

    14 nextflow VS huey

    a little task queue for python

  6. redun

    4 nextflow VS redun

    Yet another redundant workflow engine

  7. awesome-pipeline

    A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

  8. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo
  9. galaxy

    4 nextflow VS galaxy

    Data intensive science for everyone.

  10. devops-resources

    DevOps resources - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP

  11. common-workflow-language

    6 nextflow VS common-workflow-language

    Repository for the CWL standards. Use https://cwl.discourse.group/ for support 😊

  12. awesome-nextflow

    A curated list of nextflow based pipelines

  13. mag

    2 nextflow VS mag

    Assembly and binning of metagenomes

  14. Hubitat-iPhone-Presence-Sensor

    A virtual presence sensor for Hubitat that checks if an iPhone/Android is on the WiFi network.

  15. argo

    44 nextflow VS argo

    Workflow Engine for Kubernetes

  16. hyperqueue

    Scheduler for sub-node tasks for HPC systems with batch scheduling

  17. singularity

    Singularity has been renamed to Apptainer as part of us moving the project to the Linux Foundation. This repo has been persisted as a snapshot right before the changes.

  18. genopype

    Architecture for creating bash pipelines, in particular, for bioinformatics

  19. cgpipe

    cgpipe - minimum viable HPC pipeline

  20. aiida-hyperqueue

    AiiDA plugin for the HyperQueue metascheduler.

  21. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better nextflow alternative or higher similarity.

nextflow discussion

Log in or Post with

nextflow reviews and mentions

Posts with mentions or reviews of nextflow. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-08-10.
  • Nextflow: Data-Driven Computational Pipelines
    9 projects | news.ycombinator.com | 10 Aug 2023
    > It's been a while since you can rerun/resume Nextflow pipelines

    Yes, you can resume, but you need your whole upstream DAG to be present. Snakemake can rerun a job when only the dependencies of that job are present, which allows to neatly manage the disk usage, or archive an intermediate state of a project and rerun things from there.

    > and yes, you can have dry runs in Nextflow

    You have stubs, which really isn't the same thing.

    > I have no idea what you're referring to with the 'arbitrary limit of 1000 parallel jobs' though

    I was referring to this issue: https://github.com/nextflow-io/nextflow/issues/1871. Except, the discussion doesn't give the issue a full justice. Nextflow spans each job in a separate thread, and when it tries to span 1000+ condor jobs it die with a cryptic error message. The option of -Dnxf.pool.type=sync and -Dnxf.pool.maxThreads=N prevents the ability to resume and attempts to rerun the pipeline.

    > As for deleting temporary files, there are features that allow you to do a few things related to that, and other features being implemented.

    There are some hacks for this - but nothing I would feel safe to integrate into a production tool. They are implementing something - you're right - and it's been the case for several years now, so we'll see.

    Snakemake has all that out of the box.

  • Alternatives to nextflow?
    6 projects | /r/bioinformatics | 26 Oct 2022
    For now, I think that the best place to track this / get your voice heard is this GitHub Discussions post (which covers many things - error reporting is one of them). https://github.com/nextflow-io/nextflow/discussions/3107
  • HyperQueue: ergonomic HPC task executor written in Rust
    4 projects | /r/rust | 12 Oct 2022
  • Nextflow vs Snakemake
    2 projects | /r/bioinformatics | 29 Jul 2022
    We could spend the day pointing to things we wish were different, but that doesn't change the fact that Nextflow is the leader when it comes to workflow orchestration. And feel free to create a new issue in the GitHub repository if you wish to request a feature :)
  • Feel very hard writing nextflow pipeline.
    2 projects | /r/bioinformatics | 11 May 2022
    The nextflow devs have been talking about this for a while on GitHub. Looks like they're implementing something along these lines using schema like they do for nf-core. GitHub discussion.
  • Need a statically typed Python replacement
    1 project | /r/learnprogramming | 28 Dec 2021
    Groovy definitely scales up just fine I think but I never used it myself outside of little snippets embedded in my DSL, I know its considered by some to be "dead" so its interesting to see what other JVM-ecosystem users think of it.
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 14 Jul 2025
    InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →

Stats

Basic nextflow repo stats
9
2,982
9.8
5 days ago

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Groovy is
the 86th most popular programming language
based on number of references?