Experiences with workflow managers implemented in Haskell (funflow, porcupine, bioshake, ?)

1. awesome-pipeline

   1 11 6,354 6.4

   A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

   

   There are a billion of them out there (https://github.com/pditommaso/awesome-pipeline), so the decision which one to choose is not exactly easy. Most of my colleagues rely on Nextflow and Snakemake, so I should consider these, but before I start to learn an entirely new language I wanted to explore the Haskell ecosystem for possible solutions. Strong typing should in theory be a perfect match for a pipeline manager. And having this in Haskell would simplify replacing some of my R code with Haskell eventually.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. funflow

   2 3 365 3.5 Haskell

   Functional workflows

   

   Funflow: https://github.com/tweag/funflow

4. porcupine-core

   3 1 89 0.0 Haskell

   Express parametrable, composable and portable data pipelines (by YPares)

   

   Porcupine: https://github.com/tweag/porcupine

5. bioshake

   4 1 56 10.0 Haskell

   Bioinformatics pipelines with Haskell and Shake

   

   Bioshake: https://github.com/PapenfussLab/bioshake

6. bionix

   5 1 89 4.1 Nix

   Functional highly reproducible bioinformatics pipelines

   

   I wasn't satisfied with this and wanted the software to be managed too, so we ended up working on BioNix (https://github.com/PapenfussLab/bionix) which does both pipeline execution and software management. This is nice because it makes everything extremely reproducible and removes a lot of the pain of dealing with setting up software etc at various HPC facilities. The down side is Nix isn't typed, so the typing aspect of bioshake was ported on the back of a ADT implementation in Nix, and at least for my work it has caught a fair few mistakes. Of course this isn't Haskell so it doesn't satisfy your criteria, just though it's worth a mention.

7. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

Suggest a related project