Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge. Learn more →
Ploomber Alternatives
Similar projects and alternatives to ploomber
-
-
-
Mergify
Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
-
-
-
dagster
An orchestration platform for the development, production, and observation of data assets.
-
Kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
-
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
-
-
-
-
dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
-
windmill
Open-source developer platform to turn scripts into workflows and UIs. Open-source alternative to Airplane and Retool.
-
-
-
-
fastapi-dramatiq-data-ingestion
Sample project showing reliable data ingestion application using FastAPI and dramatiq
-
superset
Apache Superset is a Data Visualization and Data Exploration Platform
-
polyaxon
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better ploomber alternative or higher similarity.
ploomber reviews and mentions
Posts with mentions or reviews of ploomber.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-08-24.
-
Runme – Interactive Runbooks Built with Markdown
For those who don't know, Jupyter has a bash kernel: https://github.com/takluyver/bash_kernel
And you can run Jupyter notebooks from the CLI with Ploomber: https://github.com/ploomber/ploomber
-
Rant: Jupyter notebooks are trash.
Develop notebook-based pipelines
-
Who needs MLflow when you have SQLite?
Fair point. MLflow has a lot of features to cover the end-to-end dev cycle. This SQLite tracker only covers the experiment tracking part.
We have another project to cover the orchestration/pipelines aspect: https://github.com/ploomber/ploomber and we have plans to work on the rest of features. For now, we're focusing on those two.
-
Ploomber Cloud - Parametrizing and running notebooks in the cloud in parallel
We started with an open-source framework to help data practitioners make their work reproducible. However, after months of building and learning from our community, we realized that many needed help with the setup: getting Python installed, getting dependencies, running experiments locally, etc.
-
Alternatives to nextflow?
It really depends on your use cases, I've seen a lot of those tools that lock you into a certain syntax, framework or weird language (for instance Groovy). If you'd like to use core python or Jupyter notebooks I'd recommend Ploomber, the community support is really strong, there's an emphasis on observability and you can deploy it on any executor like Slurm, AWS Batch or Airflow. In addition, there's a free managed compute (cloud edition) where you can run certain bioinformatics flows like Alphafold or Cripresso2
-
"Do I need to know {insert advanced math} to get a Data Science job?" [Rant]
btw, you can export Ploomber to Argo and Airflow!
-
Running Jupyter notebooks in parallel
As a second option, we will use Ploomber with serial execution, which also has a Python API that allows us to execute different notebooks using the NotebookRunner function:
-
How do you deal with parallelising parts of an ML pipeline especially on Python?
I also recommend checking ploomber out, this open source can help you build code as templates, parallelize it and parameterize it. There are also some reporting and debugging tools in there!
Multiprocessing works well but you probably need an abstraction on top to make it work reliably. For starters, it's best to use a pool of processes because creating new ones is expensive, you also need to ensure that errors in the sub-processes are correctly displayed in the main process, otherwise, it becomes frustrating. Also, sometimes sub-processings might get stuck so you have to monitor them. I implemented something that takes care of all of that for a project I'm working on, it'll give you an idea of what it looks like (of course, you can use the framework as well, which lets you parallelize functions and notebooks).
-
A note from our sponsor - InfluxDB
www.influxdata.com | 29 Sep 2023
Stats
Basic ploomber repo stats
120
3,196
0.0
30 days ago
ploomber/ploomber is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of ploomber is Python.
Write Clean Python Code. Always.
Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
www.sonarsource.com