Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev. Learn more →
Papermill Alternatives
Similar projects and alternatives to papermill
-
ploomber
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
-
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
-
jupytext
Jupyter Notebooks as Markdown Documents, Julia, Python or R scripts
-
-
-
-
Onboard AI
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
-
Airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
-
fastapi
FastAPI framework, high performance, easy to learn, fast to code, ready for production
-
ipython
Official repository for IPython itself. Other repos in the IPython organization contain things like the website, documentation builds, etc.
-
Nim
Nim is a statically typed compiled systems programming language. It combines successful concepts from mature languages like Python, Ada and Modula. Its design focuses on efficiency, expressiveness, and elegance (in that order of priority).
-
dagster
An orchestration platform for the development, production, and observation of data assets.
-
-
Solara
A Pure Python, React-style Framework for Scaling Your Jupyter and Web Apps
-
nb_conda_kernels
Package for managing conda environment-based kernels inside of Jupyter
-
-
enhancement-proposals
Enhancement proposals for the Jupyter Ecosystem
-
jupyter-collaboration
A Jupyter Server Extension Providing Support for Y Documents
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
papermill reviews and mentions
-
Git and Jupyter Notebooks Guide
https://github.com/jupyter/enhancement-proposals/pull/103#is...
Papermill is one tool for running Jupyter notebooks as reports; with the date in the filename. https://papermill.readthedocs.io/en/latest/
-
JupyterLab 4.0
You may be interested in papermill to address the parametrized analysis problem [1]. I think (but I'm not positive) this is what the data team at a previous job used to automate running notebooks for all sorts nightly reports.
-
Show HN: Mercury – convert Jupyter Notebooks to Web Apps without code rewriting
I'm using Papermill to operationalize Notebooks (https://github.com/nteract/papermill), it e.g. also has airflow support. I'm really happy with papermill for automatic notebook execution, in my field it's nice that we can go very quickly from analysis to operations -- while having super transparent "logging" in the executed notebooks.
-
What's the best thing/library you learned this year ?
papermill bcpandas fastapi
-
Running Jupyter notebooks in parallel
As a first option, we will use Papermill, which has a Python API that allows us to run different notebooks using some functions:
-
Tips for using Jupyter Notebooks with GitHub
Papermill can also target cloud storage outputs for hosting rendered notebooks, execute notebooks from custom Python code, and even be used within distributed data pipelines like Dagster (see Dagstermill). For more information, see the papermill documentation.
-
Three Tools for Executing Jupyter Notebooks
Papermill Documentation
Papermill Source Code
-
html reports using python
papermill - similar to nbconvert with parametrization, and intergration for cloud storages
-
Release of IPython 8.0
1) This is painful. There are tools to help, but the most effective means I've found are having a policy to only commit notebooks in a reset, clean state (enforced with githook).
2) I don't understand. I've written full testing frameworks for applications as notebooks as a means of having code documentation that enforced/tested the non-programmatic statements in the document. Using tools like papermill (https://papermill.readthedocs.io/en/latest/), you can easily write a unit test as a notebook with a whole host of documentation around what it's doing, execute, and inspect the result (failed execution vs. final state of the notebook vs. whatever you want)
3) Projects like ipynb (https://ipynb.readthedocs.io/en/stable/) allow you to import notebooks as if they were python modules. Some projects have different opinions of what that means to match different use cases. Papermill allows you have an interface with a notebook that is more like a system call than importing a module. I've personally used papermill and ipynb and found both enjoyable for different flavors of blending applications and notebooks.
-
A note from our sponsor - Onboard AI
getonboard.dev | 4 Dec 2023
Stats
nteract/papermill is an open source project licensed under BSD 3-clause "New" or "Revised" License which is an OSI approved license.
The primary programming language of papermill is Python.