Soorgeon
Join our community | Newsletter | Contact us | Blog | Website | YouTube
Convert monolithic Jupyter notebooks into Ploomber pipelines.
soorgeon.mp4
Try the interactive demo:
Note: Soorgeon is in alpha, help us make it better.
Install
pip install soorgeon
Usage
# refactor notebook
soorgeon refactor nb.ipynb
# all variables with the df prefix are stored in csv files
soorgeon refactor nb.ipynb --df-format csv
# all variables with the df prefix are stored in parquet files
soorgeon refactor nb.ipynb --df-format parquet
# store task output in 'some-directory' (if missing, this defaults to 'output')
soorgeon refactor nb.ipynb --product-prefix some-directory
# generate tasks in .py format
soorgeon refactor nb.ipynb --file-format py
To learn more, check out our guide.
Examples
git clone https://github.com/ploomber/soorgeon
Exploratory daya analysis notebook:
cd examples/exploratory
soorgeon refactor nb.ipynb
# to run the pipeline
pip install -r requirements.txt
ploomber build
Machine learning notebook:
cd examples/machine-learning
soorgeon refactor nb.ipynb
# to run the pipeline
pip install -r requirements.txt
ploomber build
To learn more, check out our guide.