This message was deleted.

this likely has nothing to do with ploomber. Are you sure you're using the same kernel?

yes ..

after installing jupyter hub

what exactly do you mean by this? Jupyterhub is likely not running on your local machine, so would be a different environment than running from "jupyter notebook"

i have jupyter hub running on AWS

sorry, I'm not sure. I'd just try re-installing ploomber, checking your

PATH

and

PYTHONPATH

, etc.

@Nikhil Reddy it’s possible you installed it, shut down/restarted the machine? AWS usually have a startup script it runs on your machine on boot. If the ploomber installation isn’t there the machine won’t recognize it. We’ll create a video soon on how to bootstrap Sagemaker (Which is the one you’re using I assume?)

i have installed all the required libraries and am able to execute the notebooks individually

looks like the Python env running in your notebook and then one where ploomber is running is not the same. can you run this?

!  python -c 'import sys;print(sys.executable)'

and in a Python cell:

import sys
print(sys.executable)

btw, you can also use the Python API to build your pipeline, it has nicer output:

from ploomber.spec import DAGSpec

dag = DAGSpec('path/to/pipeline.yaml').to_dag()

dag.build(force=True)

thanks for your help, i have started using python API

are you using the parallel executor? I saw a problem when printing progress I see you're using the

debug=later

, awesome! let me know what you think

yup am using parallel executer.