No data migration. Ploomber Cloud runs on AWS, and can integrate with your existing infrastructure such as S3, GCS, RedShift and Athena.

Ploomber

Hello!

You can run parametrized pipelines, in this case you can define the input parameters in a yaml file and then run the pipeline using the values in the file.

More about this: <https://docs.ploomber.io/en/latest/user-guide/parametrized.html>

Please note that you can also override values in this file by running the build command with a specified flag:

```ploomber build --force --env--some_param another_value```

you can execute bash scripts from ploomber (and run the scrapy command): <https://docs.ploomber.io/en/latest/user-guide/shell.html#shell-tasks>

alternatively, you can create a notebook and use the `%%bash`  magic to execute the commands:

```%%bash
scrapy ...```