Hello guys, Is there a way of using Stateful Ingestion with schedules ? I've tried it for Snowflake and it works, but I cannot relaunch the pipeline via UI or set a schedule cron expr. Thank you guys in advance!

@bulky-soccer-26729 may be able to provide some context here!

Sure thing! I think I said this in another thread somewhere @salmon-angle-92685 but those sources you've outlined there are CLI-based sources and we don't allow you to run them or edit them/add schedules via the UI. If you create sources through the UI then you'll be able to do so!

@bulky-soccer-26729 Thanks very much for your answer! But isn't there a way of adding schedules via CLI-based ingestion ? I didn't find anything about that on the doc.

oh sorry yes there is! it's less user-friendly compared to scheduling via the UI, but I would check out this docs section: https://datahubproject.io/docs/metadata-ingestion/schedule_docs/intro. Basically you have a couple of options: 1. if you have crontab installed and know how to schedule using cron inputs, you can prefix the ingestion run with it: https://datahubproject.io/docs/metadata-ingestion/schedule_docs/cron 2. If you use Airflow you could leverage that as well: https://datahubproject.io/docs/metadata-ingestion/schedule_docs/airflow Otherwise I would suggest moving your CLI source to the UI!