This message was deleted.
# generals
Slackbot
07/27/2023, 6:38 PMThis message was deleted.
o
Oleg Yamin
07/27/2023, 7:02 PMYou could probably achieve that pretty easy with S3 triggers and lambda function which would send job trigger request via api/curl command.
Oleg Yamin
07/27/2023, 7:03 PMand if your druid is hosted on AWS too… then just have to make sure that lambda has correct permissions to that url
p
Pranav
07/28/2023, 4:31 AMyou can use oozie/airflow workflow and set frequency, their scheduler will listen to bucket and as soon as given path is ready, it will trigger the DAG that you wrote.
a
Amir Naik
07/28/2023, 4:54 AMThanks @Oleg Yamin @Pranav Yes, Druid is running in AWS. So where do you suggest to keep the ingestionSpec/SQL job in s3 ?
o
Oleg Yamin
07/31/2023, 9:08 PM@Amir Naik It’s really up to you. The task spec file can be kept in s3 bucket or GitHub any other source that lambda will have access to. You can just tell it to download that file from whatever location when it is triggered.