Hey Folks, I want to know if there is any retry me...
# ingestionc
careful-action-61962
09/30/2022, 8:49 AMHey Folks, I want to know if there is any retry mechanism config that we can specify in datahub ingestion recipe from UI
careful-action-61962
10/03/2022, 7:41 AMI want to configure retry at source.
careful-action-61962
10/03/2022, 7:41 AMnot at sink
d
dazzling-judge-80093
10/03/2022, 7:41 AMIt is source specific what kind of retry options do you have
c
careful-action-61962
10/03/2022, 7:43 AM@dazzling-judge-80093 When the ingestion runs, in first run it starts databricks cluster, which takes 5 minutes to start, but by then the ingestion is in failed status
careful-action-61962
10/03/2022, 7:43 AMI want my receipe to retry after 5 minutes so that the cluster would be up
d
dazzling-judge-80093
10/03/2022, 1:07 PMI don’t think you can do it out of the box but you can write a simple shell script to retry I think
c
careful-action-61962
10/04/2022, 6:54 AMGot it. Thanks