Hello Everyone, I have a tableau ingestion which is scheduled 4 times a day and all of them were successfully executed yesterday. However, I see the status as 'failed' as the last status on the UI. Last execution time is also wrong. Can someone help me with this.

Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: 1️⃣ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? Yes button ✅ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? ✅ button

Hey @microscopic-machine-90437, this appears to be UI related issue. What is your deployed datahub version ?

Hi @hundreds-photographer-13496, I have the datahub 0.10.0.6 version installed.

That's strange. Could you confirm the output of following graphql api. Ideally the most recent run with latest

requestedAt

is considered as latest run.

{
  listIngestionSources(
    input: {start:0, count:10, query:"Tableau PRD"}
  ) {
    start
    count
    total
    ingestionSources {
      urn
      name
      type
      schedule {
        interval
        timezone
      }
      executions(start: 0, count: 10) {
        start
        count
        total
        executionRequests {
          urn
          id
          input {
            requestedAt
          }
          result {
            status
            startTimeMs
            durationMs
          }
        }
      }
    }
  }
}

Where can I get this from?

Hi @hundreds-photographer-13496, please find the output of the graphql api in the attachment. Also, please look in to the earlier logs, as the scheduled ingestions are getting failed frequently due to the error

"acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"],
 'errors': []}

Attaching the recently failed ingestion log for your reference. Hope we get faster resolution as we have a demo planned to the users this week.

@microscopic-machine-90437 is your earlier problem with UI showing stale status and last execution resolved ? The ordering in graphql response looks correct to me.

yeah, the UI is showing correct ingestion results now, but sometimes the ingestions are getting failed with the above error message(Failed to execute 'datahub ingest').

if this happens only sometimes, this seems related to tableau metadata api behavior. How frequently does this failure happen ? Do you have tableau ingestion runs that use same personal access token and execute at same time ? We have observed in the past, that tableau does not using using same PAT in two api requests at the same time.

It happens very frequently, infact there is a failure yesterday for another ingestion. If you see the below image, the Tableau PRD OM ingestion failed on Tuesday, the Tableau PRD DOT ingestion failed yesterday, with the same error (attaching the log for your reference). All the tableau ingestions runs with the same personal access token and both these ingestions are scheduled at the same time (7 AM). So, do you suggest us to change the schedule time to different timings for each ingestion?

The mentioned error is during close of tableau source and should not affect ingested assets - this was fixed in this PR - I believe, so I would suggest upgrading to latest version if you don't wish to see this error.

yes, if using same PAT, please schedule them in such a way that they do not overlap/ or use different PAT for two ingestions.

Got it! Thank you for your quick response. Greatly appreciated!