<https://datahubspace.slack.com/archives/CUMUWQU66...
# ingestionw
wooden-gpu-7761
12/02/2021, 2:59 AMhttps://datahubspace.slack.com/archives/CUMUWQU66/p1637644851019500 Shedding light on this again and would be great if I could receive feedback! 🙏
l
loud-island-88694
12/02/2021, 5:43 AM
@wooden-gpu-7761 1) Could you please write up a short doc on the setup required for the workaround i.e how to setup exported audit logs. Is this something that is turned on by default or would require the admin to turn on something? 2) This sounds like a good idea.
loud-island-88694
12/02/2021, 5:43 AM
Would love a contribution from you since a few people in the community have already encountered the API timeout issue you've mentioned
loud-island-88694
12/02/2021, 5:44 AM
This is on our radar too but we're currently tackling a few other things.
loud-island-88694
12/02/2021, 5:45 AM
Please let us know if you can get to it in the next week or so. If not, we can address it after next week
w
wooden-gpu-7761
12/02/2021, 5:47 AM@loud-island-88694 yeah I’ll write a doc soon!
On 1) you’d have to configure a Logs Router and make sure that a projec’ts BigQuery AuditLogs are all exported to a single partitioned table continually. In my case there are two main execution projects and the AuditLogs of both projects are being exported to their respective tables.
2) Thanks!
wooden-gpu-7761
12/02/2021, 5:49 AMI can absolutely get to it next week. What do you think about a PR that addresses both 1 and 2?
l
loud-island-88694
12/02/2021, 5:49 AM
that will be fantastic
w
wooden-gpu-7761
12/07/2021, 7:48 AMhttps://github.com/linkedin/datahub/pull/3680 I’ve added a PR to support
• exported bigquery logs to compute lineage information
• multiple query projects
for the
bigquery