Join Slack
Powered by
Hello. I'm checking your demo page and was curious...
# troubleshoot
g
gifted-piano-21322
02/21/2022, 8:30 AM
Hello. I'm checking your demo page and was curious on how datahub shows s3 schemas, but seems like the few examples i reviewed (like this:
https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:s3,datahubpro[…]ct_splits.all_entities,PROD)/Schema?is_lineage_mode=false
) does not have it. Does it mean that DataHub does not store s3 schemas in general or do i have to use glue for that?
h
hundreds-photographer-13496
02/21/2022, 9:41 AM
@gifted-piano-21322
Please take a look at this link from docs -
Ingesting files from S3
. It might help clarify some of your questions.
g
gifted-piano-21322
02/21/2022, 9:53 AM
Ok, so Glue with Crawler it is. Thanks.
h
hundreds-photographer-13496
02/21/2022, 10:11 AM
And there is also a recently added
data-lake connector
that allows ingests from S3 directly.
plus1
1
Open in Slack
Previous
Next