Hello. I'm checking your demo page and was curious...
# troubleshoot
g
Hello. I'm checking your demo page and was curious on how datahub shows s3 schemas, but seems like the few examples i reviewed (like this: https://demo.datahubproject.io/dataset/urn:li:dataset:(urn:li:dataPlatform:s3,datahubpro[…]ct_splits.all_entities,PROD)/Schema?is_lineage_mode=false) does not have it. Does it mean that DataHub does not store s3 schemas in general or do i have to use glue for that?
h
@gifted-piano-21322 Please take a look at this link from docs - Ingesting files from S3 . It might help clarify some of your questions.
g
Ok, so Glue with Crawler it is. Thanks.
h
And there is also a recently added data-lake connector that allows ingests from S3 directly.
plus1 1