Hi everyone! I am using ingestion from S3 bucket, ...
# troubleshoot
m
Hi everyone! I am using ingestion from S3 bucket, and json files within, and in logger of ingestion task I get the message that it’s extracting table schema but there’s nothing actually there, it doesn’t infer the schema. Here’s logger output:
Copy code
'[2022-09-20 09:41:44,078] INFO     {datahub.ingestion.source.s3.source:519} - Extracting table schema from file: '
           '<s3://path/to/file.json>\n'
'[2022-09-20 09:41:44,078] INFO     {datahub.ingestion.source.s3.source:527} - Creating dataset urn with name: '
           'path/to/file.json\n'
h
Hi @mammoth-air-95743 do you see any related warnings in ingestion report ?
m
No, is there anywhere I can look for additional indepth logs?
h
you can enable debug logs using
datahub --debug ingest -c recipe.yml
. but also, I saw that related warnings are not logged but are included in source report that would show up at the end of pipeline execution.