Hi Team,
Can the source "data lake files" be used ...
# ingestionm
mysterious-pager-59554
08/03/2022, 3:27 PMHi Team,
Can the source "data lake files" be used to ingest data from Azure Data Lake or is it just limited to AWS (edited)
g
green-football-43791
08/04/2022, 10:15 PMyou may be looking for https://datahubproject.io/docs/generated/ingestion/sources/iceberg/#integration-details
green-football-43791
08/04/2022, 10:16 PMare you dealing with iceberg tables in your data lake?
m
mammoth-bear-12532
08/09/2022, 11:37 PM
Hi @mysterious-pager-59554 this is not supported currently, but as Gabe mentioned the iceberg connector supports ADLS. Are you interested in looking at raw json / parquet files on ADLS or lake table formats like delta-lake or iceberg?
g
gray-vegetable-18942
11/04/2022, 3:39 PMHi @green-football-43791 /@mammoth-bear-12532 - We are exploring the Data Hub/Acryl Data. We are interested in raw json/parquet/csv files on ADLS as well as delta-lake format files in ADLS. Can you please let us know any timeline when this use case will be supported by DataHub ?