future-holiday-32084
04/13/2023, 10:30 AMspark.sql("select * from <database>.<table_source>").write.mode("append").format("parquet").saveAsTable("<database>.<table_sink>")
The lineage, as shown in the image below, has been inferred perfectly for the sink table. However, the source table displays the location on my Hadoop Data Lake, even though I'm reading from a table, not a path.astonishing-answer-96712
04/14/2023, 5:27 PMrich-salesmen-77587
04/20/2023, 4:50 PM