I am noticing an issue with the Snowflake Lineage....
# ingestion
r
I am noticing an issue with the Snowflake Lineage. Here is an example - I created a temp table with CTE to build the actual dataset like this
Copy code
CREATE TEMP TABLE temp.temp_stone AS
WITH upd_stone_response_messages AS
          (
             SELECT DISTINCT srm.id AS stone_response_message_id
             FROM src_payment.stone_response_messages srm
             WHERE updated_at BETWEEN $date_start AND $date_end
               AND request_type = 'authorize'
               AND transaction_id IS NOT NULL
          )
Here you can see I have a dependency on
src_payment.stone_response_messages
, but when i look at the lineage UI, I only see that the dataset is built using temp_stone.but nothing more than that. The SQL inside of the CTE is not captured in the lineage
@helpful-optician-78938 fyi
h
Hi @red-pizza-28006, thanks for bringing this to our notice. We are not yet capturing the edge properties. The lineage model is going though an overhaul and this will come sometime next year.
r
😞 thanks, do you know an approx ETA for this?
h
Mostly Q1.
r
Perfect, thank you so much, and please let me know if i can help in any way here
h
Will definitely circle back to you once we started working on this.
r
@helpful-optician-78938 any updates on this feature?