Hello again friends another doubt now about Snowflake lineage. I have seen that it is based on a view named

access_history

but when I check this view in my Snowflake enterprise account it is empty and hence I have no lineage appearing in Datahub. Anyone has faced something similar?

Lineage is supported through snowflake-usage. Please check configuration here Specifically, include_view_lineage, include_table_lineage parameters

Thanks, @careful-pilot-86309! Yes I used this doc. Currently I have set two ingestions, one using the module

snowflake

and the other the

snowflake-usage

. I made sure my Snowflake datahub user was granted access to the snowflake database (followed this https://datahubproject.io/docs/generated/ingestion/sources/snowflake/#prerequisites) where the usage information should be available. The thing is that when I check

select * from snowflake.account_usage.access_history

in my Snowflake account the view is empty and I do not understand why. I see that the lineage for Snowflake is based on this view (https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/sql/snowflake.py#L476) so I was wondering if someone else has faced a similar issue. The yaml files are:

source:
    type: snowflake
    config:
        account_id: <...>
        warehouse: DATA_ENG
        role: datahub
        ignore_start_time_lineage: true
        include_table_lineage: true
        include_view_lineage: true
        check_role_grants: false
        profiling:
            enabled: true
        stateful_ingestion:
            enabled: false
        username: '${SNOWFLAKE_USER}'
        password: '${SNOWFLAKE_PASS}'
        schema_pattern:
            deny:
                - 'information_schema.*'
        database_pattern:
            allow:
                - 'dwh_ch.*'

and

source:
    type: snowflake-usage
    config:
        account_id: <...>
        warehouse: DATA_ENG
        role: datahub
        include_table_lineage: true
        include_view_lineage: true
        check_role_grants: true
        stateful_ingestion:
            enabled: false
        username: '${SNOWFLAKE_USER}'
        password: '${SNOWFLAKE_PASS}'
        schema_pattern:
            deny:
                - 'information_schema.*'
        database_pattern:
            allow:
                - 'dwh_ch.*'

@hundreds-photographer-13496 Can you please take a look?

@square-hair-99480 which snowflake edition are you using ? Access History requires Enterprise Edition (or higher).

Hi @hundreds-photographer-13496 yes now it makes sense. I just checked and we are using standard edition. I think we'll have to do without lineage for now. Thanks a lot for your time and answer.