https://linen.dev logo
Join Slack
Thread
#secoda-support
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Hey everyone, just setting up the Secoda x Snowflake connection, do we need to apply the grants for every databases in Snowflake per the docs here in step 6? Is there an easier way to do this? Would it work if I just used below to pull in accountwide schema, database, and lineage information
    GRANT IMPORTED PRIVILEGES ON DATABASE SNOWFLAKE TO ROLE ROLE;
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    @abundant-crowd-2724 do you have any insight on this? I know you’ve played around with the permissions in Snowflake more than I have. If not I can take a look into this. Just wanted to check first.
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Thanks Andrew! In a nut shell, I just want to know whether i need to explicitly grant access to every database we have or if there's just a simple catch all command I can run. We also use blue-green deploy so I'm not sure how the lineage might work in this case, but ideally we don't need to grant access to the staging db in a blue-green deploy
    Copy to Clipboard
    Any ideas on this @abundant-crowd-2724?
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    I’ll look into this this morning for you @agreeable-fish-22746
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Thanks!!
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    @agreeable-fish-22746 based on the research it looks like the query you’ve pasted above would do the trick. You just have to associate 
    ROLE
    with the user you connect to Secoda with.
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    gotcha, I'll try that now and let you know if I run into any issues! Would make it a lot simpler for future Snowflake users to onbaord as well IMO!
    Copy to Clipboard
    @elegant-house-93198 so it looks like it's only pulling in the schemas within the default 
    SNOWFLAKE
    database. i.e. 
    account_usage
    organization_usage
    ,etc. And not actually extracting the production databases that can be derived from this DB
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    @agreeable-fish-22746 let me make a quick update to our Snowflake queries to make it so that works properly. It shouldn’t take too long and you’re right that it will make things easier for future users. I’ll let you know when it’s been completed. Hopefully in the next hour
    💯 1
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Thanks! For now I've explicitly created a Snowflake integration for each database we plan to sync
    Copy to Clipboard
    We have a bunch of interim tables that Airbyte uses to build source tables, is there a way to deselect and not sync all of these tables?
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    Yes, if you go to the Integration in Secoda and then the Schema tab you can select which schemas and associated tables come into Secoda.
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Doesnt let me expand to see the tables
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    If you want we can update that UI to also include tables?
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Yes that would be great - we have many 
    _scd
    suffixed tables that Airbyte uses for incremental syncs and a lot of 
    _airbyte
    prefixed tables (that I can't seem to search for in the search bar) that shouldnt be included. In the image below I've searched for 
    _airbyte_
    it's saying there are 722 results but only shows 2 pages of them, none of which are the airbyte prefixed tables
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    For the screenshot, are those the results after searching 
    _airbyte
    ? It would be good to get a full screenshot if possible to get a better understanding of what’s going on.
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Yup, those are the results after entering 
    _airbyte
    in the searchbar
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    That’s helpful, should be a quick fix on our end. I’ll let you know when it’s been fixed.
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Awesome, just adding on, similarly if I search for 
    core.
    it would display 143 results on the right but only 10ish in the list with no pages to select
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    I’ve also forwarded this to our engineering team. A solution while you’re waiting on the fix is to select the “Tables” option on the right side. That should show all the tables.
    👍 1
    Copy to Clipboard
    The “All” bug should be fixed now. Let me know if you continue to experience the issue with it.
    👍 1
    a

    agreeable-fish-22746

    7 months ago
    Copy to Clipboard
    Hey Andrew is this available yet? I've got probably around 600 tables that are temp tables I don't want to include in any of the searches or catalogshttps://secodacommunity.slack.com/archives/C01PT4WP0TE/p1644257802323409?thread_ts=1643998298.824089&cid=C01PT4WP0TE
    e

    elegant-house-93198

    7 months ago
    Copy to Clipboard
    It’s not available yet, some additional work came up today. But I still have it on the top of my todo list so hoping to get to it tomorrow morning.
    👍 1
View count: 2
Join thread in Slack