Hello everyone, I’m getting an issue and maybe som...
# troubleshooting
a
Hello everyone, I’m getting an issue and maybe some of you here can help: I’m trying to send my production data from Postgres to snowflake and data are not sent to the right schema in snowflake database. Here is what’s happening: 1. I followed the documentation but data are populated by airbyte in the “public schema” created by default when creating a new database on snowflake instead of the “AIRBYTE_SCHEMA” created for this purpose 2. This only happen for my production data, all other connectors work well and they use the relevant schema I’ve attached the setup of the connection and the resulting tables in “AIRBYTE_DATABASE”. Does anyone have any idea of what I’ve done wrong please ? Appreciate your help
k
Hi Alban, I think you need to change a setting in Connections. There is a namespace dropdown for "mirror source structure" where you can change to enter the destination schema name - "AIRBYTE_SCHEMA" in your case - and I found that it solved this problem. The problem is that if you're pulling from a public schema in the source, it will automatically send to the public schema in the destination when you have "mirror source structure" selected, which is the default namespace option. More info in Airbyte docs link below, hope this helps. https://docs.airbyte.com/understanding-airbyte/namespaces
a
Hi @Kev Daly, thanks for your help. Unfortunately, it doesn’t solve the issue. Data doesn’t sync anymore and here is the logs I’m getting
k
Hi @Alban van Rijsewijk is it possible you're having a Snowflake access issue? Seeing this line in the logs
Copy code
net.snowflake.client.jdbc.SnowflakeSQLException: User temporarily locked. Try again later, or contact your local system administrator.
a
maybe because I attempted to many times to relaunch the sync ? I’m looking into it
@Kev Daly I went back to the initial settings as nothing were working anymore and I’m still getting normalisation issues. It’s a common issue among all my sources but can’t figure out where to investigate. Do you have any other ideas ?
Ok I found something in logs, I think there is an issue with schemas & credentials in snowflake..
thanks @Kev Daly for your help. I managed to solve some issues but still getting trouble for my three connectors. Opened another thread 🙂
k
@Alban van Rijsewijk glad you're making progress, I am actually having the same problem, which I'm suspecting is an Airbyte issue
a
@Kev Daly which problem are you talking about please ? The normalization one ?
k
Yes
a
@Kev Daly Can you share with me where you have reported it please ? So I can follow-up on it as well
found it here 🙂 in case other are interested