Hello everyone! I’m trying out Airbyte cloud for ...
# ask-community-for-troubleshooting
j
Hello everyone! I’m trying out Airbyte cloud for PostgreSQL => AWS Redshift pipeline and have couple of questions 1️⃣ I’m looking at Connector Catalog Destinations > Redshift> docs and am confused as to what sort of privilege does the airbyte user on Redshift side require? It seems that this is sufficient
Copy code
GRANT CREATE ON DATABASE <my_db> TO <my_user>;
before this, it would tell me it lacks privilege on database, but can someone confirm this is all it needs? 2️⃣ How does the PostgreSQL source connector handle the schema changes? I just tried to do some changes to the connector and upon save, it warned me that all of the data in the schema will be removed.. 🤯 3️⃣ How can I tell airbyte to normalize the JSON field? It currently is trying to push our JSONB into a string type field in Redshift. I’ve already set following in the transformations.
Normalized tabular dataMap the JSON object to the types and format native to the destination.
Looking at Connections and Sync Modes Airbyte basic normalization> it mentions dbt
• only available for destinations that support dbt execution.
but there is no mention as to which destinations support this? I skimmed through the docs, but did not find answers to the above questions. Said that, I’m sure I’m missing something. Thanks in advance! 🙏 P.S. https://docs.airbyte.com/quickstart/ => 404
m
Hello @JP if you’re using Airbyte Cloud please use Intercom support chat. Tech Cloud Support team will provide what you need there 😄
👍 1
1. Destination connectors needs broader permissions to be able to create schemas (custom namespace)
2. Schema change is not supported yet
1
3. Airbyte will normalize any object column (with some destination limitations)
Normalization is only supported with data warehouses has dbt package available
j
Hi @Marcos Marx (Airbyte) Thank you very much for getting back to me on this. I’ll check out the chat feature 👍
1. Destination connectors needs broader permissions to be able to create schemas (custom namespace)
Do you know where I can find out info on what are the privileges required for the destination user on Redshift?
3. Airbyte will normalize any object column (with some destination limitations)
Normalization is only supported with data warehouses has dbt package available
Would this include Redshift? Is there some place I can look up a list or how this works in some detail 😕