I am looking to use the Postgres CDC to Redshift o...
# ask-community-for-troubleshooting
d
I am looking to use the Postgres CDC to Redshift on a table with very large JSON blobs. Ideally, I'd like to map those types to a SUPER column both in terms of usability as well as due to max size as jsonb can be > than redshift varchar(max). Is this possible or are there gotchyas to watch out for?
✍️ 1
u
@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2615 to ensure timely resolution!
s
It is possible to use dbt to apply transformations to the raw tables after loading data into the destination connector, not sure if that would help? Otherwise it looks like we have opened a similar feature request for the MySQL source connector: https://github.com/airbytehq/airbyte/issues/14346 Also, I wonder if this proposal will help with the issue? https://github.com/airbytehq/airbyte/pull/17486 It would be great if you wanted to open a feature request for the postgres source connector to handle
jsonb
typed data without converting to
string
! And if you're interested, you can try to modify its code to support this datatype
d
I'll write up a new request...It's not quite the same I am asking for override of the existing type rather than airbyte automagically knowing something will be too big
or json
feel free to do with as you will
s
Thanks for creating this issue, it's been triaged to the correct team and is in queue to be addressed