Is there a setting to include data types of attrib...
# replication-troubleshootingm
Murat Cetink
10/19/2022, 6:27 PMIs there a setting to include data types of attributes for the ingested source json data? I receive the data as “colName”:”value” but there is no data type info with it. My source is Zuora and destination is Snowflake. Thanks.
✍️ 1
u
user
10/19/2022, 6:32 PM@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2945 to ensure timely resolution!
s
Saj Dider (Airbyte)
10/19/2022, 6:55 PMHey @Murat Cetink,
Saj Dider (Airbyte)
10/19/2022, 6:56 PMThanks for the issue! What versions are you using for Airbyte and for the Zuora and Snowflake connectors?
m
Murat Cetink
10/19/2022, 7:01 PMHi @Saj Dider (Airbyte) . Airbyte : 0.40.14 , Zuora: 0.1.3, Snowflake: 0.4.38
s
Saj Dider (Airbyte)
10/19/2022, 7:02 PMThanks. What streams were you using for your sync?
m
Murat Cetink
10/19/2022, 7:04 PMACCOUNT, PRODUCT, RATEPLAN, SUBSCRIPTION
Murat Cetink
10/19/2022, 7:04 PMall are on incremental append sync mode
s
Saj Dider (Airbyte)
10/19/2022, 7:06 PMThanks, I'll try replicating the issue and report back with more questions or findings
👍 1
Saj Dider (Airbyte)
11/01/2022, 4:17 PMSorry for the delay with this @Murat Cetink, our Zuora account has been locked out and I’ve been unable to test the connection up until this point.
Out of curiosity, while we wait, were you able to resolve this issue?
m
Murat Cetink
11/01/2022, 4:44 PMHi @Sajarin Dider . No, I’m still getting the date columns as String.
Murat Cetink
11/01/2022, 4:45 PMAnd I don’t see the data types in the loaded raw json.
m
Marcos Marx (Airbyte)
12/06/2022, 7:21 PMHello Murat, Zuora uses dynamic schema to build the streams data types. Probably this limit the option to retrieve fields as datetimes. Something I saw in Zuora code is:
https://github.com/airbytehq/airbyte/blob/b7816f4f585ce4b2ab20aaddca22ef5bb9f9d114[…]yte-integrations/connectors/source-zuora/source_zuora/source.py
which shows that Zuora returns datetime values in a different format than ISO. If you want you can customize the connector to read fields as datetime:
https://github.com/airbytehq/airbyte/blob/b7816f4f585ce4b2ab20aaddca22ef5bb9f9d114[…]yte-integrations/connectors/source-zuora/source_zuora/source.py