https://linen.dev logo
p

Prithvi Pradip

10/11/2021, 6:30 AM
Hi Everyone , Facing two issues at my end, not sure if this was answered in the thread already, i did look for it though. Airbyte version: 0.29.16-Alpha • OS Version / Instance: Linux/ AWS EC2 • Deployment: Docker • Source Connector : Zendesk/Iterable • Destination Connector : S3 1st issue - My sync job between iterable and s3 is in a loop. The log says : 2021-10-11 062055 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062105 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062115 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062125 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062135 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062145 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062155 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062205 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062215 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062225 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062235 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062245 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062255 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062305 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062315 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062325 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062335 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062345 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc 2021-10-11 062355 INFO () LogClientSingleton(setJobMdc):146 - Setting docker job mdc Its in the same loop for over an hour and then it fails. 2nd issue - For the sync job between zendesk support and s3, the data in table 'tickets' is broken. The column 'description' has multiple entire emails in it which is breaking the data when exported to csv through airbyte. The data from description ,which has over 100 of lines of string data(email data) is falling into other columns also and hence cannot use the data. There is no option of dropping this column as i dont really need it but now the entire data cannot be used. Please do advice on the workaround for both these problems.
u

user

10/12/2021, 2:55 PM
Please upgrade to latest version. This was an issue for this version and a fast patch was released correcting it.
a

Ameya Bapat

10/12/2021, 2:55 PM
Can you share more information about the second problem?
u

user

10/13/2021, 12:13 PM
@[DEPRECATED] Marcos Marx 2nd error -The description column in the tickets table is have a large amount of string data, basically multiple emails. The table when exported to S3 as csv, the data from the description column is broken into bits and is found in adjacent columns also. When I spoke with Natalie, she told me it might due to a parsing issue. Regarding the first issue- i upgraded to 0.30.18-alpha and i dont see that error anymore. But the sync is getting canceled due to a new memory issue error. Have attached the screenshot of the output file for the 2nd error and the log file of the new. In the output file you can see the data from column J (description) in column A (_airbyte_ab_id)
5 Views