Hi All, Can someone help me out which class/file is responsible to create csv file in destination in airbyte code. I just want to understand how airbyte is doing it.

@Rahul Borse you will find everything in airbyte-integrations here https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-csv

Hi @Siddhant Singh, Thanks for the quick response. Can you help me with class/file which is used for sync.

@Rahul Borse There are different syncs which airbyte do. Which one you want?

Okay let me tell you the context. From hubspot we are getting data into s3 destination in csv format when we do manual sync, but in that csv format few column values are in nested json which has other properties. now we don't these nested json, instead we want columns for those properties. We want to change out logic accordingly. @Siddhant Singh let me know what are necessary steps required for this.

@Rahul Borse Can you show us the code what you're trying to do?

Hi @Siddhant Singh, I have not started the coding but as I mentioned while manual sync to s3 destination we want to transform few data which is like if from hubspot source we get data for a column as a nested json eg. Please check attached screenshot of hubspot data from source, here we can see column name "properties" has a value which is nested json. Now we don't want these nested json in csv, instead we want to have a column for each field for that nested json. I am trying to find out the solution for the same and from where to start in airbyte code. I hope you understood the problem statement. Let me know if you need more information

What do you mean by manual sync? What is your source?

@Siddhant Singh Source is hubspot, destination is S3... Manual sync I mean whenever I am clicking on sync option in airbyte.

@Rahul Borse can you try to run basic normalization?

Hello Rahul Borse, it's been a while without an update from us. Are you still having problems or did you find a solution?