Hi All, I just commented airbyte metadata column ...
# replication-troubleshooting
r
Hi All, I just commented airbyte metadata column in RootLevelFlatteningSheetGenerator.java in base-java-s3. Then I ran below commands. SUB_BUILD=PLATFORM ./gradlew build VERSION=dev docker-compose up Created a connection between hubspot sounce and s3 destination with RootLevelFlattening for csv. But still I can see airbyte metadata columns in my destination result. I am not sure why changes are not reflecting. Can someone help me.
m
Rahul, Airbyte connectors (mostly) aren’t coupled with the platform. If you change the connector you don’t need to rebuild the platform but you must rebuild the connector. After you run the command:
./gradlew airbyte-integrations:connectors:destination-s3:build
You need to change the version in Airbyte UI settings from the current version to
dev
for Destination S3. With these steps you will run a sync using your changes.
r
Hi @Marcos Marx (Airbyte), I am not making change in connector. I am trying to make a change in bases-java-s3 which is in bases package as mentioned above. That changes are not reflecting if I build the platform. For that what needs be done? is there anything else I need to do so changes in bases package will be reflect?
m
Yes, can you explain your use case more clearly? Because this class is basically used by connectors and not the platform.
r
okay, so basically I don't want airbyte metadata in the the result. So RootLevelFlatteningSheetGenerator.java in base-java-s3 perform that task and I have commented few lines. Now I want to build this base-java-s3 and those changes should reflect in the result. I am not doing any changes inside connector folder, all I am doing changes in bases/base-java-s3/folders. Can you please help
m
But this change will reflect to connectors… you must rebuild the connectors which use the code. The command you used will only build dev version of platform and not connectors.
r
Okay, can you please provide the steps for it?
m
you must run the following command
./gradlew airbyte-integrations:connectors:destination-s3:build
change the destionation for what you’re using
r
okay, so in UI do I need to do any setting changes for this connector build?
m
change to
dev
version.
r
Sorry if you don't mind, can you please tell steps where I need to change dev version?
m
you must change here:
r
Okay, got it. Thank you for the help.
So after building connector, I need to perform below two steps. 1. VERSION=dev docker-compose up 2. Update destionation version in UI. is this correct?
m
only docker-compose up and update the version in UI
r
okay
Thank you
SUB_BUILD=PLATFORM ./gradlew build This is the only command which builds the platform right?
m
Yes, did it work rebuilding the connector?
r
Yes it did. Just a question @Marcos Marx (Airbyte) if I make changes to base-java-s3 folder, do I need to rebuild the platform or connector build is enough. As I can see base-java-s3 is in base folder not in connector folder.
m
only connectors you want to use… and if the connector use the changed code as well
r
Okay