hi team I am new to Airbyte and was trying to modify an exis Airbyte #help-connector-development

hi team, I am new to Airbyte and was trying to mod...

Mayur Choubey

04/28/2023, 8:11 AM

hi team, I am new to Airbyte and was trying to modify an existing connector. I just made changes in spec file to see if those are reflected on UI or not. Ran below commands -

Copy code

./gradlew :airbyte-integrations:connectors:destination-iceberg:build
./gradlew :airbyte-integrations:connectors:destination-iceberg:airbyteDocker
docker run --rm airbyte/destination-iceberg:dev spec

in the output of the last command I can see the test changes I made on UI (just change of titles).

kapa.ai

04/28/2023, 8:11 AM

A message from kapa.ai

kapa.ai

04/28/2023, 8:11 AM

To see the changes you made in the connector reflected in the Airbyte UI, you need to update the connector version in the UI. Follow these steps: 1. Build the connector with your changes using the following command:

Copy code

./gradlew :airbyte-integrations:connectors:destination-iceberg:build

2. Start your Airbyte instance with the

VERSION=dev

flag:

Copy code

VERSION=dev docker-compose up

3. Go to the Airbyte UI, navigate to the Admin section, and find the connector you modified (destination-iceberg). 4. Update the version of the connector to

dev

. This will clear the cache and make the UI pick up your changes. Please note that each time you make changes to your implementation, you need to rebuild the connector image and update the version in the UI. For more information, refer to this [Slack conversation](https://airbytehq.slack.com/archives/C021JANJ6TY/p1669029239763219) and the [documentation on developing locally](https://docs.airbyte.com/contributing-to-airbyte/developing-locally).

Mayur Choubey

04/28/2023, 8:19 AM

but I am using run-ab-platform.sh

Joe Reuter (Airbyte)

04/28/2023, 9:02 AM

Are you using the

dev

image of the connector or the latest released version? If you go to settings > destinations you should see the used version:

Joe Reuter (Airbyte)

04/28/2023, 9:03 AM

For me it will use the

0.1.0

version of the image, you need to change that to

dev

so it will pick up your changes

Mayur Choubey

04/28/2023, 10:07 AM

yes, did that it's reflecting the changes now on UI

Mayur Choubey

04/28/2023, 10:08 AM

anything else which I need to consider... since I will now be changing the connector code...

Mayur Choubey

04/28/2023, 10:08 AM

thanks

Joe Reuter (Airbyte)

04/28/2023, 10:20 AM

no, you should be good

Joe Reuter (Airbyte)

04/28/2023, 10:20 AM

running the build command again will replace the

dev

image, so running a build, then running a sync should pick up the changes

Joe Reuter (Airbyte)

04/28/2023, 10:20 AM

ah, no there is actually one thing

Joe Reuter (Airbyte)

04/28/2023, 10:21 AM

the spec is cached, so if you change the spec, then you need to do the following:

Joe Reuter (Airbyte)

04/28/2023, 10:21 AM

• run build • Go to settings > preferences • Switch version back to 0.1.0 • Switch version to dev again (this will run the spec command again)

Joe Reuter (Airbyte)

04/28/2023, 10:22 AM

but for changes to the implementation you can just run another sync

Mayur Choubey

04/28/2023, 11:10 AM

thanks Joe

Mayur Choubey

04/28/2023, 11:10 AM

not sure what's sync ?

Joe Reuter (Airbyte)

04/28/2023, 11:31 AM

I meant running a replication for a connection

Mayur Choubey

04/28/2023, 11:47 AM

u mean this command "`./gradlew airbyte integrationsconnectorsdestination icebergairbyteDocker"`

Joe Reuter (Airbyte)

04/28/2023, 11:48 AM

No I meant going to the UI and actually running the connector

Mayur Choubey

04/28/2023, 11:48 AM

ok ok got it thanks

Open in Slack

Previous Next