Needed some help in testing some changes that I made locally Airbyte #ask-community-for-troubleshooting

Needed some help in testing some changes that I ma...

Rahul Padhy

05/20/2021, 9:45 AM

Needed some help in testing some changes that I made locally. So, I’m making some changes in the file airbyte/airbyte-integrations/bases/base-normalization/normalization/transform_catalog/destination_name_transformer.py in the function transform_standard_naming in line number 189, and if I want to debug my changes, so should I go for re-starting the wbe app hosted on docker or just start a new connection sync on the UI?

✅ 1

Davin Chia (Airbyte)

05/20/2021, 9:50 AM

Hi! You need to rebuild the normalisation image and tag it

Davin Chia (Airbyte)

05/20/2021, 9:51 AM

Let me get the command for you

Rahul Padhy

05/20/2021, 9:51 AM

Could you please point me towards the resource wherein the steps are present? 😅

Davin Chia (Airbyte)

05/20/2021, 9:51 AM

./gradlew :airbyte-integrations:bases:base-normalization:build

Davin Chia (Airbyte)

05/20/2021, 9:52 AM

this will generate a new docker image for you (the normalisation image with the

dev

tag was created 5 seconds ago)

Copy code

➜  airbyte git:(davinchia/kube-queueing-poc) ✗ docker images | head -n 10
REPOSITORY                                      TAG             IMAGE ID       CREATED          SIZE
airbyte/normalization                           dev             0644e123ab6a   5 seconds ago    751MB
airbyte/base-airbyte-protocol-python            dev             1918051e44e6   30 seconds ago   162MB
airbyte/source-always-works                     dev             8abae4deccf9   26 minutes ago   171MB
airbyte/integration-base-python                 dev             2ed0ae8f6cbc   27 minutes ago   222MB
<none>                                          <none>          2eb4537d1d39   27 minutes ago   162MB
airbyte/source-postgres                         dev             83fe446fece6   2 hours ago      493MB
<none>                                          <none>          213b8a791353   2 hours ago      751MB
airbyte/server                                  dev             5928167755bd   2 hours ago      626MB
airbyte/base-python-test                        dev             973dbf9ae571   2 hours ago      171MB

Rahul Padhy

05/20/2021, 9:53 AM

So, you mean after making the change, I’ll shut down the airbyte server, execute the above command and then re-start the airbyte server through docker?

Davin Chia (Airbyte)

05/20/2021, 9:53 AM

nope

Davin Chia (Airbyte)

05/20/2021, 9:53 AM

airbyte is using the

base-normalization

image under the hood

Davin Chia (Airbyte)

05/20/2021, 9:53 AM

we want to rebuild an image with your change and tag it with the same version it's using and swap it out

Davin Chia (Airbyte)

05/20/2021, 9:55 AM

Airbyte creates a normalisation runner from this image for every job, so as long as an image with the right tag exists, Airbyte will happily start normalisation

Rahul Padhy

05/20/2021, 9:55 AM

Okay, so while the airbyte server is still running on docker, you want me to goto another tab, execute the above gradlew command and then go back to the tab where the airbyte server is running and then I’d be able to see my changes?

Davin Chia (Airbyte)

05/20/2021, 9:55 AM

the command to tag is

docker tag airbyte/base-normalization:dev airbyte/base-normalization:<version>

Davin Chia (Airbyte)

05/20/2021, 9:56 AM

yeap

Davin Chia (Airbyte)

05/20/2021, 9:57 AM

we can jump on a call if you are free now

Rahul Padhy

05/20/2021, 9:59 AM

Okay sure 🙂

Davin Chia (Airbyte)

05/20/2021, 10:00 AM

https://zoom.us/j/93388486507?pwd=cElORmRWOG5tbThGbmdkcGc1cUZ3Zz09

2 Views

Open in Slack

Previous Next