I'm trying to run migrations but can't seem to pass arguments to the main class - I know am doing something wrong. I'm running:

./gradlew :airbyte-migration:run --target-version=0.17.0

@Samuel Gordalina the migration is typically run from docker as demonstrated in this tutorial https://docs.airbyte.io/tutorials/upgrading-airbyte

does this help with the issue?

I'm writing my own migration, let me try building the docker image. This is super helpful, thank you

When i run build, i see a bunch of stuff in the

build

folder, but not a docker image. I'm not sure how to build it. (I'm a java noob)

Samuel did you figure this out?

I wasn't.

I ended up creating a test for the migration, but couldn't really test it with local data

I see. You can pass args into as such

./gradlew :airbyte-migration:run --args="--target-version=0.17.0 --output=/tmp --input=/tmp"

(my paths aren’t right)

although I’m not sure I understand what you are trying to do - like Sherif pointed out, we usually run migrations in Docker. do you mind restating what you are trying to do for me?

Absolutely. I'm adding workspace creation/deletion (code is here: https://github.com/airbytehq/airbyte/pull/2325) and that required me to add

tombstone

to the workspace definition. That requires me to write a migration (which i have) to migrate the default airbyte workspace to have tombtstone set to false.

I think my main issue is that I could find a way to build the migrations docker image to test

I was able to test with your command and it worked 🙂 thank you

Thanks for the concise summary! Glad I was able to help!

if you are wondering about Docker, I believe something like

./gradlew :composeBuild

will build all the relevant Docker images.

$ ./gradlew :composeBuild
> Task :composeBuild
The GIT_REVISION variable is not set. Defaulting to a blank string.
Building init      ... done
Building db        ... done
Building seed      ... done
Building scheduler ... done
Building server    ... done
Building webapp    ... done
Building migration ... done

we can check this via:

$ docker images
REPOSITORY                               TAG            IMAGE ID       CREATED             SIZE
airbyte/scheduler                        dev            ff66289384e8   3 seconds ago       1.01GB
airbyte/server                           dev            a17366c4fd42   3 seconds ago       596MB
airbyte/migration                        dev            abcfe3536b90   26 seconds ago      436MB

(the migration image was recently generated)

Oh, I see! I'll test now

I think my lack of knowledge of the java ecosystem didn't help

👍 can confirm it worked, thank you all for helping