Do you add

cdk.context.json

to your git project?

Yeah you should. It will make subsequent builds faster.

Even if there is multiple hostedzonea from multiple developers?