Hi ! Do someone know what's the use of the NEED_ST...
# replication-troubleshooting
f
Hi ! Do someone know what's the use of the NEED_STATE_VALIDATION env. variable ? And what's going on if i set it to false ?
✍️ 1
u
@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2730 to ensure timely resolution!
🙏 1
s
Hey @Florian Melki, can you share a link to where you’ve found this variable in the code base?
f
sure : 2022-10-11 083925 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):50 - Using default value for environment variable NEED_STATE_VALIDATION: 'true'
s
Hey @Florian Melki, sorry for the delay with this. I tried to find this variable in our codebase and found it here in the airbyte-commons directory of our mono repo: https://github.com/airbytehq/airbyte/blob/master/airbyte-commons/src/main/java/io/airbyte/commons/features/EnvVariableFeatureFlags.java#L15 It seems like this is a feature for some JDBC connectors as far as it why it breaks some of your connections, I’m not entirely sure. I saw the issue you raised on Github, hopefully a member of our team will address it.
f
hi @Saj Dider (Airbyte) Actually I crawled the source code by myself and found that this variable is used somewhere else to check something on the State. It might have been implemented between v0.49 and v.040, but not 100%. I bypassed the test by setting the env. variable to False
s
Hey @Florian Melki, thanks for looking into it. Out of curiosity, could you share where you found the variable being used? Tried looking for other places but couldn’t find it.
f
Sure. In
EnvVariableFeatureFlags.java
you got a function called
needStateValidation()
that is called from
PersistStateActivityImpl.java
where my error occurred
and the
needStateValidation()
returns the
NEED_STATE_VALIDATION
. All simply 🙂
s
Thanks for the clarification, I must have missed the PersistStateActivityImpl file. Feel free to post more questions here in the channel!
1