Hi all, what is the best way to implement testing ...
# troubleshooting
e
Hi all, what is the best way to implement testing for Flink? Need to simulate a stream producer with some dummy data, send to local Flink cluster and assert the output with expected result. is it a good idea to use https://testcontainers.com/?
n
we use testcontainers for our integration tests. The job I'm working on now does Kafka -> Flink -> Delta
e
Nice, do you know any public repo I could check out that uses testcontainers to test Flink?
n
I don't no πŸ˜• I was thinking of doing something like that in the near future
e
No problem, thanks a lot for your help πŸ™
y
Hi Enrique, Flink CDC project maintains quite a few connectors and requires running E2E tests on various Flink versions with virtualized containers. You might be interested in its implementation here: https://github.com/apache/flink-cdc/blob/master/flink-cdc-e2e-tests/flink-cdc-source-e2e-tests/src/test/java/org/apache/flink/cdc/connectors/tests/utils/FlinkContainerTestEnvironment.java
e
Thanks a lot for you recommendation @yux