Rajat Sinha
03/15/2025, 11:07 AMPedro Mázala
03/17/2025, 9:12 AMRajat Sinha
03/17/2025, 9:31 AMjava -jar myJarFile.jar
On Mysql I am sending queries based on batches of 500, my java code will wait till it collects the kafka records, if it reaches 500 OR 2 second Timeout. Then creating the query and sending it to Mysql using JDBC connectionPedro Mázala
03/18/2025, 9:10 AMSo, right now I am running my java jars directly on the server using command:
I'd suggest you check how Flink standalone works. Running Flink like this you lose a ton of it's capabilities.Copy codejava -jar myJarFile.jar
Back pressure of the source is realtime kafka topic that has 1 partition.Any reason on the single partition? Are you using Flink AsyncIO features to run the queries?
Rajat Sinha
03/18/2025, 1:13 PMRajat Sinha
03/18/2025, 1:14 PMPedro Mázala
03/18/2025, 1:30 PMRajat Sinha
03/19/2025, 2:50 PM