Hi, Is there a way to configure the key group cardinality for an operator substate when taking a savepoint?
g
Gyula Fóra
11/17/2022, 7:10 AM
you have to set this before you start the job by setting the max_parallelism of the pipeline
Gyula Fóra
11/17/2022, 7:10 AM
maxParallelism defines the number of keygroups that will be managed
j
Joris Basiglio
11/17/2022, 2:26 PM
Ah, I didn’t know it was bound to that property. But thinking of it, it makes sense now.
But now that it has already been set for my job, I’m kind of stuck with it right? (Unless I play with the state processing API to re shuffle my save point)
g
Gyula Fóra
11/17/2022, 2:53 PM
yes, you cannot change this normally for existing checkpoints