Does anyone knows where Kryo serializer is taking ...
# troubleshooting
u
Does anyone knows where Kryo serializer is taking so much time for serialization float[][] matrices?
k
Are you getting any complaints about the multidimensional array not being POJO-compliant?
If so, you can get around it by changing your matrix to something that implements
org.apache.flink.types.Value
and write a simple serdes for them. I've had OOM improvements when I did this for
LocalDate
.
u
And do you think implementing the Value for my pojo (includes List of 1000 matrices of 401x401) will be faster then Kryo serializer?
a
u
Thanks! In my case it is using Kryo as fallback, you have idea why it is taking so much time after my join?
Value
will work better?