Hi all, I was using Java records as stream items i...
# troubleshooting
є
Hi all, I was using Java records as stream items in my DataStream API job without any issues. Now I am introducing a wrapping class which has a record as a field and I am receiving those errors
Copy code
Caused by: java.lang.IllegalArgumentException: Unable to create serializer "com.esotericsoftware.kryo.serializers.FieldSerializer" for class: XXX
	at com.esotericsoftware.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSerializerFactory.java:48)
	at com.esotericsoftware.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSerializerFactory.java:26)
	at com.esotericsoftware.kryo.Kryo.newDefaultSerializer(Kryo.java:351)
	at com.esotericsoftware.kryo.Kryo.getDefaultSerializer(Kryo.java:344)
	at com.esotericsoftware.kryo.util.DefaultClassResolver.registerImplicit(DefaultClassResolver.java:56)
	at com.esotericsoftware.kryo.Kryo.getRegistration(Kryo.java:461)
	at com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:79)
	at com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:488)
	at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:57)
	... 9 more
Caused by: java.lang.reflect.InvocationTargetException
	at com.esotericsoftware.kryo.factories.ReflectionSerializerFactory.makeSerializer(ReflectionSerializerFactory.java:35)
	... 17 more
Caused by: java.lang.UnsupportedOperationException: can't get field offset on a record class: private final XXX XXX.value
	at jdk.unsupported/sun.misc.Unsafe.objectFieldOffset(Unsafe.java:648)
	at com.esotericsoftware.kryo.serializers.FieldSerializerUnsafeUtilImpl.getObjectFieldOffset(FieldSerializerUnsafeUtilImpl.java:117)
What should I do to fix this ? • Implement custom serializer? I can't find example of custom Kryo serializers, only configuration to enable them. • Should I try to directly use
com.esotericsoftware.kryo.serializers.BeanSerializer
for my class ?
d
Copy code
import com.esotericsoftware.kryo.Kryo;
Copy code
import com.esotericsoftware.kryo.Serializer;
import com.esotericsoftware.kryo.io.Input; import com.esotericsoftware.kryo.io.Output; public class YourWrapperClassSerializer extends SerializerYourWrapperClass { @Override public void write(Kryo kryo, Output output, YourWrapperClass object) { // Serialize fields of YourWrapperClass manually kryo.writeObject(output, object.getField1()); kryo.writeObject(output, object.getRecordField()); // Assuming ‘recordField’ is the Record instance } @Override public YourWrapperClass read(Kryo kryo, Input input, ClassYourWrapperClass type) { // Deserialize fields and construct YourWrapperClass instance FieldType1 field1 = kryo.readObject(input, FieldType1.class); RecordType recordField = kryo.readObject(input, RecordType.class); return new YourWrapperClass(field1, recordField); } } ``````
Something like that is needed
є
thanks
Any idea why plain record works as an stream item withoun any magic ?
d
Not without knowing more about how your record differs. I think its kind of a fallback serializer when others don’t match. So its generic but cannot handle all scenarios.