Apollo Elon
06/18/2025, 4:05 PMKafkaSourceBuilder<RichCdcMultiplexRecord> kafkaSourceBuilder = KafkaSource.builder();
kafkaSourceBuilder.setTopics(Context.KafkaOptions.topic)
.setBootstrapServers(Context.KafkaOptions.bootstrapServer)
.setStartingOffsets(OffsetsInitializer.earliest())
.setValueOnlyDeserializer(new RichCdcMultiplexRecordDeserializer())
.setGroupId(Context.KafkaOptions.groupId);
public class RichCdcMultiplexRecordDeserializer
implements DeserializationSchema<RichCdcMultiplexRecord> {
@Override
public RichCdcMultiplexRecord deserialize(byte[] message) throws IOException {
RichCdcMultiplexRecord richCdcMultiplexRecord = RichCdcMultiplexRecordDeserializer.deserializeForValue(message);
return richCdcMultiplexRecord;
}
@Override
public boolean isEndOfStream(RichCdcMultiplexRecord nextElement) {
return false;
}
@Override
public TypeInformation<RichCdcMultiplexRecord> getProducedType() {
return TypeInformation.of(RichCdcMultiplexRecord.class);
}
public static RichCdcMultiplexRecord deserializeForValue(byte[] value) {
return KryoSerializerUtil.deserialize(value, RichCdcMultiplexRecord.class);
}
}
I'm sure the Value of the data in Kafka is in the RichCdcMultiplexRecord format. The data has been read from Kafka because the serialization method debug has observed it. However, there was a problem when writing to the next operator. Thank you all!!!