:wave: Hello, team! I', using the <Debezium format...
# troubleshooting
i
πŸ‘‹ Hello, team! I', using the Debezium format json in a Flink job, but I'm having the following error: "`DateTimeParseException: Text '' could not be parsed at index 0 flink data time zone"`
The synk data is:
Sink schema: [id: STRING, name: STRING, date: TIMESTAMP(6)] and if I use this type of data TIMESTAMP(6)] or TIMESTAMP_LTZ the error is the same.
this is the value to convert :date":{"value":"2024-06-03T124045.246Z","set":true},
any idea about it ?
thanks πŸ™
s
maybe changing this option would help? https://nightlies.apache.org/flink/flink-docs-stable/docs/connectors/table/formats/debezium/#debezium-json-timestamp-format-standard seems like an issue of
β€’ Option
'SQL'
will parse input timestamp in β€œyyyy-MM-dd HHmmss.s{precision}” format, e.g β€˜2020-12-30 121314.123’ and output timestamp in the same format.
which is different from the format you supplied. But then again since your error message says text β€˜β€™, it could also mean your column name is wrong too, or your data ingested is not in the dbz format since the text passed to the formatter is empty
i
Hi Shikai, thanks ! I already tried change this option, I think that the problem is the debezium format, because my json has the following format:
date":{"value":"2024-06-03T12:40:45.246Z","set":true},
and cheking the documentation I think that the format should be
{"date":"2024-06-03T12:40:45.246Z" }
πŸ‘ 1
Just to inform, finally this works changing the debezium parameter to:
πŸ‘ 1
Copy code
props.setProperty("transforms","pgcompatible");
props.setProperty("transforms.pgcompatible.type","io.debezium.connector.yugabytedb.transforms.PGCompatible");
and changing :
β€’ Option
'SQL'
will parse input timestamp in β€œyyyy-MM-dd HHmmss.s{precision}” format, e.g β€˜2020-12-30 121314.123’ and output timestamp in the same format.
to ISO.
so thanks !!!