Hi Team, I have an etl pipeline from postgresql to...
# general
y
Hi Team, I have an etl pipeline from postgresql to pinot using debezium, for a field "amount" type used is BigDecimal and debezium converts this type to byte array by default, in pinot side I set the type BYTES and wrote this
Copy code
"ingestionConfig": {
  "transformConfigs": [
    {
      "columnName": "amount_updated",
      "transformFunction": "bytesToBigDecimal(amount)"
    }
  ]
},
but the result is something like that , can anyone help me on what ı am doing wrong, thank you.
r
after the transform is run, a data type transformer is run to convert it to your output pinot type which is bytes From the code, it's casting the big decimal value to a byte array
h
Hi Yener, Pinot support bigdecimal. Is it possible to check the debezium config in regards to handling bigdecimal? https://debezium.io/documentation/reference/stable/connectors/postgresql.html
y
thank you, ı will investigate more