it has to be a new name, you cannot transform a co...
# getting-startedn
Neha Pawar
10/08/2021, 8:22 PM
it has to be a new name, you cannot transform a column and put it into the same name
👍 1
k
Kamal Chavda
10/08/2021, 8:53 PMfollow-up on this. I'm reading from a kafka topic which has dates as EPOCH. I want to load as TIMESTAMP in my Pinot realtime table. Do I have to use a transformfunction and load as a new column? @User
n
Neha Pawar
10/08/2021, 8:54 PM
when you say EPOCH, is it millisSinceEpoch? and what is the format of TIMESTAMP?
k
Kamal Chavda
10/08/2021, 9:17 PMI'm using debezium and using the time.precision.mode = connect so it's in millisSinceEpoch. Would like to load it as yyyy-MM-dd HHmmss' (ex:2019-07-02 122104).
n
Neha Pawar
10/09/2021, 3:46 AM
In that case you'll have to use transform function toDateTime
k
Kamal Chavda
10/11/2021, 3:52 PMThanks Neha. I'll add a new column and use the transform function.
Kamal Chavda
10/12/2021, 10:01 PMI actually did not have to use the transform function. I just changed my schema datetimefieldspecs datatype from long to timestamp and the dates converted to yyyy-MM-dd HHmmss automatically.
Copy code
{
"name": "created_at",
"dataType": "TIMESTAMP",
"format" : "1:MILLISECONDS:TIMESTAMP",
"granularity": "1:MILLISECONDS"
}, Copy code
{
"name": "created_at",
"dataType": "LONG",
"format": "1:MILLISECONDS:EPOCH",
"granularity": "1:MILLISECONDS"
}