When doing upsert, can the table's time column be ...
# generalj
Josh Highley
04/22/2021, 5:25 PMWhen doing upsert, can the table's time column be a string or does it have to be a long?
y
Yupeng Fu
04/22/2021, 5:29 PMit has to be the time column of the table for now
Yupeng Fu
04/22/2021, 5:30 PMso needs to be long
j
Josh Highley
04/22/2021, 5:31 PMah, so time column can't be a string?
"format":"1MILLISECONDSSIMPLE_DATE_FORMAT:EE,dd MMM yyyy HHmmss.SSS"
y
Yupeng Fu
04/22/2021, 5:33 PMyeah, it can be converted during ingestion
Yupeng Fu
04/22/2021, 5:33 PMj
Josh Highley
04/22/2021, 5:35 PMI can't use simple_data_format with LONG, though, correct? I believe I tried that and it wouldn't convert
Josh Highley
04/22/2021, 5:36 PMI'd have to use a transformFunction, correct?
j
Jackie
04/22/2021, 5:52 PMCurrently we don't support SDF string as the upsert time values, but that is doable. Can you please submit a github issue for this?
Jackie
04/22/2021, 5:53 PMFor now, you have to use transform to convert the values to long