Diogo Baeder
11/12/2021, 6:31 PMTIMESTAMP
type something that will stay in Pinot? Because @User gave me a nice hint about that but we don't see that in the docs, so I'm unsure whether I can safely use it and know that it won't get removed on future Pinot versionsNeha Pawar
Diogo Baeder
11/12/2021, 6:34 PMNeha Pawar
Diogo Baeder
11/12/2021, 6:37 PM2020-04-04 00:00:00 UTC
, as a string, and it's not saving on PinotNeha Pawar
"dateTimeFieldSpecs": [
{
"name": "time_col_name",
"dataType": "STRING",
"format": "1:MILLISECONDS:SIMPLE_DATE_FORMAT:yyyyMMdd HH:mm:ss z",
"granularity": "1:MILLISECONDS"
}
]
https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.htmlDiogo Baeder
11/12/2021, 8:21 PMTIMESTAMP
, am I wrong?Neha Pawar
2020-04-04 00:00:00 UTC
string also work for TIMESTAMP
?Jackie
11/12/2021, 9:40 PMUTC
Neha Pawar
yyyyMMdd HH:mm:ss
and epoch millis
that can use TIMESTAMP
?Jackie
11/12/2021, 9:40 PMTIMESTAMP
format would be yyyy-MM-dd HH:mm:ss.SSS
Diogo Baeder
11/12/2021, 9:40 PM2020-04-04 00:00:00
then? And in terms of performance, how does that compare to using SIMPLE_DATE_FORMAT
with a date-time format?TIMESTAMP
vs STRING
, would there be a significant performance difference?Jackie
11/12/2021, 9:41 PMTIMESTAMP
is stored as long (millis since epoch), so it has better performance than stringDiogo Baeder
11/12/2021, 9:42 PMJackie
11/12/2021, 9:42 PMDiogo Baeder
11/12/2021, 9:42 PM"2020-01-01 00:00:00.000"
, instead of just the string with the datetime format. No big deal really, just a strange difference I found compared to when I was using SIMPLE_DATE_FORMAT
earlier today.
Thanks a lot, have a great weekend, folks!