Peter Corless
01/06/2025, 4:06 PMKasinath Reddy
01/22/2025, 5:45 PMKasinath Reddy
01/22/2025, 5:46 PMFasih Khatib
01/23/2025, 9:43 AMcreated_at is a TIMESTAMP column without timezone. In the JSON that's generated by Debezium, it's emitted as milliseconds since epoch. I use this to specify the timeColumnName for my table's configuration. Additionally, I use it to create a range index which can be used to efficiently filter slices of time. For example, when using the ago function.Fasih Khatib
01/23/2025, 9:44 AMtime -based pruning can happen using the column specified in the timeColumnName. Relevant docs here. https://docs.pinot.apache.org/configuration-reference/table#routingFasih Khatib
01/23/2025, 9:45 AMKasinath Reddy
01/23/2025, 9:54 AMKasinath Reddy
01/23/2025, 9:55 AMFasih Khatib
01/23/2025, 9:56 AMKasinath Reddy
01/23/2025, 10:02 AMFasih Khatib
01/23/2025, 10:08 AMtimeType is a number so my understanding is that you'd need it as an epoch. https://docs.pinot.apache.org/configuration-reference/table#real-time-tableKasinath Reddy
01/23/2025, 6:11 PMKasinath Reddy
01/23/2025, 6:11 PMThe name of the time column for this table. This must match with the time column name in the schema. This is mandatory for tables with push type APPEND, optional for REFRESH. timeColumnName along with timeColumnType is used to manage segment retention and time boundary for offline vs real-time.Kasinath Reddy
01/23/2025, 6:11 PMFasih Khatib
01/24/2025, 7:44 AM"segmentsConfig": {
"timeColumnName": "daysSinceEpoch",
"timeType": "DAYS",
This indicates that time column daysSinceEpoch is numeric.