Qn on schema, how can I have a datetimefield as a metric I.e. published time. It looks like RealTimeToOffline roll up will think all date time columns are dimensions and wont aggregate across digfferent received timestamps. Would be better if rollup/dedup just used the tables primaryKey field list.

What aggregation are you expecting on that metric?

max value / last (would need implementing)

time columns are special in Pinot. If you really want to aggregate you may create another derived column that is not marked as datetimefield?

yeah think simplest would be change the schema and store the long time values as metrics