hey folks - i’ve two fields that are epoch with second granularity at input time. I have them configured as such:

"dateTimeFieldSpecs": [
    {
      "name": "start",
      "dataType": "LONG",
      "format": "1:SECONDS:EPOCH",
      "granularity": "1:SECONDS"
    },
    {
      "name": "end",
      "dataType": "LONG",
      "format": "1:SECONDS:EPOCH",
      "granularity": "1:SECONDS"
    }
  ]

but am now thinking they should be TIMESTAMP dataType? I’m not clear on the implications. We will be doing sum aggregations based groupings of like minute/hour/day/etc. thanks in advance

Will you query at second granularity? If not, pick the coarsest granularity that you will query (to allow pre-aggregation, and reduce cardinality). From perf perspective TIMESTAMP and long are the same (former will store it as long internally).

Thank Mayank. It may be we do query at a second granularity, but I will double check. I was wondering if we should use TIMESTAMP as it seems there will be a Tiemstamp Index available in .11 that allows for some nice pre-aggregations?

Yes you can use that