Apache Pinot

Hi <@U019P6RD5C5>, based on the exception, I think the time column is not configured correctly

Can you please share the table config and the schema?

```{
    "schemaName":"motion",
    "dimensionFieldSpecs":[
       {
          "name":"sensor_id",
          "dataType":"STRING"
       },
       {
          "name":"config_details",
          "dataType":"STRING"
       },
       {
          "name":"has_motion",
          "dataType":"BOOLEAN"
       }
    ],
    "metricFieldSpecs":[
    ],
    "dateTimeFieldSpecs":[
       {
          "name":"time_stamp",
          "dataType":"LONG",
          "format":"1:MILLISECONDS:EPOCH",
          "granularity":"1:MILLISECONDS"
       }
    ]
}```

```{
    "tableName":"motion",
    "tableType":"REALTIME",
    "segmentsConfig":{
       "timeColumnName":"timestampInEpoch",
       "timeType":"MILLISECONDS",
       "schemaName":"motion",
       "replicasPerPartition":"1"
    },
    "tenants":{

    },
    "tableIndexConfig":{
       "loadMode":"MMAP",
       "streamConfigs":{
          "streamType":"kafka",
          "stream.kafka.consumer.type":"lowlevel",
          "stream.kafka.topic.name":"ash-logger.etldb.derived.motion",
          "stream.kafka.decoder.class.name":"org.apache.pinot.plugin.stream.kafka.KafkaJSONMessageDecoder",
          "stream.kafka.consumer.factory.class.name":"org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory",
          "stream.kafka.broker.list":"kafka-dev-1-kafka-bootstrap.kafka-dev-1:9092",
          "realtime.segment.flush.threshold.time":"3600000",
          "realtime.segment.flush.threshold.size":"50000",
          "stream.kafka.consumer.prop.auto.offset.reset":"smallest"
       }
    },
    "metadata":{
       "customConfigs":{

       }
    }
 }```

an example value for `time_stamp` is `1599000470000`

ooh i think i screwed up in `timeColumnName` for config

i just copy pasted this config from the example

sorry to bother; i will correct and retry and report back

quick question. i used `pinot-admin.sh` to create this table. how would i go about dropping it and recreating it with the proper config?

you can drop using swagger APIs. if you go to localhost:9000 you should see this option

i do see some `2020/09/01 23:09:14.532 WARN [TopStateHandoffReportStage] [HelixController-pipeline-default-pinot-(d1b54062_DEFAULT)] Event d1b54062_DEFAULT : Cannot confirm top state missing start time. Use the current system time as the start time.`

<@U019P6RD5C5> This warning is from Helix, which you can ignore

image.png

i don’t know what to make of the segments marked bad

Hi, fyi with the latest master, swagger endpoint seems to be broken. Not sure if anyone noticed

<@U0152KZ970V> are you using the latest code?

I wanted to try out some feature on master

Can I see which commit you are using as the latest commit?

<https://github.com/apache/incubator-pinot/commit/032a7bf7f15c0361ad2a23d35a223a963d94b99f>