All how to write schema for date column I have a column wit Apache Pinot #general

Join Slack

@All - how to write schema for date column I have ...

# general

Ravikumar Maddi

03/16/2021, 7:43 AM

@All - how to write schema for date column I have a column with date: "startDate": "2021-01-04 000000" Need help 🙂

Xiang Fu

03/16/2021, 7:53 AM

Can you try something like :

Xiang Fu

03/16/2021, 7:54 AM

"dateTimeFieldSpecs": [{ "name": "startDate", "dataType": "STRING", "format" : "1SECONDSSIMPLE_DATE_FORMAT:yyyy-MM-dd HHmmss", "granularity": "1:DAYS" }]

✅ 1

Xiang Fu

03/16/2021, 7:56 AM

FYI : https://docs.pinot.apache.org/basics/components/schema#date-time-fields

Ravikumar Maddi

03/16/2021, 7:58 AM

Thanks, I have two fields startDate and endDate then. I have to write two times this block of code with name different. am I right?

Ravikumar Maddi

03/16/2021, 2:57 PM

I have three date columns, So, I written like this,

Copy code

"dateTimeFieldSpecs": [
  {
    "name": "_source.startDate",
    "dataType": "STRING",
    "format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd",
    "granularity": "1:DAYS"
  },
  {
    "name": "_source.lastUpdate",
    "dataType": "STRING",
    "format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd HH:mm:ss",
    "granularity": "1:DAYS"
  },
  {
    "name": "_source.sDate",
    "dataType": "STRING",
    "format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd HH:mm:ss",
    "granularity": "1:DAYS"
  }
]

can you please correct. I am getting error {"code":400,"error":"Cannot find valid fieldSpec for timeColumn: timestamp from the table config: eventflow_REALTIME, in the schema: eventflowstats"}

Ravikumar Maddi

03/16/2021, 2:58 PM

Hi Xiang Fu, can you check once

Open in Slack

Previous Next