Deepak Kumar Mishra
03/16/2021, 4:07 AMRavikumar Maddi
03/16/2021, 6:11 AM{
"name": "madIds",
"datatype": "INT",
"delimiter":",",
"singleValueField":false
},
Ravikumar Maddi
03/16/2021, 7:43 AMRavikumar Maddi
03/16/2021, 7:50 AMVibhor Jain
03/16/2021, 8:39 AMRavikumar Maddi
03/16/2021, 2:59 PM"dateTimeFieldSpecs": [
{
"name": "_source.startDate",
"dataType": "STRING",
"format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd",
"granularity": "1:DAYS"
},
{
"name": "_source.lastUpdate",
"dataType": "STRING",
"format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd HH:mm:ss",
"granularity": "1:DAYS"
},
{
"name": "_source.sDate",
"dataType": "STRING",
"format": "1:SECONDS:SIMPLE_DATE_FORMAT:yyyy-MM-dd HH:mm:ss",
"granularity": "1:DAYS"
}
]
can you please correct.
I am getting error
{
"code": 400,
"error": "Cannot find valid fieldSpec for timeColumn: timestamp from the table config: eventflow_REALTIME, in the schema: eventflowstats"
}
Need your help 🙂Karin Wolok
Ron Kitay
03/16/2021, 5:12 PMPinot
support out-of-the-box? I’m guessing String
, numerics (integers and floating points), date
and boolean
- are there any others supported? For example - ip-address
?Ron Kitay
03/16/2021, 5:19 PMPinot
? Our average records are about 6KB when stored in AVRO
, but can reach up to ~50K in edge casesChad Preisler
03/17/2021, 2:40 AMChad Preisler
03/17/2021, 2:46 AMtroywinter
03/17/2021, 5:52 AMRonak
03/17/2021, 4:18 PMindex type: Text
and encoding type: RAW
) on the column and doing TEXT_MATCH, I was first getting an empty result, but after some time, I was getting the result. So, what is the initial delay for such a column to be searchable? Is any settings/configuration (e.g num of docs, indexed size, etc) for the same?Brian Olsen
03/17/2021, 5:00 PMBrian Olsen
03/17/2021, 7:19 PMRavikumar Maddi
03/18/2021, 2:07 PMJosh Highley
03/18/2021, 4:58 PMKen Krugler
03/19/2021, 5:59 PMAaron Wishnick
03/19/2021, 6:33 PMKen Krugler
03/19/2021, 7:16 PMOguzhan Mangir
03/20/2021, 3:52 PMOguzhan Mangir
03/21/2021, 10:22 AMaggregateMetrics
to pre-aggregation as it is consumed, pinot aggregates data based on fields which defined in dimensionFieldSpecs
and dateTimeFieldSpecs
. Can pinot aggregates data only based on fields which defined in dimensionFieldSpecs
while applying pre-aggregation using aggregateMetrics?
The second question;
We can set time to generate segments for real-time table using realtime.segment.flush.threshold.time
config. Let's assume current hour is 10:25. When i set realtime.segment.flush.threshold.time
to 1 hour
, pinot creates segment with startTime 10:25, and it will close this segment when time is 11:25. As a result, start/end time of that segment is 1025 1125. But when the new hour starts, I want pinot to close segment.. Start/end time of that segment should be 1000 1100. How can i achieve that?Dan Hill
03/22/2021, 3:14 AMRavikumar Maddi
03/22/2021, 6:58 AMKarin Wolok
virtualandy
03/23/2021, 4:20 AMKarin Wolok
Charles
03/25/2021, 10:10 AMOguzhan Mangir
03/25/2021, 10:46 AMCharles
03/26/2021, 12:42 AM