Shadab Anwar
02/16/2022, 7:10 PMMohemmad Zaid Khan
02/17/2022, 7:11 AMtoString()
, A different hashCode is being generated for same value when segment pruning is done by PartitionSegmentPruner because it always call toString on literal value before invoking getPartitionId.Pavel Stejskal
02/17/2022, 10:39 AMWeixiang Sun
02/18/2022, 9:28 PMTrust Okoroego
02/21/2022, 9:46 AMMinglei Zhang
02/21/2022, 12:44 PMDan DC
02/21/2022, 1:06 PMChengxuan Wang
02/22/2022, 4:29 AMst_setsrid
like function in crdb to change the spatial reference system?Prashant Pandey
02/22/2022, 6:14 AMRealtimeProvisioningHelper -tableConfigFile /Users/prashant.pandey/table_config.json -numPartitions 4 -pushFrequency null -numHosts 12 -numHours 2 -sampleCompletedSegmentDir /Users/prashant.pandey/segment_dir -ingestionRate 4750 -maxUsableHostMemory 10G -retentionHours 24
The segment is around 426M in size. But this returns the following:
Note:
* Table retention and push frequency ignored for determining retentionHours since it is specified in command
* See <https://docs.pinot.apache.org/operators/operating-pinot/tuning/realtime>
2022/02/22 11:41:31.825 INFO [RealtimeProvisioningHelperCommand] [main]
Memory used per host (Active/Mapped)
numHosts --> 12 |
numHours
2 --------> NA |
2022/02/22 11:41:31.826 INFO [RealtimeProvisioningHelperCommand] [main]
Optimal segment size
numHosts --> 12 |
numHours
2 --------> NA |
2022/02/22 11:41:31.826 INFO [RealtimeProvisioningHelperCommand] [main]
Consuming memory
numHosts --> 12 |
numHours
2 --------> NA |
2022/02/22 11:41:31.827 INFO [RealtimeProvisioningHelperCommand] [main]
Total number of segments queried per host (for all partitions)
numHosts --> 12 |
numHours
2 --------> NA |
Class transformation time: 0.271994872s for 4134 classes or 6.579459893565553E-5s per class
Why am I getting N/A
s? Is the config incorrect?Ali Atıl
02/22/2022, 7:49 AMKISHORE B R
02/22/2022, 12:52 PMKarin Wolok
Karin Wolok
Tiger Zhao
02/22/2022, 8:43 PMKISHORE B R
02/23/2022, 2:08 PMsunny
02/25/2022, 3:15 AMkaivalya apte
02/25/2022, 10:34 AMDan DC
02/28/2022, 12:37 PMSaravanan Arumugam
03/01/2022, 5:31 PMJaromir Hamala
03/02/2022, 8:10 AMAyush Kumar Jha
03/03/2022, 5:55 AMShadab Anwar
03/03/2022, 9:21 AMLakshmanan Velusamy
03/03/2022, 9:56 PMDiana Arnos
03/04/2022, 9:45 AMChengxuan Wang
03/04/2022, 2:12 PMnumEntriesScannedInFilter
. is high (equals to the number of docs). the pinot version is 0.8.0
.
the query is
select count(*) from some_table where st_distance(resto_st_point, st_point(116.459717 , 39.955734, 1)) < 3000
the table config is
"fieldConfigList": [
{
"name": "resto_st_point",
"encodingType": "RAW",
"indexType": "H3",
"properties": {
"resolutions": "12"
}
}
],
.....
"noDictionaryColumns": [
"resto_st_point"
],
and if i change the threshold to 300 (meters), the index hits.Chengxuan Wang
03/04/2022, 4:26 PMST_Distance
can take advantage of h3 index, how about ST_Contains
?Weixiang Sun
03/04/2022, 7:08 PMKarin Wolok
Monica
03/09/2022, 4:21 AMWeixiang Sun
03/09/2022, 6:27 AM