Star tree indexing has to be generated at index ge...
# generalm
Mayank
02/26/2020, 11:14 PM
Star tree indexing has to be generated at index generation time, and cannot be dynamically created at load time (unlike inverted index), currently.
h
Harshini Elath
02/27/2020, 4:45 PMIs there a way to check if the inverted index has been applied to the pre-loaded segments ?
Harshini Elath
02/27/2020, 4:46 PMWe apply index for some columns but couldn't find anything in server or controller logs. Also; there wasn't much improvement in query performance.
m
Mayank
02/27/2020, 4:47 PM
Do you have access to segment dir?
h
Harshini Elath
02/27/2020, 4:47 PMyes
m
Mayank
02/27/2020, 4:47 PM
Or the server log should state it is building Inv index
Mayank
02/27/2020, 4:48 PM
Check Index_map file which shows offset of all indices
h
Harshini Elath
02/27/2020, 4:49 PMwhere can i find index_map file ?
m
Mayank
02/27/2020, 4:52 PM
Inside segment dir in server
h
Harshini Elath
02/27/2020, 5:12 PMthere was no inverted index in the file. it had the default forward index offset
Harshini Elath
02/27/2020, 5:12 PMthis is the table config used
Harshini Elath
02/27/2020, 5:12 PM Copy code
{
"OFFLINE": {
"tableName": "iw_audit_OFFLINE",
"tableType": "OFFLINE",
"segmentsConfig": {
"segmentAssignmentStrategy": "BalanceNumSegmentAssignmentStrategy",
"retentionTimeUnit": null,
"retentionTimeValue": null,
"segmentPushFrequency": null,
"segmentPushType": "APPEND",
"replicaGroupStrategyConfig": null,
"completionConfig": null,
"hllConfig": null,
"timeType": "DAYS",
"timeColumnName": "audit_date",
"schemaName": "iw_audit",
"replication": "2",
"replicasPerPartition": null
},
"tenants": {
"broker": "DefaultTenant",
"server": "DefaultTenant",
"tagOverrideConfig": null
},
"tableIndexConfig": {
"invertedIndexColumns": [
"str_num"
],
"autoGeneratedInvertedIndex": false,
"createInvertedIndexDuringSegmentGeneration": false,
"sortedColumn": [],
"bloomFilterColumns": [],
"loadMode": "MMAP",
"streamConfigs": {},
"segmentFormatVersion": null,
"columnMinMaxValueGeneratorMode": null,
"noDictionaryColumns": null,
"noDictionaryConfig": null,
"onHeapDictionaryColumns": null,
"starTreeIndexSpec": null,
"starTreeIndexConfigs": null,
"segmentPartitionConfig": null,
"aggregateMetrics": false,
"varLengthDictionaryColumns": null,
"nullHandlingEnabled": false
},
"metadata": {
"customConfigs": null
}
}
}Harshini Elath
02/27/2020, 5:13 PM"tableIndexConfig": {
"invertedIndexColumns": [
"str_num"
],
Any error here ?
m
Mayank
02/27/2020, 5:20 PM
I suspect
"autoGeneratedInvertedIndex": false,Mayank
02/27/2020, 5:23 PM
actually, nm. will look at the code at get back
h
Harshini Elath
02/27/2020, 5:28 PMWe tried to call 'Reload all segments' api
Harshini Elath
02/27/2020, 5:29 PMi see inverted index now in index_map
m
Mayank
02/27/2020, 5:29 PM
oh ok
Mayank
02/27/2020, 5:29 PM
previously you just updated the table config?
Mayank
02/27/2020, 5:29 PM
if so, that does not trigger reload
h
Harshini Elath
02/27/2020, 5:30 PMi called 'Rebalance API'
Harshini Elath
02/27/2020, 5:30 PMbefore after update table config
m
Mayank
02/27/2020, 5:30 PM
I see
Mayank
02/27/2020, 5:30 PM
reload api is the right one
h
Harshini Elath
02/27/2020, 5:30 PMgot it
Harshini Elath
02/27/2020, 5:30 PMthanks