```protected IntermediateResultsBlock getNextBlock lt here `

Question

```protected IntermediateResultsBlock getNextBlock lt here ```

Sidd · Answer

You said indexedTable finish was throwing NPE

Sidd · Answer

So my suggestion is to put breakpoint inside the function and step through it

Damiano · Answer

yes that call is inside getNextBlock

Sidd · Answer

yes so what happens when you go inside finish

Damiano · Answer

the problem is not the finish method is indexedTable that is null

Sidd · Answer

Why is the indexedTable not getting initialized in this code

Sidd · Answer

``` initLock lock try if dataSchema == null dataSchema = intermediateResultsBlock getDataSchema indexedTable = new ConcurrentIndexedTable dataSchema brokerRequest getAggregationsInfo brokerRequest getOrderBy indexedTableCapacity finally initLock unlock ```

Damiano · Answer

yeah i am trying to debug that piece of code

Damiano · Answer

one moment

Damiano · Answer

ok hit that line of inizialization

Sidd · Answer

I wonder why the NPE was not caused here ``` indexedTable upsert key record ```

Damiano · Answer

but it remain null

Damiano · Answer

then i get an exception

Damiano · Answer

Could not find column drawdown id amount in data schema lt

Damiano · Answer

why

Sidd · Answer

Where are you getting this message from

Sidd · Answer

Can you try the query without aliasing once

Sidd · Answer

Try ```SELECT drawdown id amount FROM table GROUP BY strategy id ORDER BY drawdown id amount ```

Damiano · Answer

ok i try without aliasing

Damiano · Answer

i get that error in line 187

Damiano · Answer

i get that exception

Damiano · Answer

``` catch Exception e LOGGER error Exception processing CombineGroupByOrderBy for index operator index operators get index getClass getName e mergedProcessingExceptions add QueryException getException QueryException QUERY EXECUTION ERROR e ```

Damiano · Answer

i try without aliasing

Damiano · Answer

wait how can i order with that

Damiano · Answer

i mean the problem is because i am using the ORDER BY clause too

Sidd · Answer

```SELECT drawdown id amount FROM table GROUP BY strategy id ORDER BY drawdown id amount ```

Damiano · Answer

if i do not use ORDER BY i do not get any error

Damiano · Answer

ah ok

Damiano · Answer

repeating the aggregator

Damiano · Answer

one moment

Sidd · Answer

Where are you getting this message from

Sidd · Answer

```Could not find column drawdown id amount in data schema lt ```

Damiano · Answer

line 187 CombineGroupByOrderByOperator java

Sidd · Answer

that is where it is reported caught

Sidd · Answer

who throws it

Sidd · Answer

I strongly suggest to step through each and every line of code and then step into

Sidd · Answer

to identify the root cause of the exception

Damiano · Answer

yes ok

Damiano · Answer

but now i test it without alias

Damiano · Answer

one moment

Damiano · Answer

then i check again to understand who throws it

Damiano · Answer

grr blackout one moment

Damiano · Answer

i am ingesting the data again

Damiano · Answer

< Sidd> same error Could not find column drawdown id amount in data schema

Damiano · Answer

i see that exception after initLock unlock

Sidd · Answer

This is coming from TableResizer

Sidd · Answer

Put a breakpoint in the constructor of TableResizer

Sidd · Answer

the exception of missing column name in data schema is coming from there

Damiano · Answer

ok

Damiano · Answer

```if columnIndexMap containsKey column int index = columnIndexMap get column if index lt numKeyColumns orderByValueExtractors orderByIdx = new KeyColumnExtractor index else AggregationFunction aggregationFunction = aggregationColumnToFunction get column orderByValueExtractors orderByIdx = new AggregationColumnExtractor index aggregationFunction else throw new IllegalStateException Could not find column + column + in data schema ```

Damiano · Answer

``` if columnIndexMap containsKey column lt from here```

Damiano · Answer

that else throws it

Sidd · Answer

I know

Sidd · Answer

Why is not being added to the map

Sidd · Answer

```for int i = 0 i lt numColumns i++ String columnName = dataSchema getColumnName i columnIndexMap put columnName i ```

Sidd · Answer

What are all the column names in data schema as retrieved in the above loop

Damiano · Answer

i try to inspect that map one moment

Damiano · Answer

columns from there

Damiano · Answer

0 = strategy id 1 = drawdown amount

Damiano · Answer

thats the problem

Damiano · Answer

it miss id

Sidd · Answer

there you go

Damiano · Answer

id amount

Damiano · Answer

eh why

Damiano · Answer

DataSchema dataSchema

Damiano · Answer

why does the id is missing

Sidd · Answer

We need to go back to CombineGroupByOrderByOperator

Sidd · Answer

where the data schema is being created

Sidd · Answer

Put breakpoint at lin 89 in AggregationGroupByOrderByOperator

Sidd · Answer

This is where it is being created and then being used in combine

Sidd · Answer

you want to do team viewer

Damiano · Answer

not this CombineGroupByOrderByOperator

Damiano · Answer

we were working on that

Damiano · Answer

i will back in 30 minutes have dinner

Damiano · Answer

however we were working on that no

Sidd · Answer

data schema is being created in AggregationGroupByORderByOperator

Sidd · Answer

it returns IntermediateResultsBlock with a data schema

Damiano · Answer

``` dataSchema = intermediateResultsBlock getDataSchema ``` ^ here right

Sidd · Answer

yes that s what I am saying this intermediate block is returned by a segment level operator AggregationGroupByORderByOperator

Sidd · Answer

put a breakpoint in its constructor

Sidd · Answer

What is the impelmentation of this function for your aggregation function

Sidd · Answer

```String getResultColumnName ```

Damiano · Answer

```public String getResultColumnName return getType getName toLowerCase + + column + ```

Sidd · Answer

That s the problem

Damiano · Answer

what should it be something like firstcol UNDERSCORE secondcol

Sidd · Answer

It should be the signature of the function with exact arguments both id and amount

Sidd · Answer

At least for now it is needed assumed by the order by operator when it creates the schema

Damiano · Answer

ok but do i need a separator

Damiano · Answer

i mean in that example it is name name

Damiano · Answer

in mine with two columns

Sidd · Answer

Yes

Damiano · Answer

what should i return what signature i mean how can i combine two columnnames

Sidd · Answer

drawdown id amount

Damiano · Answer

ah

Damiano · Answer

got

Damiano · Answer

it

Damiano · Answer

i iwll try that way

Damiano · Answer

in few minutes thank you really much < Sidd> pardon for the fast quick and with errors messages but i am having dinner right now slightly smiling face eheh

Damiano · Answer

thank you i will try it shortly

Damiano · Answer

< Sidd> ok the error is gone but now i get

Damiano · Answer

` message QueryExecutionError njava lang ClassCastException org apache pinot core query aggregation function customobject RangeSet cannot be cast to java lang Comparable n tat org apache pinot core data table TableResizer$AggregationColumnExtractor lambda$new$0 TableResizer java 311 n tat org apache pinot core data table TableResizer$AggregationColumnExtractor extract TableResizer java 320 n tat org apache pinot core data table TableResizer getIntermediateRecord TableResizer java 138 n tat org apache pinot core data table TableResizer convertToIntermediateRecordsPQ TableResizer java 183 n tat org apache pinot core data table TableResizer resizeRecordsMap TableResizer java 159 n tat org apache pinot core data table ConcurrentIndexedTable resize ConcurrentIndexedTable java 141 n tat org apache pinot core data table ConcurrentIndexedTable finish ConcurrentIndexedTable java 174 n tat org apache pinot core operator CombineGroupByOrderByOperator getNextBlock CombineGroupByOrderByOperator java 208 n tat org apache pinot core operator CombineGroupByOrderByOperator getNextBlock CombineGroupByOrderByOperator java 60 n tat org apache pinot core operator BaseOperator nextBlock BaseOperator java 49 n tat org apache pinot core operator InstanceResponseOperator getNextBlock InstanceResponseOperator java 37 n tat org apache pinot core operator InstanceResponseOperator getNextBlock InstanceResponseOperator java 26 n tat org apache pinot core operator BaseOperator nextBlock BaseOperator java 49 n tat org apache pinot core plan GlobalPlanImplV0 execute GlobalPlanImplV0 java 48 `

Damiano · Answer

RangeSet is my object does it must implement Comparable

Sidd · Answer

Yes

Damiano · Answer

ok