When I turn on upserts in my table config I get the following error from the pinot-server:

Caught exception while indexing the record: {
  "nullValueFields" : [ ],
  "fieldToValueMap" : {
    "deviceType" : "bar",
    "data" : "{\"test\":123}",
    "deviceId" : "foo",
    "ts" : 1663345155307
  }
}
java.lang.NullPointerException: null
        at org.apache.pinot.segment.local.indexsegment.mutable.MutableSegmentImpl.index(MutableSegmentImpl.java:515) ~[pinot-all-0.11.0-jar-with-dependencies.jar:0.11.0-1b4d6b6b0a27422c1552ea1a936ad145056f7033]
        at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.processStreamEvents(LLRealtimeSegmentDataManager.java:573) [pinot-all-0.11.0-jar-with-dependencies.jar:0.11.0-1b4d6b6b0a27422c1552ea1a936ad145056f7033]
        at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.consumeLoop(LLRealtimeSegmentDataManager.java:430) [pinot-all-0.11.0-jar-with-dependencies.jar:0.11.0-1b4d6b6b0a27422c1552ea1a936ad145056f7033]
        at org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager$PartitionConsumer.run(LLRealtimeSegmentDataManager.java:623) [pinot-all-0.11.0-jar-with-dependencies.jar:0.11.0-1b4d6b6b0a27422c1552ea1a936ad145056f7033]
        at java.lang.Thread.run(Thread.java:829) [?:?]

Using the following table config: https://pastebin.com/uXnyVSfx data schema: https://pastebin.com/yvLCa1cd Just changing the upsertConfig to null everything works. Any ideas?

What version of Pinot are you running? We fixed a few upsert bugs that went into 0.11. cc: @Jackie @Kartik Khare

just upgraded to 0.11.0, i'll try the latest build

Ok, if you are already on 0.11, then you can skip trying latest build.

@erik bergsten Did you add upsert config to an existing table? You'll need to restart the server if that is the case

I keep getting the NullPointerException "while indexing the record" only if I have a json-column in the table. Upserts with no jsoncolumns work fine.

Interesting.. Can you check if you are getting the same stack trace for the NPE? Based on the stack-trace above, the issue is that the upsert metadata manager is not set up correctly

It seems to be working now... (with nothing changed on my end!). I'll be back if the problem returns...