https://pinot.apache.org/ logo
j

Jonathan Meyer

06/21/2021, 7:25 AM
Hello 🙂 Can someone remind me the steps to handle
"message": "MergeResponseError: Data schema mismatch between merged block:
after a REALTIME table backward-compatible schema change ? (new column) I've tried
Reload All Segments
Is that because I haven't set
pinot.server.instance.reload.consumingSegment
?
Full message:
Copy code
[
  {
    "errorCode": 500,
    "message": "MergeResponseError:
Data schema mismatch between merged block: 

[communityId(STRING),documentId(STRING),eventTimeString(STRING),eventType(STRING),hoverDuration(INT),ibcustomer(STRING),origin(STRING),projectId(STRING),selectionId(STRING),timeString(STRING),userId(STRING)] 

and block to merge:

[communityId(STRING),documentId(STRING),eventTimeString(STRING),eventType(STRING),ibcustomer(STRING),origin(STRING),projectId(STRING),selectionId(STRING),timeString(STRING),userId(STRING)], 
drop block to merge"
  }
]
x

Xiang Fu

06/21/2021, 9:02 AM
can you try to restart realtime servers?
j

Jonathan Meyer

06/21/2021, 9:04 AM
Oh, I'd have to see with the SREs Is that the only way ?
Because that would mean changing a schema would lead to downtime, right ?
x

Xiang Fu

06/21/2021, 9:24 AM
hmm, typically it should be if it’s backwards compatible changes
Shouldn’t
Need to check what’s going on there
Can you create an issue and describe how you find this issue?
j

Jonathan Meyer

06/21/2021, 11:46 AM
Yeah sure will do, thanks @Xiang Fu
j

Jackie

06/21/2021, 4:49 PM
Yes, in order to reload consuming segment as well, you need to set a flag
We should consider making it on by default
j

Jonathan Meyer

06/21/2021, 4:49 PM
@Jackie Is there any benefit to keeping it off ?
j

Jackie

06/21/2021, 4:50 PM
I don’t think so. I think the flag is added when testing the feature
Let me double check
j

Jonathan Meyer

06/21/2021, 4:51 PM
Okay It's this flag :
pinot.server.instance.reload.consumingSegment
, right ? 🙂
j

Jackie

06/21/2021, 4:52 PM
Yes, that is correct
j

Jonathan Meyer

06/21/2021, 4:53 PM
Great news, I'll try that then 🎉 Thanks Jackie
j

Jackie

06/21/2021, 5:04 PM
@Xiang Fu PR to set the default behavior: https://github.com/apache/incubator-pinot/pull/7078
j

Jonathan Meyer

06/21/2021, 5:05 PM
Fantastic thankyou