Hello :slightly_smiling_face: I've evolved a realt...
# troubleshooting
j
Hello 🙂 I've evolved a realtime table schema (renaming column) and seeing the following error when querying
Copy code
[
  {
    "errorCode": 500,
    "message": "MergeResponseError:\nData schema mismatch between merged block: [eventTimeString(STRING),communityId(STRING),eventType(STRING),ibcustomer(STRING),newsId(STRING),timeString(STRING),userId(STRING)] and block to merge: [eventTimeString(STRING),communityId(STRING),ibcustomer(STRING),newsId(STRING),timeString(STRING),type(STRING),userId(STRING)], drop block to merge"
  }
]
I'm aware of
pinot.server.instance.reload.consumingSegment
setting - can you confirm setting it to
true
will solve this problem ? If so, maybe the error message should contain this bit of information ? or a reference to the doc ?
x
I think pinot only support backward compatible schema changes, which means delete a column is not supported.
you can keep the old column, it will be filled with null value
j
Ah that makes sense Maybe we should prevent updating the schema in such a way then ? (fail early)
x
agreed
We are adding this feature to avoid certain update
j
Oh great Mind sharing the issue / PR regarding this feature ?
x
also discussing the support for schema versioning
👏 1
j
Thanks @Xiang Fu 🙂
👍 1