Hello, Does Pinot support updating an existing Schema & Table's definition? I have a dimension which is a string representation of a JSON. The schema of this json payload is dynamic. Some inner fields exist for some rows but not others and will change over time. I have a business requirement to deconstruct the json such that users can use the inner fields in the json for queries. I've seen that it is possible to deconstruct json fields: https://stackoverflow.com/questions/65886253/pinot-nested-json-ingestion but my question is whether pinot allows this deconstruct to change over time. Thank you.

Pinot allows changing of table configs and schemas. However, schema changes need to be backward compatible. For example, you cannot change a columns type from string to integer.

Will Pinot reprocess existing segments in a table to match the new schema?

So if you add a new column for example then there is a segment reload api you need to call, and it will populate old segments with new column having a default value

Alright, thank you for the information!