Hi, Does schema evolution only work at batch table...
# troubleshooting
y
Hi, Does schema evolution only work at batch tables? We wanted to add a new column on hybrid table (offline table + realtime streaming table) which includes upsert columns. When we added new column on schema config, we also needed to change table config since the new columns should have beed overwritten. It means we must have deleted original realtime table and re-generated realtime table. Is it right way of creating new columns in a streaming upsert table? example here only shows batch table
m
Schema evolution works for hybrid tables as well. As for upsert cc: @User
y
when i tried below in order, here is an error msg. cc. @User • schema a' add (i.e. schema a modify) • table A' modify (i.e. table A modify - since we needed to highlight test_evolution column to be "OVERWRITE" in table config) • run bin/pinot-admin.sh AddTable -schemaFile a_schema.json -tableConfigFile a_table.json -exec; • send new msg
Copy code
[
  {
    "message": "MergeResponseError:\nData schema mismatch between merged block: [card_alert(STRING),card_bin(STRING),card_id(STRING),card_issuer(STRING),card_number(STRING),card_type(STRING),create_time(TIMESTAMP),delete_time(TIMESTAMP),test_evolution(INT),update_time(TIMESTAMP),user_id(STRING)] and block to merge: [card_alert(STRING),card_bin(STRING),card_id(STRING),card_issuer(STRING),card_number(STRING),card_type(STRING),create_time(TIMESTAMP),delete_time(TIMESTAMP),update_time(TIMESTAMP),user_id(STRING)], drop block to merge",
    "errorCode": 500
  }
]
can you tell us process of adding new column which would be overwritten by using meetupRsvp example?