Team, I am experimenting with apache pinot. Using ...
# getting-started
m
Team, I am experimenting with apache pinot. Using realtime tables to store metrics data into pinot. The data streaming is live. After few days, I had to update table schema to add new columns. I used UI to add new columns, updated table config, reload all segments. Query console is complaining. What else I should be doing? “There are 82 invalid segment/s. This usually means that they were created with an older schema. Please reload the table in order to refresh these segments to the new schema.”
You need to call the reload-api to have the new columns appear in existing data (with default values)
m
@Mayank Here is the result of the reload. I can see the new columns in the UI. I still get the same error while querying.
Copy code
{
  "status": "Segment reload details: {\"metrics_REALTIME\":{\"reloadJobId\":\"8af6d4e0-fa0b-4f7b-b06e-2bc14a2f1bb6\",\"reloadJobMetaZKStorageStatus\":\"SUCCESS\",\"numMessagesSent\":\"2\"}}"
}
Copy code
{
  "metadata": {
    "jobId": "8af6d4e0-fa0b-4f7b-b06e-2bc14a2f1bb6",
    "messageCount": "2",
    "submissionTimeMs": "1666883805035",
    "jobType": "RELOAD_ALL_SEGMENTS",
    "tableName": "metrics_REALTIME"
  },
  "successCount": 105,
  "totalSegmentCount": 105,
  "totalServersQueried": 2,
  "totalServerCallsFailed": 0,
  "timeElapsedInMinutes": 101.23236666666666,
  "estimatedTimeRemainingInMinutes": 0
}