Hi, Did anyone know How to add new Json column nam...
# general
v
Hi, Did anyone know How to add new Json column name to the existing table
s
@Vuppala Suresh Kumar You should be able to simply add the new column to your schema via edit schema API, reload all your segments and you should be good to go.
v
We want to add transform function as well, How can we do that? @saurabh dubey @Mayank
Copy code
"ingestionConfig": {
            "transformConfigs": [
                {
                    "columnName": "gps_tracking_devices",
                    "transformFunction": "jsonFormat(\"gps_tracking_devices_json\")"
                },
                {
                    "columnName": "vehicles",
                    "transformFunction": "jsonFormat(\"vehicles_json\")"
                },
                {
                    "columnName": "drivers",
                    "transformFunction": "jsonFormat(\"drivers_json\")"
                }
m
When adding a New column you should be able to add transform function to it. However, adding transform function to existing column is considered a backward incompatible change and is not allowed
v
1. Added new column with data type JSON in schema using schema POST API call 2. Added transform function in table config PUT api call 3. Reloaded the segements But now data not get reloaded.
🤔 1
m
Is this a real-time table? If so, are there segments that are committed yet, or did you including reload of consuming segments
v
Yes, real time table and existing segments
m
Hmm, that doesn’t make sense. Do you have server logs?
p
@Mayank you need zookeeper logs right?
s
@Piyush Chauhan We'd need pinot-server logs post reload is initiated