Hi Team, I am new to Pinot (1.2.0 version) and fac...
# troubleshooting
d
Hi Team, I am new to Pinot (1.2.0 version) and facing following challenge: currently we have one realtime table on our Pinot cluster. We would like to remove it and recreate with the same name on a daily basis. We often see that although table was successfully deleted, external view is present long after table removal. Only once server is restarted EV seems to be removed. My question would be: • Is there any direct way to remove EV or force Pinot to refresh EV status, • Is it safe to create the table even EV is still visible after deletion or we must wait until EV is no longer present? Thanks!
m
1.2 is very old, can you move to the latest, there were some bug fixes around the problem you mentioned. Also, what’s the usecase that requires deleting and recreating the table? You could just refresh the data right?
d
We wanted to remove all data by dropping table and recreating as data volume is increasing quickly and we need only the latest
m
Checkout REFRESH
d
doesnt REFRESH apply only to batch tables?
m
Yes. I re-read your message, why not use retention? That will remove the older data and only keep the latest that you want
d
Thanks for answer! Could you also point me to bug fixes which were made around table recreation- I was able to find following (wanted to make sure I'm not missing anything and better understand): https://github.com/apache/pinot/pull/14334 https://github.com/apache/pinot/pull/11380 https://github.com/apache/pinot/pull/16307 https://github.com/apache/pinot/pull/14352