https://pinot.apache.org/ logo
j

Josh Highley

03/03/2021, 1:16 AM
I have a realtime table configured for upsert, so a primary key in the schema. If I delete the table, then re-create it with the SAME name, then inserted records in the NEW table will not be returned by a query if they have an earlier timestamp than what the same records had in the deleted table (same record by primary key). The records in the new table are reflected in the query stats (and only the new records) but they aren't returned by the query if they have an earlier timestamp. Is there more I need to delete besides the table? New segments are being created when I create the new table
x

Xiang Fu

03/03/2021, 1:20 AM
@Yupeng Fu @Jackie is it possible the primary key store is not cleaned during deletion?
j

Jackie

03/03/2021, 1:21 AM
There is a recent fix regarding this issue: https://github.com/apache/incubator-pinot/pull/6608. This fix is not included in 0.6.0, so for now you have to restart the server in order to make the new table work as expected
j

Josh Highley

03/03/2021, 2:41 AM
we're running version 0.7.0-SNAPSHOT-e62addb3b381e89d3afe24847a1bff06e7682246
x

Xiang Fu

03/03/2021, 6:12 AM
this image is 22 days ago and the PR is merged 6 days ago
You can try to pull the latest image and try
right now we are publishing images daily from the master trunk, you can find the images here: https://hub.docker.com/repository/docker/apachepinot/pinot/tags?page=1&ordering=last_updated