I have a realtime table configured for upsert, so ...
# troubleshooting
j
I have a realtime table configured for upsert, so a primary key in the schema. If I delete the table, then re-create it with the SAME name, then inserted records in the NEW table will not be returned by a query if they have an earlier timestamp than what the same records had in the deleted table (same record by primary key). The records in the new table are reflected in the query stats (and only the new records) but they aren't returned by the query if they have an earlier timestamp. Is there more I need to delete besides the table? New segments are being created when I create the new table
x
@Yupeng Fu @Jackie is it possible the primary key store is not cleaned during deletion?
j
There is a recent fix regarding this issue: https://github.com/apache/incubator-pinot/pull/6608. This fix is not included in 0.6.0, so for now you have to restart the server in order to make the new table work as expected
j
we're running version 0.7.0-SNAPSHOT-e62addb3b381e89d3afe24847a1bff06e7682246
x
this image is 22 days ago and the PR is merged 6 days ago
You can try to pull the latest image and try
right now we are publishing images daily from the master trunk, you can find the images here: https://hub.docker.com/repository/docker/apachepinot/pinot/tags?page=1&ordering=last_updated