Hi all, I have set up some realtime tables with upserts enabled but I am seeing that table size keeps on increasing, is this by design or I am missing some clean up job config.
👋 1
n
Navina
03/27/2023, 2:26 PM
@Durgesh Choudhary if you don't have retention period setup/ purge task / repeating primary keys in your input, then the data will keep growing by design. Do you have these in your setup? Is the input all unique records?
d
Durgesh Choudhary
03/27/2023, 3:16 PM
No, I am indexing iot device data and wanted to maintain last reported view of devices hence did not have retention set up for this. Should I write some custom logic for purge tasks for this?