This message was deleted.

Hi @Juan Jesus Prieto, middle managers hold the data in row form until they publish segments, either locally with intermediate persists or publish them to Deep Storage. I have heard of cases where more intermediate persists help performance because they are stored in segment form which are faster to query the the row form (the historicals only process in segment form). So you might want to try adjusting your streaming ingestion such that it does intermediate persists more often. The settings are

maxRowsInMemory

or

maxBytesInMemory

and time based with

intermediatePersistPeriod

. Hope this helps, let us know how it goes.

thanks @Sergio Ferragut, I will try these suggestions