This message was deleted.

This is essentially a compaction. Advantages of MSQ over compact/batch ingestion 1. Better segment sizing. 2. Lesser things to tune. 3. More user friendly since its sql based. 4. Better support for range partitioning. 5. Ability to run multiple stage ingestion using sub queries.

Thanks for you answer! I also want to know why it has better segment sizing and range partitioning? we often compact by hour, it equals to partition by hour?

For segment sizing and range partitioning, MSQ uses data sketches with ability to down sample which gives us better segments cuts

Thanks! so if we only use partition by hour, it maybe a litter better than compact. If we add cluster by, it maybe a lot better than compact!

You still get 1,2,3,5

That’s great!