Thanks @Lari Hotari for providing a detailed answer to the question. It was really helpful. I had a followup question to the "offset management". I have added it as a comment in the discussion thread. Please can you help answer it when you get a chance.