Hello, I am kicking the tyres of Pinot (v 0.9.0) by doing the following tutorial https://github.com/npawar/pinot-tutorial. I load 4 records from a CSV file into an offline table named transcript and I get 4 rows returned when executing the following statement

select * from transcript limit 10

. As soon as I upload a realtime table config and schema (https://github.com/npawar/pinot-tutorial/tree/master/transcript#upload-realtime-table-config-and-schema) only 3 rows are returned when running the same SQL statement. I do however see 4 rows if I query the offline table e.g.

select * from transcript_OFFLINE limit 10

. What could be the reason?

Time boundary .. https://docs.pinot.apache.org/basics/components/broker

At the moment I haven't pushed any real-data yet, I just created the realtime table config and schema. Let's say, no real-time data comes in for some time. At which point will selecting from transcript return back 4 rows? Are there any setting that I can change to get a better understanding on the time boundary works?

The expectation from a hybrid table is that data is flowing in both, and that there’s data overlap.

Thanks for the replies Kishore and Mayank. I've read the documentation on time boundaries but still a bit confused on how a hybrid table is supposed to be used. In the test data of the tutorial, the records for offline and real time are unique but there a few records which exist both on the Oct 24 and Oct 28. The hybrid table shows the records as in the diagram below - records from the real-time table on the 24th are not visible and the records from offline table on the 30th are also not visible. I understand why this has been done. Given that the records are unique, will the hybrid table show all records as some point later in time (reconciled?). I'll like to be able to count the number of student transcripts to get an accurate total.