Hi everyone, I'm new to Apache pinot. I have started recently researching about Apache pinot and apache Hudi. I understood that Hudi is just a table format and pinot is a real-time OLAP store but ever since I started researching on this I feel that Apache Pinot can remove the usage of Apahe Hudi since both of them have primarily OLAP usecases. Is there someone here who have used both pinot as well as Hudi or something similar that can help me differenitate between these?

Apache Pinot is a query engine which has its own custom table format. Apache Hudi is a data lake platform that allows for transactional semantics while inserting, deleting, or updating data. Two very different technologies, although both used in OLAP space as you mentioned. Pinot currently doesn’t support querying Hudi tables.

Adding on…. Pinot is a database, Hudi, like DeltaLake and Iceberg are data formats for data lakes. So this is kind of like comparing grapes to lettuce.

adding on here- hudi is more for near real-time analytics and if you have a lot of data you need to analyze and store on s3- hudi is a good option. If you need real-time (in the seconds) in terms of data freshness and query performance, pinot is a good option.