Does pinot support a CDC out or a bulk export meth...
# generalm
Manish
06/26/2023, 11:36 PMDoes pinot support a CDC out or a bulk export methods for getting data out? Are there specific pattern that we can use to get data out of Apache Pinot ?
j
Jayesh Asrani
06/27/2023, 4:15 AMManish , No there is no CDC support out of Pinot at the moment. I can suggest looking at the Spark connector for reading data (https://github.com/apache/pinot/blob/master/pinot-connectors/pinot-spark-3-connector/README.md)
Jayesh Asrani
06/27/2023, 4:15 AMHowever, trying to move or export bulk data from Pinot sounds like an anti-pattern.
m
Mingmin Xu
06/27/2023, 7:16 PMwe were talking about using Pinot as an aggregation engine, CDC support would be an option to stream it to another storage for very low latency and large qps.