Hey All I have a question.
Can I push data from S...
# randomr
Rajat Gupta
03/12/2024, 5:12 AMHey All I have a question.
Can I push data from S3 to pinot? Basically as when the file is uploaded, it pushes to pinot offline table. On seeing the documentation, i noticed that we can configure SegmentGenerationAndPushTask which will fetch the s3 files from the specified folder and push it to pinot cluster but I am looking more of a push mechanism from s3 to pinot where as the file is uploaded, it is pushed to pinot automatically.
m
Mayank
03/12/2024, 5:34 AM
Can you post in #C011C9JHN7R
v
Vik Gamov
03/12/2024, 2:13 PM@Rajat Gupta I maybe over engineering this but
S3 -> kafka connect s3 connector -> kafka > Pinot realitime table?
r
Rajat Gupta
03/12/2024, 6:59 PMsure @Mayank I will point in troubleshoot.