Hi, looking at <https://github.com/apache/pinot/pu...
# troubleshootingt
Tiger Zhao
08/15/2022, 9:55 PMHi, looking at https://github.com/apache/pinot/pull/8032 from the 0.10.0 release, my understanding is that we can now batch ingest segments into realtime tables? I just tried doing this with
pinot-admin.sh LaunchDataIngestionJobFailed to decode table config from JSONm
Mayank
08/22/2022, 7:16 PM
Hey @Tiger Zhao this feature was designed for supporting long retention realtime table, and in such cases, minion is used for pushing data (eg merge/rollup), and not really with a standalone offline ingestion job. What’s your use case for pushing data to realtime table via ingestion job?
t
Tiger Zhao
08/22/2022, 7:25 PMthe use case is for backfilling realtime upsert tables
Tiger Zhao
08/22/2022, 7:25 PMlike if we were to reset a table and we wanted to add back in older data and keep the upsert functionality
m
Mayank
08/22/2022, 7:33 PM
That seems a valid use case. @Yupeng Fu @Jackie