Hello everyone,
If i don't set 'maxNumRecordsPerSegment' config for my 'RealtimeToOfflineSegmentsTask', would it truncate my data if i have more records than default value (it says 5.000.000 in docs) for that time window?
n
Neha Pawar
04/07/2022, 2:06 PM
If you have more than 5m (or whatever value is set in maxNumRecords), it will generate multiple segments in that run, with 5m records per segment. No truncation