Vinny Tunnell
03/01/2022, 1:11 AM...
2022-03-01 01:07:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14455000
2022-03-01 01:07:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14456000
2022-03-01 01:07:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14457000
2022-03-01 01:07:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14458000
...
If multiple output files is not possible, is there any way I can at least see staged data that has been processed so far?
My desired output format is Parquet with SNAPPY compression.Vinny Tunnell
03/01/2022, 7:16 AM