Quick question: I noticed that the interactive `cl...
# generalh
Hagen Rother
10/08/2024, 10:39 AMQuick question: I noticed that the interactive
classic-batch-data-loaderk
Karan Kumar
10/08/2024, 11:09 AMMost of the validations are on front end so I think no .
Please use SQL based ingestion which is much more automatic and user friendly.
h
Hagen Rother
10/08/2024, 2:06 PMI am using this for kafka and (pre built-in) compacting. So sql is the recommend way of specifying such jobs now?
k
Karan Kumar
10/08/2024, 2:06 PMMaybe not for kafka
Karan Kumar
10/08/2024, 2:06 PMbut for compaction yes
Karan Kumar
10/08/2024, 2:06 PMSQL based ingestion can work
Karan Kumar
10/08/2024, 2:06 PM@Vishesh Garg has done a lot of work in this area
h
Hagen Rother
10/08/2024, 2:09 PMlike I said, I have a production funnel on this before compacting even existed. I will migrate once batch is deprecated or validation becomes an api call