This message was deleted.

yes, that should go to

thrownAway

count in the logs and will not be kept inside druid. Ex:

[X]events thrown away. Possible causes: null events, events filtered out by transformSpec, or events outside earlyMessageRejectionPeriod / lateMessageRejectionPeriod.

Then I think collecting all the data and throwing it away is inefficient. Therefore, I would like to collect at once and divide the collected data to have each data source. What should I do?

you may collect it without filter from kafka to datasource1 and then use datasource1 as source and filter the required data to new datasource.

@Bibek Sahoo You seem to be referring to this function, is that correct?

correct

thanks