Hi team Can we filter the metadata change log events pipelines on the basis of entity urn specific to dbt as platform ? ( filter using regex for entity urn)

@famous-waitress-64616 might be able to speak to this!

I'm not too familiar with MCLs, @gentle-night-56466 do you have any idea?

Yeah I want to filter only dbt dataset events from the mcl, in the filter mentioned dataset as an entity type . Can we apply that @brainy-tent-14503

Based on the docs for the actions framework (assuming that is the context here), the filter configuration is exact match on the event fields and not a regex match. Since the transformer and action steps are customizable so the filter could theoretically be implemented there. I don’t see any support for custom filters. The reality is that the filter is going to be reading all messages in the consumer in any event so filtering at that layer vs the transformer or action steps doesn’t offer an efficiency gain.

Currently I am able to filter at entity type level, aspects level and change type level but when I trying to filter on entity urn specific to dbt, it’s not taking the value