This message was deleted.

Hi Ross - you can use a

not

filter to help with this.

"transformSpec": {
        "filter": {
          "type": "not",
          "field": {
            "type": "and",
            "fields": [
              {
                "type": "interval",
                "dimension": "__time",
                "intervals": [
                  "2016-06-27T00:00:00/2016-06-27T00:01:00"
                ]
              }​​​​​​,
              {
                "type": "selector",
                "dimension": "channel",
                "value": "#sv.wikipedia"
              }
            ]
          }
        }

In the

wikipedia

example, this would remove any data with interval

2016-06-27T00:00:00/2016-06-27T00:01:00

and channel value of

#sv.wikipedia

thanks @Kyle Hoondert but wouldn't that remove the whole row from what I understand? I still want the row but a particular dimension value

So you are looking to substitute a dimension value?

@Kyle Hoondert Yeah essentially substitute it with empty if it contains a certain value

Maybe then a

replace

expression in the transform https://druid.apache.org/docs/latest/misc/math-expr.html#string-functions

ahh ok interesting, cheers!

If you are doing batch ingestion and you switch to SQL based ingestion you can express these transformations in SQL