This message was deleted.
# general
s
This message was deleted.
o
I think i found a way:
Copy code
"parser": {
      "type": "string",
      "parseSpec": {
        "format": "tsv",
        "timestampSpec": {
          "column": "timestamp",
          "format": "auto"
        },
        "transformSpec": {
            "transforms": [
                {
                    "type": "expression",
                    "name": "a",
                    "expression": "substring(params, index_of(params, '=') + 1, index_of(params, '&'))"
                },
                {
                    "type": "extraction",
                    "name": "c",
                    "expr": "substring(params, index_of(params, '=', index_of(params, '&')) + 1, index_of(params, '&', index_of(params, '&') + 1))"
                }
            ]
        }
        "dimensionsSpec": {
          "dimensions": [
            "type",
            "name",
            "status",
            "a",
            "c"
          ]
        },
        "columns": [
          "timestamp",
          "type",
          "name",
          "status",
        ]
      }
    },
v
What a strange format to use both
\t
and
&
as separators
I don't know how consistent the columns are but you could also use a regex
you could also try using tsv with delimiter set to
\t
and setting the listDelimiter to
&
this would ingest
a=b
c=d
e=f
as values of a single multi-value field
which is not what you said you wanted but might work well depending on the usecase (I have seen real usecases where that was the ingestion method)
it would look like this on the dataset you provided (which has one more column than you indicated)
o
Oh.. nice… I will have to give it a shot. Thank you very much for the suggestion. Yeah their messages are weird. Not sure who thought it was a good idea 😞