wondering if it works for kafka streaming ingestio...
# general
c
wondering if it works for kafka streaming ingestion:
Copy code
"ingestionConfig": {
      "transformConfigs": [
        {
          "columnName": "brand_name_facility_id_tuple",
          "transformFunction": "concat(brand_name, facility_id, ':')"
        }
      ]
    },
not sure if the
concat
works here. the examples here are mostly groovy function: https://docs.pinot.apache.org/developers/advanced/ingestion-level-transformations#column-transformation
n
yup this should work. cc @User seems docs are incomplete or causing some confusion?
m
Thanks - lemme add some more examples
c
got it. thanks @User and @User
Hey @User and @User, btw, what is the difference to put the transformFunction in
dimensionFieldSpecs
directly like following: https://github.com/apache/pinot/blob/master/pinot-tools/src/main/resources/examples/batch/starbucksStores/starbucksStores_schema.json#L24
thanks
n
This has been deprecated, so recommend using the table config version
c
gotcha, thanks a lot.