Do lowlevel realtime tables support ingestionConfi...
# generalj
Josh Highley
03/02/2021, 3:55 PMDo lowlevel realtime tables support ingestionConfig-transformConfig ?
k
Kishore G
03/02/2021, 4:01 PM
Yes
j
Josh Highley
03/02/2021, 4:05 PMMy POST request to create my table has a transformConfig property in ingestionConfig but it doesn't appear in the UI for the new table when I look. I also tried adding the config in the UI and it's not updated
Josh Highley
03/02/2021, 4:09 PM'filterConfig' is saved but transformConfig isn't
k
Kishore G
03/02/2021, 4:24 PM
can you show the screen shot
Kishore G
03/02/2021, 4:24 PM
@Neha Pawar ^^
n
Neha Pawar
03/02/2021, 4:37 PM
Can you share the table config?
j
Josh Highley
03/02/2021, 4:49 PMthe config in my REST body:
Josh Highley
03/02/2021, 4:49 PM Copy code
"ingestionConfig": {
"filterConfig": {
"filterFunction": "Groovy({custom_saluation != null})"
},
"transformConfig": [{
"columnName":"custom_salutation",
"transformFunction":"Groovy({'This is Groovy'})"
}]
}Josh Highley
03/02/2021, 4:51 PMwhen I view the table config in the UI:
Josh Highley
03/02/2021, 4:51 PM Copy code
"ingestionConfig": {
"filterConfig": {
"filterFunction": "Groovy({custom_saluation != null})"
}
},Josh Highley
03/02/2021, 4:57 PMlowlevel realtime table configured for upsert, if that matters
Josh Highley
03/02/2021, 5:09 PMversion 0.7.0-SNAPSHOT-e62addb3b381e89d3afe24847a1bff06e7682246 running from the docker images
n
Neha Pawar
03/02/2021, 5:32 PM
it should be transformConfigs
j
Josh Highley
03/02/2021, 5:48 PMok, that worked. The documentation needs fixed: https://docs.pinot.apache.org/developers/advanced/ingestion-level-transformations
n
Neha Pawar
03/02/2021, 5:57 PM
will fix it, thanks for pointing that out!