Hi, I use jsonPathLong to extract timestamp and it...
# troubleshootinga
Alice
06/21/2022, 10:21 AMHi, I use jsonPathLong to extract timestamp and it’s ok.
{
“columnName”: “timestamp”,
“transformFunction”: “jsonPathLong(body, ‘$.timestamp’)”
}
Then I want to update the table config and add this transformation function.
{
“columnName”: “hoursSinceEpoch”,
“transformFunction”: “toEpochHours(timestamp)”
}
But returned the following error. I had add this column in table schema.
Alice
06/21/2022, 10:21 AMPinot version is 0.10 and I referred to this doc to configure my table.
https://docs.pinot.apache.org/developers/advanced/ingestion-level-transformations#datetime-functions
l
Lars-Kristian Svenøy
06/21/2022, 2:29 PMI'm pretty sure the column you're requesting needs to be present in the data you're transforming. You can't depend on a column dynamically created through a transform function for another transform function
Lars-Kristian Svenøy
06/21/2022, 2:30 PMSo you could potentially run your transform function like this
Copy code
{
"columnName": "hoursSinceEpoch",
"transformFunction": "toEpochHours(jsonPathLong(body, '$.timestamp'))"
}Lars-Kristian Svenøy
06/21/2022, 2:30 PMI haven't tested this myself, but in theory that should work
✅ 1
a
Alice
06/21/2022, 3:15 PMYes, I’ve tried your method and it worked. Thank you so much.
l
Lars-Kristian Svenøy
06/21/2022, 3:19 PMPerfect, glad to hear it!