In config file I have added like so i.am.only able...
# general
r
In config file I have added like so i.am.only able to see the rows whose value is not null.
x
if you make this field a column in pinot, then you can set default null value, during query time, you can try to filter based on the null value.
r
@User means here no need to remove this transformation, but I need to add one more default value column here for this field as need to assign default value as null, so in this case will it pick both null and not null values because how it's only taking the rows where this columns value is not null?
n
Take a look at the documentation for jsonPathString with default value: https://docs.pinot.apache.org/users/user-guide-query/supported-transformations#json-functions
jsonPathString(after, '$Conveniencefee', 'none')
- for example if you wanted to set 'none' in rows where the column in null in source. This way the row won't get skipped during ingestion
r
@User Thanks alot .It Worked.