Hello Team As per the document ,I am strugling to ...
# general
s
Hello Team As per the document ,I am strugling to configure below parameter in jobspec config skipUnParseableLines: true https://docs.pinot.apache.org/manage-data/data-import/pinot-input-formats it throwing error as org.apache.pinot.shaded.com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: Unrecognized field "skipUnParseableLines" (class org.apache.pinot.plugin.inputformat.csv.CSVRecordReaderConfig), not marked as ignorable (15 known properties: "ignoreEmptyLines", "delimiter", "escapeCharacter", "skipHeader", "quoteCharacter", "multiValueDelimiter", "multiValueDelimiterEnabled", "fileFormat", "recordSeparator", "commentMarker", "ignoreSurroundingSpaces", "stopOnError", "header", "nullStringValue", "quoteMode"]): source="airflow.providers.cncf.kubernetes.utils.pod_manager.PodManager" can anyone help me.
m
I am guessing you are using older version of Pinot which does not have this config
s
we are using pinot 1.3
which pinot have this property
https://github.com/apache/pinot for csv reader this option is not there
cc: @Jackie we should remove the config from the doc, since it is removed from code ^^
s
Thanks but document it is showing this property.Hope document will update soon.
m
Feel free to contribute @San Kumar