Hello, does Pinot support loading from this input ...
# generala
abhinav wagle
01/10/2022, 8:46 PMHello, does Pinot support loading from this input format :
org.apache.hadoop.mapred.TextInputFormatk
Kishore G
01/10/2022, 8:51 PM
thats specific to how you read a text file in Hadoop
Kishore G
01/10/2022, 8:51 PM
are you generating the output file using TextOutputFormat?
a
abhinav wagle
01/10/2022, 8:53 PMyes
abhinav wagle
01/10/2022, 8:54 PMThe output file is of TextOutputFormat
abhinav wagle
01/10/2022, 8:54 PMAnd I need to batch ingest dimension table in hive and upload it to pinot
k
Kishore G
01/10/2022, 9:03 PM
Got it, we dont have a RecordReader for that
Kishore G
01/10/2022, 9:04 PM
should be easy to add one
m
Mayank
01/11/2022, 4:27 AM
@User Do you mind filing a GitHub issue?
a
abhinav wagle
01/14/2022, 9:22 PM@User: https://github.com/apache/pinot/issues/8027 FYI.
k
Kishore G
01/14/2022, 9:56 PM
Did you try using CSV with a delimiter?
a
abhinav wagle
01/14/2022, 10:00 PM@User: Yes. Running into following problem for that approach : https://apache-pinot.slack.com/archives/C011C9JHN7R/p1642186740005400