I'm trying to log a bug related to CSV file loadin...
# questions-and-troubleshooting
p
I'm trying to log a bug related to CSV file loading from a GCS bucket. It seems that the file may be getting split up incorrectly. Can anyone confirm for me that the reading of files from GCS is done with HDFS? I think it is, but would like to confirm. https://github.com/StarRocks/starrocks/blob/08c845a33018ab64dad910589ea11d442e84ede9/be/src/fs/fs.cpp#L134
k
yes
p
OK, I believe this code may be splitting the file incorrectly by row delimiter where there are row delimiters in enclosed fields. I'm not sure exactly how to report this with some example code https://github.com/StarRocks/starrocks/blob/main/be/src/exec/hdfs_scanner/hdfs_scanner_text.cpp#L93..L132
k
maybe open a github issue, with sample csv data file, and the sql to load the csv file into starrocks.
p
Yeah, ok, I already have an open issue but it's a little vague. Now I think I know what the issue is, I should be able to generate some CSV to replicate
👍 2
Thanks