Hello everyone,
I have a bug when using the file s...
# ask-community-for-troubleshootingc
Charles
08/26/2021, 4:13 PMHello everyone,
I have a bug when using the file source connector.
It don't detect the correct order in my columns...
I supply a csv with no headers so I specify in the reader option the columns names but then when it detect the schema the colunns are not in the order I gave it
👀 1
g
George Claireaux (Airbyte)
08/26/2021, 4:49 PM
Hey Charles 👋
looks like it's alphabetically ordering rather than retaining your order... I'll have a look if that can be easily patched
George Claireaux (Airbyte)
08/26/2021, 4:50 PM
On the same topic though, where is the file located? I ask because if it's in S3 there is a separate S3 connector that supports CSV which might do what you want already
c
Chris (deprecated profile)
08/26/2021, 5:08 PM
is it just the UI re-ordering alphabetically but they should be correctly mapped (in the catalog json file for example), right?
this 1
c
Charles
08/30/2021, 9:32 AMOK so, sorry for the delay @George Claireaux (Airbyte)...
The csv file is located on a HTTPS repo (no S3 connector)
Charles
08/30/2021, 9:33 AMIndeed the JsonSchema is correct, but I when I export the file to parquet on a S3 destination and I reimport it in my spark workflow the columns are in the UI order
g
George Claireaux (Airbyte)
09/01/2021, 10:09 AM
Would you mind creating an issue for this @Charles? This will allow us to not lose track of the problem and to prioritise the fix 🙂
c
Charles
09/01/2021, 10:10 AMCharles
09/01/2021, 10:11 AMI created it a few days ago 🙂
Charles
09/01/2021, 10:11 AMBut was moved to type/enhancement
g
George Claireaux (Airbyte)
09/01/2021, 10:12 AM
Ah great thanks
6 Views