Hello Folks! I’m running Airbyte with Kubernetes, ...
# replication-troubleshooting
c
Hello Folks! I’m running Airbyte with Kubernetes, it’s great! However, I’m facing a problem when exporting a specific table to parquet, I receive the following error message:
Array contains a null element at 0
I saw the warning about turning the
parquet.avro.write-old-list-structure=false
. Is it possible to play with this flag running Airbyte via Kubernetes?
u
What connector are you using? can you share the log file too?
c
Hi Marcos! I’m using an extraction from postgres DB (created via terraform) to Parquet File on S3
Checking the logs here
m
Cesar, did you try other compressions?
c
These are my settings for the Parquet destionation:
m
Did you try to enable the dictionary encoding and use a compression codec?
c
No, but I’ll try!
I tested both:
Copy code
Compression Codec → Snappy + Dictionary Encoding Enable
and
Copy code
Compression Codec → Uncompressed + Dictionary Encoding Enabled
And the problem persists…any other suggestion?
m
Hello Cesar, I don’t have. I suggest to you open a Github issue to an engineer take a look and solve the problem. S3 destination is a GA connector so the problem should fix soon. If possible share the schema of the table is causing the problem and the complete log file.
c
I shared the log file with you on a private chat.
Sure, I’ll open a ticket