Hi, I'm investigating if open source Airbyte can ...
# ask-community-for-troubleshooting
s
Hi, I'm investigating if open source Airbyte can fit to our data architecture. For now I need a data load from Kafka to Postgres. I've been able to prepare some basic connection, But how can I specify the data structure that would sync to Postgres table? I wonder how Airbyte recognize data structure from a specific Kafka topic. To be clear - I've got a destination table DDL defined and I want to create a Kafka topic that would sync and fill the table. Any help or source? Thanks.
m
Airbyte will read the kafka topic structure and create the table based on those records
s
No, unfortunately it's not. It creates one column in destination table named "Value". Are there any prerequisities for Airbyte to work like this? Like JSON format for Kafka topics only? Or some specific separator in messages?