Idris Osman
08/16/2023, 8:50 AMresource "airbyte_connection" "mysql_src_tf_bigquery_dest_tf" {
configurations = {
}
name = "mysql_src_tf <> bigquery_dest_tf"
non_breaking_schema_updates_behavior = "ignore"
schedule = {
schedule_type = "manual"
}
destination_id = airbyte_destination_bigquery.bigquery_dest_tf.destination_id
source_id = airbyte_source_mysql.mysql_src_tf.source_id
status = "active"
}
However, I'm unable to get the stream config working. Is there example code that one could recommend. Attempt below.
resource "airbyte_connection" "mysql_src_tf_bigquery_dest_tf" {
configurations = {
streams = [
{
name = "table_a"
sync_mode = "full_refresh_overwrite"
},
]
}
name = "mysql_src_tf <> bigquery_dest_tf"
non_breaking_schema_updates_behavior = "ignore"
schedule = {
schedule_type = "manual"
}
destination_id = airbyte_destination_bigquery.bigquery_dest_tf.destination_id
source_id = airbyte_source_mysql.mysql_src_tf.source_id
status = "active"
}kapa.ai
08/16/2023, 8:52 AMoctavia apply command. Here is an example of a connection configuration: yaml configuration: status: active namespace_definition: source namespace_format: "${SOURCE_NAMESPACE}" prefix: "" resource_requirements: cpu_limit: "" cpu_request: "" memory_limit: "" memory_request: "" schedule_type: manual sync_catalog: streams: - config: alias_name: cities cursor_field: [] destination_sync_mode: overwrite primary_key: [] selected: true sync_mode: full_refresh stream: default_cursor_field: [] json_schema: properties: city: type: string city_code: type: string type: object name: cities namespace: public source_defined_primary_key: [] supported_sync_modes: - full_refresh - incremental You can apply this configuration using the command octavia apply -f connections/postgres_to_bigquery/configuration.yaml [source](https://airbyte.com/tutorials/version-control-airbyte-configurations). Please note that the stream configuration is generated automatically and you should only edit streams.config. The streams.stream should not be edited as the schema cannot be changed. For more specific information about using the Terraform provider for Airbyte, I recommend referring to the official Terraform documentation or the Airbyte documentation.Idris Osman
08/16/2023, 9:49 AM