on `octavia apply` ```File usr local lib python3 9 site pack Airbyte #help-api-cli-orchestration

on `octavia apply` ```File "/usr/local/lib/python3...

Dayten Sheffar

04/18/2023, 9:46 PM

octavia apply

Copy code

File "/usr/local/lib/python3.9/site-packages/airbyte_api_client/rest.py", line 226, in request
    raise ServiceException(http_resp=r)
airbyte_api_client.exceptions.ServiceException: (500)
Reason: Internal Server Error
HTTP response headers: HTTPHeaderDict({'Server': 'nginx/1.23.3', 'Date': 'Tue, 18 Apr 2023 21:41:28 GMT', 'Content-Type': 'application/json', 'Content-Length': '13965', 'Connection': 'keep-alive'})
HTTP response body: {"message":"Internal Server Error: SQL [select (exists (select \"public\".\"connection\".\"id\", \"public\".\"connection\".\"namespace_definition\", \"public\".\"connection\".\"namespace_format\", \"public\".\"connection\".\"prefix\", \"public\".\"connection\".\"source_id\", \"public\".\"connection\".\"destination_id\", \"public\".\"connection\".\"name\", \"public\".\"connection\".\"catalog\", \"public\".\"connection\".\"status\", \"public\".\"connection\".\"schedule\", \"public\".\"connection\".\"manual\", \"public\".\"connection\".\"resource_requirements\", \"public\".\"connection\".\"created_at\", \"public\".\"connection\".\"updated_at\", \"public\".\"connection\".\"source_catalog_id\", \"public\".\"connection\".\"schedule_type\", \"public\".\"connection\".\"schedule_data\", \"public\".\"connection\".\"geography\", \"public\".\"connection\".\"notify_schema_changes\", \"public\".\"connection\".\"non_breaking_change_preference\", \"public\".\"connection\".\"breaking_change\", \"public\".\"connection\".\"unsupported_protocol_version\", \"public\".\"connection\".\"field_selection_data\" from \"public\".\"connection\" where \"public\".\"connection\".\"id\" = cast(? as uuid)))]; ERROR: column connection.notify_schema_changes does not exist\n  Position: 683","exceptionClassName":"org.jooq.exception.DataAccessException","exceptionStack":["org.jooq.exception.DataAccessException: SQL [select (exists (select \"public\".\"connection\".\"id\", \"public\".\"connection\".\"namespace_definition\", \"public\".\"connection\".\"namespace_format\", \"public\".\"connection\".\"prefix\", \"public\".\"connection\".\"source_id\", \"public\".\"connection\".\"destination_id\", \"public\".\"connection\".\"name\", \"public\".\"connection\".\"catalog\", \"public\".\"connection\".\"status\", \"public\".\"connection\".\"schedule\", \"public\".\"connection\".\"manual\", \"public\".\"connection\".\"resource_requirements\", \"public\".\"connection\".\"created_at\", \"public\".\"connection\".\"updated_at\", \"public\".\"connection\".\"source_catalog_id\", \"public\".\"connection\".\"schedule_type\", \"public\".\"connection\".\"schedule_data\", \"public\".\"connection\".\"geography\", \"public\".\"connection\".\"notify_schema_changes\", \"public\".\"connection\".\"non_breaking_change_preference\", \"public\".\"connection\".\"breaking_change\", \"public\".\"connection\".\"unsupported_protocol_version\", \"public\".\"connection\".\"field_selection_data\" from \"public\".\"connection\" where \"public\".\"connection\".\"id\" = cast(? as uuid)))];

Octavia/Airbyte versions tested 0.40.32 / 0.41.0 0.41.0 / 0.41.0 0.41.0 / 0.42.1 0.42.1 / 0.42.1 0.42.1 / 0.44.0 the breaking field:

notify_schema_changes

is present in my config file, but fails when commented out as well. Also broken in the UI when submitting a new connection (local postgres to big query)

Dayten Sheffar

04/19/2023, 5:22 PM

is there a way to just do a complete hard reset of airbyte? I have the sources, destinations, and connections I want as configuration files. I removed the docker volumes, rebuilt my docker stack (dagster + dbt + airbyte), and octavia apply only creates sources and destinations and chokes (as above) on creating connections?

Dayten Sheffar

04/19/2023, 5:23 PM

removing state files from a given source/dest/conn sometimes works to recreate it with a new id, but i feel like the db must be polluted or something

Liam Coley

04/19/2023, 9:16 PM

Hey Dayten, this has been an ongoing issue unfortunately. A workaround is to comment out those fields (

notify_schema_changes

and

geography

) and then run apply, however this will ask you to update every time. Would be great for this to be fixed as Octavia is pretty usable except for this issue!

2 Views

Open in Slack

Previous Next