Hello Team, Is this your first time deploying Airb...
# troubleshooting
s
Hello Team, Is this your first time deploying Airbyte: NO OS Version / Instance: E Memory / Disk: 30 GB Airbyte Version: 0.35.35 Step: Export Airbyte Configuration and Data Archive OR Import Airbyte Configuration is not working properly Description: Migration script for Export and Import not working properly. Error when exporting and then importing the same configuration and data archive. Works alright before
Copy code
{
  "status": "failed",
  "reason": "io.airbyte.validation.json.JsonValidationException: json schema validation failed when comparing the data to the json schema. \nErrors: $.id: is missing but it is required, $.catalog: is missing but it is required, $.catalogHash: is missing but it is required \nSchema: \n{\n  \"$schema\" : \"<http://json-schema.org/draft-07/schema#>\",\n  \"$id\" : \"<https://github.com/airbytehq/airbyte/blob/master/airbyte-config/models/src/main/resources/types/AttemptFailureSummary.yaml>\",\n  \"title\" : \"ActorCatalog\",\n  \"description\" : \"Catalog of an actor.\",\n  \"type\" : \"object\",\n  \"additionalProperties\" : false,\n  \"required\" : [ \"id\", \"catalog\", \"catalogHash\" ],\n  \"properties\" : {\n    \"id\" : {\n      \"type\" : \"string\",\n      \"format\" : \"uuid\"\n    },\n    \"catalog\" : {\n      \"type\" : \"object\",\n      \"existingJavaType\" : \"com.fasterxml.jackson.databind.JsonNode\"\n    },\n    \"catalogHash\" : {\n      \"type\" : \"string\"\n    }\n  }\n}"
}
c
When do you see this error? Also can you give more detail on the process you have followed?
c
@Harshith (Airbyte) Our airbyte will keep having error randomly now and then be it running on its own or we are doing upgrade. We will lose all our connections. Hence we wrote an airflow script to back up our airbyte configuration so if there are any random crashes. We can easily reinstate the previous day setting. The steps we followed: Step 1: Use the export airbyte configuration and data archive api /v1/deployment/export to export an gzip file -> save into gcs Step 2: Just use the import airbyte configuration and data archive api /v1/deployment/import download the gzip file and import configuration if we have to reinstate The first few days we run, it was alright. We were able to export and import into another new airbyte easily. This enable us to spin multiple same configuration airbyte. However, after we update to 0.35.35. We were having issues with the import as the error that I have sent above is being thrown via the api response. We are unable to debug and understand what it even means. We hope your team to have a look into this as it will really help us. We ran google sheet, postgresql and bigquery connections.
d
I tested locally with a PokeAPI to Postgres and it’s worked. Give me an error but refreshing the page shows me the sources in my new instance.
@Kelvin Beh it’s possible to open a Github issue to investigate further? Please tell which sources/destination you’re using to be able to simulate your envs
Also can you confirm your Airbyte Version?
l
Any chance there was resolution on this? Running into this on
0.35.51
FYI, this seems to work as a workaround if you don’t feel like upgrading to `0.35.57`+: https://airbytehq.slack.com/archives/C01MFR03D5W/p1649195985650859?thread_ts=1646309555.988879&amp;cid=C01MFR03D5W