https://linen.dev logo
Join Slack
Powered by
Hi folks, Suddenly is appearing this error when I ...
# replication-troubleshooting
m
Hi folks, Suddenly is appearing this error when I am testing my connector. Could you help me? 
FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/declarative_component_schema.yaml'
e
Hi. are you using a venv and if so did you install airbyte_cdk?
m
Yes, I am using conda. I have this version installed -> airbyte-cdk 0.16.0
e
try to uninstall and install again sounds odd.
Copy code
py -m pip uninstall airbyte_cdk
py -m pip install --upgrade airbyte_cdk
m
This is the error when I try to install again airbyte_cdk 
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
source-tutorial-example 0.0.0 requires airbyte-cdk~=0.1.56, but you have airbyte-cdk 0.16.0 which is incompatible.
e
great- go to 
source-tutorial-example
to setup.py and there inside 
MAIN_REQUIREMENTS
list, change from 
airbyte-cdk~=0.1.56
specific version to just 
airbyte-cdk
this will install the latest version and will resolve the conflict
m
No results... When I run 
python main.py discover --config secrets/config.json
raise FileNotFoundError(f"Failed to read manifest component json schema required for validation: {e}")
e
I see two things: 1. when using read you need to use a 
configured_catalog.json
and not 
config.json
(the names dont really matter as long as you are using a json file that has correct data to run i.e. 
streams
) 2. it seems that you are missing the json validator file that validates the 
configured_catalog.json
How did you create the connector? example of a configured_catalog.json
Copy code
{
  "streams": [
    {
      "sync_mode": "full_refresh",
      "stream": {
        "name": "campaigns",
        "json_schema": {
          "$schema": "<http://json-schema.org/draft-07/schema#>",
          "type": "object",
          "properties": {
            "id": {
              "type": "string"
            },
            "name": {
              "type": "string"
            }
          }
        },
        "supported_sync_modes": [
          "full_refresh"
        ]
      },
      "destination_sync_mode": "overwrite"
    }
  ]
}
m
I am running this command -> 
python main.py read --config secrets/config.json --catalog integration_tests/configured_catalog.json
My configured_catalog.json is this one:
Copy code
{
  "streams": [
    {
      "stream": {
        "name": "candidates",
        "json_schema": {
          "$schema": "<http://json-schema.org/draft-07/schema#>",
          "type": "object",
          "properties": {
            "id": {
              "type": "string"
            },
            "job": {
              "type": "object",
              "properties": {
                "shortcode": {
                  "type": "string"
                },
                "title": {
                  "type": "string"
                }
              }
            },
            "stage": {
              "type": "string"
            },
            "disqualified": {
              "type": "boolean"
            },
            "hired_at": {
              "type": [
                "null",
                "string"
              ]
            },
            "sourced": {
              "type": "boolean"
            },
            "created_at": {
              "type": "string"
            },
            "updated_at": {
              "type": "string"
            },
            "reject_reason": {
              "type": [
                "null",
                "string"
              ]
            },
            "source": {
              "type": "string"
            }
          }
        },
        "supported_sync_modes": [
          "full_refresh"
        ]
      },
      "sync_mode": "full_refresh",
      "destination_sync_mode": "overwrite"
    },
    {
      "stream": {
        "name": "jobs",
        "json_schema": {
          "$schema": "<http://json-schema.org/draft-07/schema#>",
          "type": "object",
          "properties": {
            "id": {
              "type": "string"
            },
            "shortcode": {
              "type": "string"
            },
            "code": {
              "type": "string"
            },
            "department": {
              "type": [
                "null",
                "string"
              ]
            },
            "created_at": {
              "type": "string"
            },
            "name": {
              "type": "string"
            },
            "status": {
              "type": "string"
            },
            "updated_at": {
              "type": "string"
            }
          }
        },
        "supported_sync_modes": [
          "full_refresh"
        ]
      },
      "sync_mode": "full_refresh",
      "destination_sync_mode": "overwrite"
    }
  ]
}
e
how did you create the connector? using the cli or .generate?
m
With low code generator
e
low code cdk is still early alpha so it could be a bug though lets try to figure this out or did you mean the
Copy code
cd airbyte-integrations/connector-templates/generator
./generate.sh
?
did you run?
Copy code
cd ../../connectors/source-exchange-rates-tutorial
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
m
The first question, yes, I run :
Copy code
cd airbyte-integrations/connector-templates/generator
./generate.sh
The second one, I am using conda, but it is the same. The first connector I did it's working fine, but suddenly I get this error... I not change nothing on my side
e
this part is crucial
Copy code
pip install -r requirements.txt
did you install the requirements?
it sounds as your file is missing
m
Yes, of course. I am deleting the environment and I'll try again install the requirements
Another error... 
ERROR: Could not find a version that satisfies the requirement airbyte-cdk~=0.2 (from source-acceptance-test==0.0.0->-r requirements.txt (line 1)) (from versions: 0.1.0rc3, 0.1.0rc4, 0.1.0rc5, 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6rc1, 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.1.10, 0.1.11, 0.1.12, 0.1.13, 0.1.14, 0.1.15, 0.1.16, 0.1.17, 0.1.18, 0.1.20, 0.1.21, 0.1.22, 0.1.23, 0.1.24, 0.1.25, 0.1.26, 0.1.27, 0.1.28, 0.1.29, 0.1.30, 0.1.31, 0.1.32, 0.1.33, 0.1.34, 0.1.35, 0.1.36, 0.1.37, 0.1.38, 0.1.39, 0.1.41, 0.1.42, 0.1.43, 0.1.44, 0.1.45, 0.1.46, 0.1.47, 0.1.48, 0.1.49, 0.1.50, 0.1.52, 0.1.53)
ERROR: No matching distribution found for airbyte-cdk~=0.2 (from source-acceptance-test==0.0.0->-r requirements.txt (line 1))
When installing requirements.txt
e
what airbyte version are you using?
m
0.40.25
e
go to 
airbyte-integrations/bases/source-acceptance-test
under 
setup.py
change the version of airbyte-cdk from 
airbyte-cdk~=0.2
to 
airbyte-cdk
run install again
y
Hi folks, looks like this might be an issue on our side. We’re investigating at the moment. Will follow-up once we have an update. Thank you for your patience! 🙏🏾
✅ 2
t
I got the same error today / over the weekend when trying to learn Airbyte and create a new YAML connector - I didn't get to the bottom of it but I think explicitly installing 
airbyte-cdk==0.15.0
stopped me from receiving this error, and allowed me to continue iterating on the connector 👍
y
Hi all, upgrading to 
0.16.1
should fix the issue going forward! Please let me know if you have any questions!
thanku 1
✅ 1
4 Views
Open in Slack
PreviousNext
Powered by