Hi <@U04SE163WC8> I am developing a custom connect...
# ask-ai
a
Hi @kapa.ai I am developing a custom connector. I was able to build images of it earlier. Today I added some dependencies to my pyproject.toml and am trying to build a new image. I get the following error: ERROR: Could not find a version that satisfies the requirement airbyte-cdk<6,>=5 (from source-shopify) (from versions: 0.1.0rc3, 0.1.0rc4, 0.1.0rc5, 0.1.1, 0.1.2, 0.1.3, 0.1.4, 0.1.5, 0.1.6rc1, 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.1.10, 0.1.11, 0.1.12, 0.1.13, 0.1.14, 0.1.15, 0.1.16, 0.1.17, 0.1.18, 0.1.20, 0.1.21, 0.1.22, 0.1.23, 0.1.24, 0.1.25, 0.1.26, 0.1.27, 0.1.28, 0.1.29, 0.1.30, 0.1.31, 0.1.32, 0.1.33, 0.1.34, 0.1.35, 0.1.36, 0.1.37, 0.1.38, 0.1.39, 0.1.41, 0.1.42, 0.1.43, 0.1.44, 0.1.45, 0.1.46, 0.1.47, 0.1.48, 0.1.49, 0.1.50, 0.1.52, 0.1.53, 0.1.54, 0.1.55, 0.1.56, 0.1.57, 0.1.58, 0.1.59, 0.1.60, 0.1.61, 0.1.62, 0.1.63, 0.1.64, 0.1.65, 0.1.66, 0.1.67, 0.1.68, 0.1.69, 0.1.70, 0.1.71, 0.1.72, 0.1.73, 0.1.74, 0.1.75, 0.1.76, 0.1.77, 0.1.78, 0.1.79, 0.1.80, 0.1.81, 0.1.82, 0.1.83, 0.1.84, 0.1.85, 0.1.86, 0.1.87, 0.1.88, 0.1.89, 0.1.90, 0.1.91, 0.1.92, 0.1.93, 0.1.94, 0.1.95, 0.1.96, 0.1.97, 0.1.98, 0.1.99, 0.1.100, 0.1.101, 0.1.102, 0.1.103, 0.1.104, 0.2.0, 0.2.1, 0.2.2, 0.2.3, 0.4.0, 0.4.1, 0.4.2, 0.5.2, 0.5.3, 0.5.4, 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1, 0.9.0, 0.9.1, 0.9.2, 0.9.3, 0.9.4, 0.9.5, 0.10.0, 0.11.0, 0.11.1, 0.11.2, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2, 0.12.3, 0.12.4, 0.13.0, 0.13.1, 0.13.2, 0.13.3, 0.14.0, 0.15.0, 0.16.0, 0.16.1, 0.16.2, 0.16.3, 0.17.0, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0, 0.20.1, 0.20.2, 0.21.0, 0.22.0, 0.23.0, 0.24.0, 0.25.0, 0.25.1, 0.25.2, 0.26.0, 0.27.0, 0.28.0, 0.28.1, 0.29.0, 0.29.1, 0.29.2, 0.29.3, 0.30.0, 0.30.1, 0.30.2, 0.30.3, 0.30.4, 0.31.0, 0.31.1, 0.32.0, 0.33.0, 0.33.1, 0.33.2, 0.34.0, 0.34.1, 0.34.2, 0.34.3, 0.35.0, 0.35.1, 0.35.2, 0.35.3, 0.35.4, 0.36.0, 0.36.1, 0.36.2, 0.36.3, 0.36.4, 0.36.5, 0.37.0, 0.38.0, 0.39.0, 0.39.1, 0.39.2, 0.39.3, 0.39.4, 0.40.0, 0.40.1, 0.40.2, 0.40.3, 0.40.4, 0.40.5, 0.41.0, 0.42.0, 0.42.1, 0.43.0, 0.43.1, 0.43.2, 0.43.3, 0.44.0, 0.44.1, 0.44.2, 0.44.3, 0.44.4, 0.45.0, 0.46.0, 0.46.1, 0.47.0, 0.47.1, 0.47.2, 0.47.3, 0.47.4, 0.47.5, 0.48.0, 0.49.0, 0.50.0, 0.50.1, 0.50.2, 0.51.0, 0.51.1, 0.51.2, 0.51.3, 0.51.4, 0.51.5, 0.51.6, 0.51.7, 0.51.8, 0.51.9, 0.51.10, 0.51.11, 0.51.12, 0.51.13, 0.51.14, 0.51.15, 0.51.16, 0.51.17, 0.51.18, 0.51.19, 0.51.20, 0.51.21, 0.51.22, 0.51.23, 0.51.24, 0.51.25, 0.51.26, 0.51.27, 0.51.28, 0.51.29, 0.51.30, 0.51.31, 0.51.32, 0.51.33, 0.51.34, 0.51.35, 0.51.36, 0.51.37, 0.51.38, 0.51.39, 0.51.40, 0.51.41, 0.51.42, 0.51.43, 0.51.44, 0.52.0, 0.52.1, 0.52.2, 0.52.3, 0.52.4, 0.52.5, 0.52.6, 0.52.7, 0.52.8, 0.52.9, 0.52.10, 0.53.0, 0.53.1, 0.53.2, 0.53.3, 0.53.4, 0.53.5, 0.53.6, 0.53.7, 0.53.8, 0.53.9, 0.54.0, 0.55.0, 0.55.1, 0.55.2, 0.55.3, 0.55.4, 0.55.5, 0.56.0, 0.56.1, 0.57.0, 0.57.1, 0.57.2, 0.57.3, 0.57.4, 0.57.5, 0.57.6, 0.57.7, 0.57.8, 0.58.0, 0.58.1, 0.58.2, 0.58.3, 0.58.4, 0.58.5, 0.58.7, 0.58.8, 0.58.9, 0.59.0, 0.59.1, 0.59.2, 0.60.0, 0.60.1, 0.60.2, 0.61.0, 0.61.1, 0.61.2, 0.62.0, 0.62.1, 0.62.2, 0.63.0, 0.63.1, 0.63.2, 0.64.0, 0.64.1, 0.65.0, 0.66.0, 0.67.0, 0.67.1, 0.67.2, 0.67.3, 0.68.0, 0.68.1, 0.68.2, 0.68.3, 0.68.4, 0.69.0, 0.69.1, 0.69.2, 0.70.0, 0.70.1, 0.70.2, 0.71.0, 0.72.0, 0.72.1, 0.72.2, 0.73.0, 0.74.0, 0.75.0, 0.76.0, 0.77.0, 0.77.1, 0.77.2, 0.78.0, 0.78.1, 0.78.2, 0.78.3, 0.78.4, 0.78.5, 0.78.6, 0.78.8, 0.78.9, 0.79.0, 0.79.1, 0.79.2, 0.80.0, 0.81.0, 0.81.1, 0.81.2, 0.81.3, 0.81.4, 0.81.6, 0.81.7, 0.81.8, 0.82.0, 0.83.0, 0.83.1, 0.84.0, 0.85.0, 0.86.0, 0.86.1, 0.86.2, 0.86.3, 0.87.0, 0.88.0, 0.88.1, 0.88.2, 0.88.4, 0.89.0, 0.90.0, 1.0.0, 1.0.1, 1.1.0, 1.1.1, 1.1.2, 1.1.3, 1.2.0, 1.2.1, 1.3.0, 1.3.1, 1.3.2, 1.3.3, 1.4.0, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.6.0, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.8.0, 2.0.0, 2.1.0, 2.2.0, 2.3.0, 2.3.1, 2.4.0, 3.0.0, 3.1.0, 3.2.0, 3.2.1, 3.3.0, 3.4.0, 3.4.1, 3.5.0, 3.5.1, 3.5.2, 3.5.3, 3.6.0, 3.7.0, 3.8.0, 3.8.1, 3.8.2, 3.9.0, 3.9.1, 3.9.2, 3.9.3, 3.9.4, 3.9.5, 3.9.6) 2.799 ERROR: No matching distribution found for airbyte-cdk<6,>=5 here is what is in my dependencies section in pyproject.toml: [tool.poetry.dependencies] python = "^3.10,<3.12" airbyte-cdk = "^5" sgqlc = "==16.3" graphql-query = "^1" boto3 = "^1.15" botocore = "^1.21" mysql-connector-python = "^8.0"
u
The error message indicates that the version of
airbyte-cdk
you're trying to install (
^5
) is not available. The available versions are listed in the error message, and it seems that the version you're trying to install does not exist. You should adjust the version of
airbyte-cdk
in your
pyproject.toml
file to match one of the available versions. For example, if you want to use the latest version, you could change the line to:
Copy code
toml airbyte-cdk = "^0.81.8"
Please note that the
^
symbol in the version number means that it will install the latest minor or patch version that is not supposed to have breaking changes. If you want to install a specific version, you should remove the
^
symbol. Also, ensure that your Python version is up-to-date. As seen in a [forum post](https://discuss.airbyte.io/t/1397), a user faced a similar issue and was able to resolve it by updating their Python version. If you continue to face issues, please provide more details about the error message and your environment.
a
@kapa.ai I now get this error after upgrading airbyte-cdk ImportError: cannot import name 'ConfiguredAirbyteCatalog' from 'airbyte_cdk' (/Users/aaditi.thakkar/Library/Caches/pypoetry/virtualenvs/source-shopify-x74yURgK-py3.10/lib/python3.10/site-packages/airbyte_cdk/__init__.py)
u
A message from kapa.ai
u
The error message suggests that the
ConfiguredAirbyteCatalog
cannot be imported from
airbyte_cdk
. This could be due to a few reasons: 1. The
ConfiguredAirbyteCatalog
class might have been moved, renamed, or removed in the version of
airbyte_cdk
you're using. You should check the [Airbyte documentation](https://docs.airbyte.com/understanding-airbyte/beginners-guide-to-catalog#summary-of-the-postgres-example) or the source code of the
airbyte_cdk
package to verify this. 2. There might be an issue with your Python environment. Ensure that you're using the correct Python version and that your virtual environment is set up correctly. 3. There might be a problem with the
airbyte_cdk
installation. You could try reinstalling the package to see if that resolves the issue. If none of these suggestions help, please provide more details about your Python environment and the exact steps you're taking that lead to this error.
a
@kapa.ai how do I ensure I'm running the correct python version
u
A message from kapa.ai
u
You can check your Python version by running the following command in your terminal:
Copy code
bash python --version
This will output the version of Python that's currently active in your shell. If you're using
pyenv
to manage your Python versions (as recommended in the [Airbyte development documentation](https://docs.airbyte.io/contributing-to-airbyte/developing-locally)), you can check the current Python version with:
Copy code
bash pyenv version
To set a specific Python version with
pyenv
, you can use:
Copy code
bash pyenv install 3.9.11  # replace with your desired version pyenv global 3.9.11   # replace with your desired version
This will set the specified version as the default Python version for your entire system. If you want to set the Python version for a specific project, you should use
pyenv local
instead of
pyenv global
. Remember to replace
3.9.11
with the Python version that's compatible with your project. For Airbyte, the compatible Python version is
3.9.11
as mentioned in the [forum post](https://discuss.airbyte.io/t/2521).
a
@kapa.ai how do I reinstall airbyte-cdk
u
A message from kapa.ai
u
You can reinstall
airbyte-cdk
using pip, which is a package installer for Python. Here's how you can do it:
Copy code
bash pip uninstall airbyte-cdk pip install airbyte-cdk
The first command uninstalls the
airbyte-cdk
package, and the second command installs it again. If you're using a specific version of
airbyte-cdk
, you can specify it like this:
Copy code
bash pip install airbyte-cdk==0.1.56
Replace
0.1.56
with the version number you want to install. Please note that you might need to use
pip3
instead of
pip
if you're using Python 3. Also, if you're working in a virtual environment (which is a good practice), make sure you've activated it before running these commands.
a
@kapa.ai I am now getting this error:Traceback (most recent call last): File "<string>", line 1, in <module> File "/Users/aaditi.thakkar/.pyenv/versions/3.10.2/lib/python3.10/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1050, in _gcd_import File "<frozen importlib._bootstrap>", line 1027, in _find_and_load File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 688, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/Users/aaditi.thakkar/revenue-airbyte-shopify-connector/airbyte-integrations/connectors/source-shopify/source_shopify/__init__.py", line 25, in <module> from .source import SourceShopify File "/Users/aaditi.thakkar/revenue-airbyte-shopify-connector/airbyte-integrations/connectors/source-shopify/source_shopify/source.py", line 21, in <module> from .scopes import ShopifyScopes File "/Users/aaditi.thakkar/revenue-airbyte-shopify-connector/airbyte-integrations/connectors/source-shopify/source_shopify/scopes.py", line 10, in <module> from airbyte_cdk.sources.streams.http import HttpClient ImportError: cannot import name 'HttpClient' from 'airbyte_cdk.sources.streams.http' (/Users/aaditi.thakkar/Library/Caches/pypoetry/virtualenvs/source-shopify-x74yURgK-py3.10/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/__init__.py)
u
A message from kapa.ai
u
The error message suggests that the
HttpClient
cannot be imported from
airbyte_cdk.sources.streams.http
. This could be due to a few reasons: 1. The
HttpClient
class might have been moved, renamed, or removed in the version of
airbyte_cdk
you're using. You should check the [Airbyte documentation](https://docs.airbyte.com/connector-development/cdk-python/basic-concepts#http-streams) or the source code of the
airbyte_cdk
package to verify this. 2. There might be an issue with your Python environment. Ensure that you're using the correct Python version and that your virtual environment is set up correctly. 3. There might be a problem with the
airbyte_cdk
installation. You could try reinstalling the package to see if that resolves the issue. If none of these suggestions help, please provide more details about your Python environment and the exact steps you're taking that lead to this error.
a
@kapa.ai what info do you need about my Python env?
u
A message from kapa.ai
u
To help troubleshoot your issue, it would be useful to know the following about your Python environment: 1. Python Version: You can get this by running
python --version
in your terminal. 2. Package List: The list of installed Python packages and their versions can be helpful. You can get this by running
pip list
. 3. Virtual Environment: Are you using a virtual environment? If so, what tool are you using to manage it (e.g.,
venv
,
pyenv
,
conda
)? 4. Operating System: The operating system you're using can sometimes affect how Python and its packages work. 5. airbyte-cdk Version: The version of
airbyte-cdk
you're using. You can get this by running
pip show airbyte-cdk
. 6. Error Logs: If there are any more error messages or logs, they could be very helpful in diagnosing the problem. Please provide this information in your response.
a
@kapa.ai what is the latest airbyte-cdk version?
u
A message from kapa.ai
u
Based on the provided knowledge sources, the latest
airbyte-cdk
version mentioned is
0.89.0
as per the [Iterable changelog](https://docs.airbyte.com/integrations/sources/iterable#changelog) dated 2024-06-05. However, please note that this might not be the absolute latest version as the information could have been updated after the provided sources. For the most accurate and up-to-date version, please check the official Airbyte GitHub repository or PyPI.