When trying to build datahub in local I am facing the build DataHub #troubleshoot

When trying to build datahub in local....I am faci...

nutritious-bird-77396

11/09/2021, 7:24 PM

When trying to build datahub in local....I am facing the build errors due to test failures..

Copy code

=========================== short test summary info ============================
FAILED tests/unit/test_glue_source.py::test_get_column_type_contains_key - bo...
FAILED tests/unit/test_glue_source.py::test_get_column_type_contains_array - ...
FAILED tests/unit/test_glue_source.py::test_get_column_type_contains_map - bo...
FAILED tests/unit/test_glue_source.py::test_get_column_type_contains_set - bo...
FAILED tests/unit/test_glue_source.py::test_get_column_type_not_contained - b...
FAILED tests/unit/test_glue_source.py::test_glue_ingest - botocore.exceptions...
FAILED tests/unit/test_glue_source.py::test_underlying_platform_takes_precendence
FAILED tests/unit/test_glue_source.py::test_underlying_platform_cannot_be_other_than_athena
FAILED tests/unit/test_glue_source.py::test_without_underlying_platform - bot...
FAILED tests/unit/sagemaker/test_sagemaker_source.py::test_sagemaker_ingest
========== 10 failed, 154 passed, 18 deselected, 2 warnings in 34.06s ==========

> Task :metadata-ingestion:testQuick FAILED

Any idea on what i am missing? More details in 🧵

nutritious-bird-77396

11/09/2021, 7:25 PM

For most of the tests the error is the same as below

Copy code

self = <botocore.credentials.SharedCredentialProvider object at 0x14ef74430>
mapping = {'aws_access_key_id': 'xxxxxxxxxx'}
key_names = ('aws_access_key_id', 'aws_secret_access_key')
found = ['xxxxxxxx'], key_name = 'aws_secret_access_key'

    def _extract_creds_from_mapping(self, mapping, *key_names):
        found = []
        for key_name in key_names:
            try:
                found.append(mapping[key_name])
            except KeyError:
>               raise PartialCredentialsError(provider=self.METHOD,
                                              cred_var=key_name)
E               botocore.exceptions.PartialCredentialsError: Partial credentials found in shared-credentials-file, missing: aws_secret_access_key

venv/lib/python3.8/site-packages/botocore/credentials.py:943: PartialCredentialsError

nutritious-bird-77396

11/09/2021, 11:03 PM

As of now I am working with quickstart docker but would like to understand the reason for the above failures to be able to local builds....

mammoth-bear-12532

11/10/2021, 3:25 PM

@nutritious-bird-77396: can you git pull to latest and see if you can still reproduce it?

nutritious-bird-77396

11/10/2021, 3:58 PM

@mammoth-bear-12532 Did a forced update https://medium.com/@topspinj/how-to-git-rebase-into-a-forked-repo-c9f05e821c8a Still hitting on

PartialCredentialsError

mammoth-bear-12532

11/10/2021, 4:05 PM

@nutritious-bird-77396: I wonder if it is picking up some AWS Profile from your env and getting confused

nutritious-bird-77396

11/10/2021, 4:21 PM

I reset the

.zshrc

file and that worked. Thanks @mammoth-bear-12532

🎉 2

3 Views

Open in Slack

Previous Next