Hello Everyone, I am trying to eshtablish connection with S3 Data Lake, using the below connection string. However, I am getting the below error. Any suggestion for the same would be helpful.

source:
    type: s3
    config:
        path_specs:
            -
                include: '<s3://datahub-poc/account/csv/nodes/*.*>'
        aws_config:
            aws_access_key_id: ************
            aws_secret_access_key: ************
            aws_region: us-east-2
        env: PROD
        profiling:
            enabled: false

datahub.ingestion.run.pipeline.PipelineInitError: Failed to find a registered source for type s3: SPARK_VERSION environment variable is required. Supported values are: dict_keys(['3.3', '3.2', '3.1', '3.0', '2.4'])

Hi, this is a known bug; there are 2 things that you can try : • add SPARK_VERSION to your env : https://datahubspace.slack.com/archives/C029A3M079U/p1689071272782439 • bump up the version to v0.10.5.2rc2 https://datahubspace.slack.com/archives/C029A3M079U/p1689240320473359?thread_ts=1689239256.096109&cid=C029A3M079U

Hello Everyone, I am trying to ingest data for MongoDB in Datahub using the below recipe but I am getting the below error:- source: type: mongodb config: connect_uri: 'mongodb://user:XXXXXX@00.000.000.000:27017/adv8_qlik?tls=false&readPreference=primary&replicaSet=rs01&authMechanism=SCRAM-SHA-1&authSource=adv8_qlik&directConnection=true' username: user password: XXXXXX enableSchemaInference: true useRandomSampling: true maxSchemaSize: 300

File "/tmp/datahub/ingest/venv-mongodb-f3c1b67e57e34548/lib/python3.10/site-packages/datahub/ingestion/source/mongodb.py", line 472, in get_workunits_internal
    data_platform_instance,
UnboundLocalError: local variable 'data_platform_instance' referenced before assignment

Please suggest on this issue. Thanks!

Hey Jyotika! It looks like Tony has opened a PR to resolve this issue https://datahubspace.slack.com/archives/C017W0NTZHR/p1703015230579819