Hello, everyone, I am trying to ingest metadata fr...
# ingestion
l
Hello, everyone, I am trying to ingest metadata from mssqls, two of which succeeded, but one alarm. How to solve it? Thanks in advance for your help
Copy code
'Error: Client does not have encryption enabled but it is required by server, enable encryption and try connecting again\n'
Configure Recipe:
Copy code
source:
    type: mssql
    config:
        env: QA
        host_port: '10.xxxx:50920'
        database: OA
        username: xxx
        password: 'oaxxxxn'
sink:
    type: datahub-rest
    config:
        server: '<http://datahub-gms:8080>'
logs:
Copy code
'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/sqlalchemy/engine/strategies.py", line '
           '114, in connect\n'
           '    return dialect.connect(*cargs, **cparams)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 508, '
           'in connect\n'
           '    return self.dbapi.connect(*cargs, **cparams)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/__init__.py", line 1345, in '
           'connect\n'
           '    conn._open(sock=sock)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/__init__.py", line 372, in _open\n'
           '    self._try_open(timeout=retry_time, sock=sock)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/__init__.py", line 354, in '
           '_try_open\n'
           '    self._connect(host=host, port=port, instance=instance, timeout=timeout, sock=sock)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/__init__.py", line 304, in '
           '_connect\n'
           '    route = conn.login(login, sock, self._tzinfo_factory)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/tds.py", line 1703, in login\n'
           '    self._main_session.process_prelogin(login)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/tds.py", line 1294, in '
           'process_prelogin\n'
           '    self.parse_prelogin(octets=p, login=login)\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/pytds/tds.py", line 1343, in '
           'parse_prelogin\n'
           "    raise tds_base.Error('Client does not have encryption enabled but it is required by server, '\n"
           '\n'
           'Error: Client does not have encryption enabled but it is required by server, enable encryption and try connecting again\n'
           '\n'
           'The above exception was the direct cause of the following exception:\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/datahub/cli/ingest_cli.py", line 106, in '
           'run\n'
           '    88   def run(\n'
           '    89       ctx: click.Context,\n'
           '    90       config: str,\n'
           '    91       dry_run: bool,\n'
           '    92       preview: bool,\n'
           '    93       strict_warnings: bool,\n'
           '    94       preview_workunits: int,\n'
           '    95       suppress_error_logs: bool,\n'
           '    96   ) -> None:\n'
           ' (...)\n'
           '    102      pipeline_config = load_config_file(config_file)\n'
           '    103  \n'
           '    104      try:\n'
           '    105          logger.debug(f"Using config: {pipeline_config}")\n'
           '--> 106          pipeline = Pipeline.create(pipeline_config, dry_run, preview, preview_workunits)\n'
           '    107      except ValidationError as e:\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-91f9ab72-fe31-48a7-93d1-378e08f9ea5f/lib/python3.9/site-packages/datahub/ingestion/run/pipeline.py", line '
           '204, in create\n'
           '    196  def create(\n'
           '    197      cls,\n'
           '    198      config_dict: dict,\n'
           '    199      dry_run: bool = False,\n'
           '    200      preview_mode: bool = False,\n'
           '    201      preview_workunits: int = 10,\n'
           '    202  ) -> "Pipeline":\n'
           '    203      config = PipelineConfig.parse_obj(config_dict)\n'
           '--> 204      return cls(\n'
           '    205          config,\n'
           '\n'
c
Hi @lemon-zoo-63387 seems like actual issue is during config parsing. Can you cross check your recipe and see if something expected is there. Please tag me when you respond.
l
hi,@careful-pilot-86309,I have consulted. It turns out that DBA has enabled SSL authentication for MSSQL, and datahub does not have this configuration for the time being
c
@lemon-zoo-63387 Thanks a lot for update. Feel free raise feature request here