https://datahubproject.io logo
Join Slack
Powered by
a
Hi Team
b
Hi there! What type of machine are you running on? It seems like it's taking a bit longer than expected to start up GMS
They don't appear to be error messages
a
8GB of Ram Linux-Ubuntu
g
@alert-fall-82501 the quickstart process should have written logs to a file and printed the path to it - could you upload that log file here so we can debug?
a
@gray-shoe-75895 in which path I should get it
you mean yaml file
g
I do mean log file here - the docker quickstart command should’ve printed out a message 
Be sure to attach the logs from <file>
, and I was hoping to see that file
a
kiranto@administrator-HCL-Desktop:~/Documents/datalake/datahub/airflow/dags/datahub/recipes/dev/datahubnew$ datahub ingest -c reciepe.yaml /usr/lib/python3/dist-packages/requests/__init__.py89 RequestsDependencyWarning: urllib3 (1.26.11) or chardet (3.0.4) doesn't match a supported version! warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported " /usr/lib/python3/dist-packages/paramiko/transport.py219 CryptographyDeprecationWarning: Blowfish has been deprecated "class": algorithms.Blowfish, [2022-08-02 130943,086] INFO {datahub.cli.ingest_cli:170} - DataHub CLI version: 0.8.41.2 [2022-08-02 130944,780] INFO {datahub.ingestion.run.pipeline:163} - Sink configured successfully. DataHubRestEmitter: configured to talk to http://localhost:8080 Illegal instruction (core dumped)
Unable to run quickstart - the following issues were detected: - kafka-setup is still running - mysql-setup is still running - datahub-gms is running but not healthy - elasticsearch-setup is still running - elasticsearch is running but not healthy If you think something went wrong, please file an issue at https://github.com/datahub-project/datahub/issues or send a message in our Slack https://slack.datahubproject.io/ Be sure to attach the logs from /tmp/tmpoh5b07wb.log
g
The 
Illegal instruction (core dumped)
line indicates that something at a low-level is wrong with your installation of python / other packages. Are you on an M1 machine by chance?
Additionally, i’d recommend running datahub inside of a python venv to avoid conflicts from other packages you’ve got installed on your machine
a
Hi @gray-shoe-75895 I am have ubuntu and 8gb of RAM
does it matter 8gb of ram ?
g
The 8gb ram should be enough
Could you try setting up a python venv to avoid dependency conflicts?
a
no
i will try .you mean create venv and try datahub things on it
g
yep
a
some of your colleague from git support team says atleast 12gb of ram needed.thas why asked about it
g
I’ve seen it work with 8gb before, but if you’ve got many other things running then 8gb will not be enough
If you can easily increase to 12gb ram, then that might help solve the quickstart issues
a
but I am able to access Datahub UI and ingest data to it
but if I do it from CLI then I am facing some issue
g
Ah I see - in that case, the venv will hopefully resolve those issues
a
Copy code
~~~~ Execution Summary ~~~~

RUN_INGEST - {'errors': [],
 'exec_id': '70ff9ca8-8f88-49f1-8568-e7724ab56b82',
 'infos': ['2022-08-02 17:40:55.235920 [exec_id=70ff9ca8-8f88-49f1-8568-e7724ab56b82] INFO: Starting execution for task with name=RUN_INGEST',
           '2022-08-02 17:41:13.562074 [exec_id=70ff9ca8-8f88-49f1-8568-e7724ab56b82] INFO: stdout=Elapsed seconds = 0\n'
           'datahub ingest run -c /tmp/datahub/ingest/70ff9ca8-8f88-49f1-8568-e7724ab56b82/recipe.yml \n'
           '[2022-08-02 17:40:59,836] INFO     {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.41\n'
           '[2022-08-02 17:41:13,067] ERROR    {datahub.entrypoints:167} - File '
           '"/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn\n'
           '    161  def _new_conn(self):\n'
           ' (...)\n'
           '    170      if self.socket_options:\n'
           '    171          extra_kw["socket_options"] = self.socket_options\n'
           '    172  \n'
           '    173      try:\n'
           '--> 174          conn = connection.create_connection(\n'
           '    175              (self._dns_host, self.port), self.timeout, **extra_kw\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/util/connection.py", line 95, in create_connection\n'
           '    37   def create_connection(\n'
           '    38       address,\n'
           '    39       timeout=socket._GLOBAL_DEFAULT_TIMEOUT,\n'
           '    40       source_address=None,\n'
           '    41       socket_options=None,\n'
           '    42   ):\n'
           ' (...)\n'
           '    91                   sock.close()\n'
           '    92                   sock = None\n'
           '    93   \n'
           '    94       if err is not None:\n'
           '--> 95           raise err\n'
           '    96   \n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/util/connection.py", line 85, in create_connection\n'
           '    37   def create_connection(\n'
           '    38       address,\n'
           '    39       timeout=socket._GLOBAL_DEFAULT_TIMEOUT,\n'
           '    40       source_address=None,\n'
           '    41       socket_options=None,\n'
           '    42   ):\n'
           ' (...)\n'
           '    81               if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT:\n'
           '    82                   sock.settimeout(timeout)\n'
           '    83               if source_address:\n'
           '    84                   sock.bind(source_address)\n'
           '--> 85               sock.connect(sa)\n'
           '    86               return sock\n'
           '\n'
           'ConnectionRefusedError: [Errno 111] Connection refused\n'
           '\n'
           'While handling the above exception, another exception occurred:\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in urlopen\n'
           '    522  def urlopen(\n'
           '    523      self,\n'
           '    524      method,\n'
           '    525      url,\n'
           '    526      body=None,\n'
           '    527      headers=None,\n'
           '    528      retries=None,\n'
           '    529      redirect=True,\n'
           '    530      assert_same_host=True,\n'
           '    531      timeout=_Default,\n'
           '    532      pool_timeout=None,\n'
           '    533      release_conn=None,\n'
           '    534      chunked=False,\n'
           '    535      body_pos=None,\n'
           '    536      **response_kw\n'
           '    537  ):\n'
           ' (...)\n'
           '    699          if is_new_proxy_conn and http_tunnel_required:\n'
           '    700              self._prepare_proxy(conn)\n'
           '    701  \n'
           '    702          # Make the request on the httplib connection object.\n'
           '--> 703          httplib_response = self._make_request(\n'
           '    704              conn,\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connectionpool.py", line 398, in _make_request\n'
           '    361  def _make_request(\n'
           '    362      self, conn, method, url, timeout=_Default, chunked=False, **httplib_request_kw\n'
           '    363  ):\n'
           ' (...)\n'
           '    394      try:\n'
           '    395          if chunked:\n'
           '    396              conn.request_chunked(method, url, **httplib_request_kw)\n'
           '    397          else:\n'
           '--> 398              conn.request(method, url, **httplib_request_kw)\n'
           '    399  \n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 239, in request\n'
           '    231  def request(self, method, url, body=None, headers=None):\n'
           ' (...)\n'
           '    235          # Avoid modifying the headers passed into .request()\n'
           '    236          headers = headers.copy()\n'
           '    237      if "user-agent" not in (six.ensure_str(k.lower()) for k in headers):\n'
           '    238          headers["User-Agent"] = _get_default_user_agent()\n'
           '--> 239      super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n'
           '\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1285, in request\n'
           '    1282  def request(self, method, url, body=None, headers={}, *,\n'
           '    1283              encode_chunked=False):\n'
           '    1284      """Send a complete request to the server."""\n'
           '--> 1285      self._send_request(method, url, body, headers, encode_chunked)\n'
           '\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request\n'
           '    1287  def _send_request(self, method, url, body, headers, encode_chunked):\n'
           ' (...)\n'
           '    1327      if isinstance(body, str):\n'
           '    1328          # RFC 2616 Section 3.7.1 says that text default has a\n'
           '    1329          # default charset of iso-8859-1.\n'
           "    1330          body = _encode(body, 'body')\n"
           '--> 1331      self.endheaders(body, encode_chunked=encode_chunked)\n'
           '\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders\n'
           '    1269  def endheaders(self, message_body=None, *, encode_chunked=False):\n'
           ' (...)\n'
           '    1276      if self.__state == _CS_REQ_STARTED:\n'
           '    1277          self.__state = _CS_REQ_SENT\n'
           '    1278      else:\n'
           '    1279          raise CannotSendHeader()\n'
           '--> 1280      self._send_output(message_body, encode_chunked=encode_chunked)\n'
           '\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output\n'
           '    1031  def _send_output(self, message_body=None, encode_chunked=False):\n'
           ' (...)\n'
           '    1036      """\n'
           '    1037      self._buffer.extend((b"", b""))\n'
           '    1038      msg = b"\\r\\n".join(self._buffer)\n'
           '    1039      del self._buffer[:]\n'
           '--> 1040      self.send(msg)\n'
           '    1041  \n'
           '\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 980, in send\n'
           '    972  def send(self, data):\n'
           ' (...)\n'
           '    976      """\n'
           '    977  \n'
           '    978      if self.sock is None:\n'
           '    979          if self.auto_open:\n'
           '--> 980              self.connect()\n'
           '    981          else:\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect\n'
           '    204  def connect(self):\n'
           '--> 205      conn = self._new_conn()\n'
           '    206      self._prepare_conn(conn)\n'
           '\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn\n'
           '    161  def _new_conn(self):\n'
           ' (...)\n'
           '    182              % (self.host, self.timeout),\n'
           '    183          )\n'
           '    184  \n'
           '    185      except SocketError as e:\n'
           '--> 186          raise NewConnectionError(\n'
           '    187              self, "Failed to establish a new connection: %s" % e\n'
           '\n'
           '---- (full traceback above) ----\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connectionpool.py", line 703, in urlopen\n'
           '    httplib_response = self._make_request(\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connectionpool.py", line 398, in _make_request\n'
           '    conn.request(method, url, **httplib_request_kw)\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 239, in request\n'
           '    super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1285, in request\n'
           '    self._send_request(method, url, body, headers, encode_chunked)\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1331, in _send_request\n'
           '    self.endheaders(body, encode_chunked=encode_chunked)\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1280, in endheaders\n'
           '    self._send_output(message_body, encode_chunked=encode_chunked)\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 1040, in _send_output\n'
           '    self.send(msg)\n'
           'File "/usr/local/lib/python3.9/http/client.py", line 980, in send\n'
           '    self.connect()\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 205, in connect\n'
           '    conn = self._new_conn()\n'
           'File "/tmp/datahub/ingest/venv-delta-lake-0.8.41/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn\n'
           '    raise NewConnectionError(\n'
           '\n'
           'NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f8ed5a0a6a0>: Failed to establish a new connection: [Errno 111] '
           'Connection refused\n'
           '\n'
           'While handling the above exception, another exception occurred:\n'
           '\n'
'
Hi @gray-shoe-75895 it is fine for me to work with UI . I task is to retrieve the data from amazon s3 to datahub ,can you please suggest me on this ?
I am getting above error while ingesting it
g
Looks like the error is 
Connection refused
- it’s unable to access something?
a
Copy code
source:
  type: delta-lake
  config:
    env: "DEV"
    base_path : "<s3a://dt.lakehouse.uevents.dev.eventsData.us-west-1>"
    s3:
      aws_config:
        aws_config:
        aws_access_key_id: 
        aws_secret_access_key: 


sink:

  type : "datahub-rest"
  config :
    server : "<http://localhost:8080>"
here is the yaml file
g
The config looks ok - from the error logs, it’s not clear if the issue is connecting to datahub or to delta lake
a
I have send you half of the error message .let me send you full details
please check
g
are you using managed ingestion via the UI?
a
yes
custom source choosen
g
ah for managed ingestion, I think you don’t need to specify the sink in your yaml
a
hi ok
Copy code
~~~~ Execution Summary ~~~~

RUN_INGEST - {'errors': [],
 'exec_id': '44ea63ff-9eb2-4136-a22d-96779fc0bf91',
 'infos': ['2022-08-02 18:24:03.484582 [exec_id=44ea63ff-9eb2-4136-a22d-96779fc0bf91] INFO: Starting execution for task with name=RUN_INGEST',
           '2022-08-02 18:24:13.931576 [exec_id=44ea63ff-9eb2-4136-a22d-96779fc0bf91] INFO: stdout=Elapsed seconds = 0\n'
           'datahub ingest run -c /tmp/datahub/ingest/44ea63ff-9eb2-4136-a22d-96779fc0bf91/recipe.yml \n'
           '[2022-08-02 18:24:10,302] INFO     {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.41\n'
           'No ~/.datahubenv file found, generating one for you...\n'
           '[2022-08-02 18:24:10,517] INFO     {datahub.ingestion.run.pipeline:160} - Sink configured successfully. DataHubRestEmitter: configured '
           'to talk to <http://datahub-gms:8080>\n'
           '/usr/local/bin/run_ingest.sh: line 33:   225 Illegal instruction     (core dumped) ( datahub ingest run -c "${recipe_file}" '
           '${report_option} )\n',
           "2022-08-02 18:24:13.932065 [exec_id=44ea63ff-9eb2-4136-a22d-96779fc0bf91] INFO: Failed to execute 'datahub ingest'",
           '2022-08-02 18:24:13.932540 [exec_id=44ea63ff-9eb2-4136-a22d-96779fc0bf91] INFO: Caught exception EXECUTING '
           'task_id=44ea63ff-9eb2-4136-a22d-96779fc0bf91, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 122, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 112, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"]}
Execution finished with errors.
I just put the source thing and tried managed ingestion
source: type: delta-lake config: env: DEV base_path: 's3a://dt.lakehouse.uevents.dev.eventsData.us-west-1' s3: aws_config: aws_access_key_id: aws_secret_access_key:
this is the yaml file
please suggest
g
that’s quite a strange error - I’m asking some other people on the acryl team for help
a
OK FINE
Thank You for your kind help @gray-shoe-75895
Hi
did you find anything with team ?
with simple sql ingestion error
Copy code
source:
  type: "mysql"
  config:
    username : "datahub"
    password : "datahub"
    host_port: "localhost:3306"
yaml file
g
the issue there is that localhost doesn’t work inside of docker containers
the log is here in that file:
Copy code
'OperationalError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'localhost\' ([Errno 99] Cannot assign '
           'requested address)")\n'
a
What do you suggest then ?
g
You’ll need to expose your mysql container in a way that the docker container can connect to it - you can reference the docker networking docs for some techniques there
The other option is to run ingestion using the cli tool rather than through the UI-based managed ingestion
the latter is probably easier
a
ok .as you have suggested i will try to run venv of python .will update
thanks
g
Hi @gray-shoe-75895 I took a call with Kiran in regards to core dump, his machine is not responding, taking too much time to open just a Firefox , terminal, and any action taking much more time etc.... He has docker engine, and DataHub services on same machine. so I suggested to first increase the RAM to 16 GB and then try out.
g
Sounds good, thanks @gentle-hamburger-31302
a
Issue was with memory . enhance the RAM to 16 GB .Now It is working fine .Thanks Team for your support
5 Views
Open in Slack
PreviousNext
Powered by