polite-actor-701
01/03/2023, 12:27 AMancient-petabyte-52399
01/03/2023, 10:41 AMdatahub ingest -c delta.dhub.yaml
, happened this problem (in image). I don’t what root cause isbland-orange-13353
01/03/2023, 6:51 PMhallowed-shampoo-52722
01/03/2023, 6:51 PMgreen-lion-58215
01/03/2023, 6:59 PM[2023-01-03 18:03:43,123] {{python_operator.py:323}} INFO - Got error output
b'Traceback (most recent call last):\n File "/tmp/venveo6od6mv/script.py", line 113, in <module>\n res = generate_redshift_metadata(*args, **kwargs)\n File "/tmp/venveo6od6mv/script.py", line 9, in generate_redshift_metadata\n from datahub.ingestion.run.pipeline import Pipeline\n File "/tmp/venveo6od6mv/lib/python3.7/site-packages/datahub/ingestion/run/pipeline.py", line 16, in <module>\n from datahub.ingestion.api.committable import CommitPolicy\n File "/tmp/venveo6od6mv/lib/python3.7/site-packages/datahub/ingestion/api/__init__.py", line 1, in <module>\n from datahub.ingestion.api.common import RecordEnvelope\n File "/tmp/venveo6od6mv/lib/python3.7/site-packages/datahub/ingestion/api/common.py", line 5, in <module>\n import requests\n File "/usr/local/lib/python3.7/site-packages/requests/__init__.py", line 95, in <module>\n from urllib3.contrib import pyopenssl\n File "/usr/local/lib/python3.7/site-packages/urllib3/contrib/pyopenssl.py", line 46, in <module>\n import OpenSSL.SSL\n File "/usr/local/lib/python3.7/site-packages/OpenSSL/__init__.py", line 8, in <module>\n from OpenSSL import crypto, SSL\n File "/usr/local/lib/python3.7/site-packages/OpenSSL/crypto.py", line 3268, in <module>\n _lib.OpenSSL_add_all_algorithms()\nAttributeError: module \'lib\' has no attribute \'OpenSSL_add_all_algorithms\'\n'
hallowed-shampoo-52722
01/03/2023, 8:30 PMbland-lighter-26751
01/03/2023, 9:23 PMMETADATA_SERVICE_AUTH_ENABLED
environment variable to "true" for the datahub-gms
AND datahub-frontend
I then generated a token in the UI. After saving the token, I changed my recipe through the UI to look like
source:
type: metabase
config:
connect_uri: '<https://metabase.domain.com>'
username: <mailto:data@domain.com|data@domain.com>
password: password
sink:
type: datahub-rest
config:
token: eyJhbGciOiJIUzxxxxxxxxxxxxxxxxxxxxxx
When I try to run an ingestion, I get
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: <http://datahub-gms:8080/aspects?action=ingestProposal>
Am I missing something?brave-waitress-14748
01/04/2023, 3:15 AMacoustic-winter-85299
01/04/2023, 9:33 AMfaint-actor-78390
01/04/2023, 10:41 AMmelodic-dress-7431
01/04/2023, 12:48 PMcuddly-butcher-39945
01/04/2023, 3:41 PM"[2023-01-04 15:35:22,763] ERROR {datahub.entrypoints:213} - Command failed: Cmd('git') failed due to: exit code(128)\n"
' cmdline: git clone -v -- git@github.com:git@github.com:blahblahblah/blahblahblah.git '
'/tmp/tmpohcqgm1elookml_tmp/e8911598-aea0-4cf1-a5bd-beafafc35814/checkout\n'
" stderr: 'Cloning into '/tmp/tmpohcqgm1elookml_tmp/e8911598-aea0-4cf1-a5bd-beafafc35814/checkout'...\n"
"Warning: Permanently added 'github.com,444.44.444.444' (ECDSA) to the list of known hosts.\n"
'fatal: remote error: \n'
' is not a valid repository name\n'
' Visit https://support.github.com/ for help\n'
"'\n"
'Traceback (most recent call last):\n'
' File "/tmp/datahub/ingest/venv-lookml-0.9.5/lib/python3.10/site-packages/datahub/entrypoints.py", line 171, in main\n'
' sys.exit(datahub(standalone_mode=False, **kwargs))\n'
' File "/tmp/datahub/ingest/venv-lookml-0.9.5/lib/python3.10/site-packages/click/core.py", line 1130, in __call__\n'
I have verified the repo is correct, as well as my ingestion source yaml...
source:
type: lookml
config:
parse_table_names_from_sql: true
stateful_ingestion:
enabled: true
github_info:
repo: 'git@github.com:blahblahblah/blahblahblah.git'
deploy_key: "-----BEGIN RSA PRIVATE KEY-----\blahblahblahblah=\n-----END RSA PRIVATE KEY-----\n"
project_name: clinical
api:
base_url: 'https://sharphealblahblahblah.cloud.looker.com/'
client_id: blahblahblah
client_secret: blahblahblah
connection_to_platform_map:
snowflake_o:
platform: snowflake
default_db: dev_mart_db
Any help on this would be greatly appreciated!miniature-librarian-48611
01/04/2023, 7:22 PMminiature-plastic-43224
01/05/2023, 12:35 AMminiature-plastic-43224
01/05/2023, 12:47 AMplain-cricket-83456
01/05/2023, 1:38 AMlively-dusk-19162
01/05/2023, 3:00 AMrapid-city-92351
01/05/2023, 11:08 AMalert-fall-82501
01/05/2023, 11:19 AMproud-waitress-17589
01/05/2023, 5:29 PMfuture-iron-16086
01/05/2023, 4:04 PMsink:
type: datahub-rest
config:
server: '<http://datahub-datahub-gms:8080>'
token: '${TOKEN}'
source:
type: powerbi
config:
workspace_id_pattern:
allow:
- hidden
tenant_id: hidden
dataset_type_mapping:
PostgreSql: postgres
Oracle: oracle
SqlServer: mssql
client_secret: hidden
extract_ownership: false
env: qa
client_id: hidden
hallowed-shampoo-52722
01/05/2023, 6:14 PMrapid-fall-7147
01/06/2023, 6:05 AMmagnificent-notebook-88304
01/06/2023, 7:49 AMfaint-actor-78390
01/06/2023, 2:25 PMadorable-activity-7956
01/06/2023, 2:42 PMthankful-fireman-70616
01/06/2023, 3:19 PMpolite-art-12182
01/08/2023, 7:31 PMpolite-art-12182
01/08/2023, 7:39 PMalert-fall-82501
01/09/2023, 7:04 AM