Error in using lookml connector
# troubleshoot
c
Error in using lookml connector
plus1 1
m
Hi @clean-tomato-22549 gentle reminder to not post long stacktraces on the main channel, but use threads to post them... this keeps the main messages visible
๐Ÿ‘Œ 1
Copy code
hey all. I am trying to ingest lookml.  but encounter error

!565 $ datahub ingest -c lookml.dhub.yaml 
[2022-07-19 03:54:12,857] INFO     {datahub.cli.ingest_cli:99} - DataHub CLI version: 0.8.41
[2022-07-19 03:54:12,887] INFO     {datahub.ingestion.run.pipeline:160} - Sink configured successfully. DataHubRestEmitter: configured to talk to <http://localhost:8080>
[2022-07-19 03:54:13,958] ERROR    {datahub.ingestion.run.pipeline:126} - lookml is disabled; try running: pip install 'acryl-datahub[lookml]'
[2022-07-19 03:54:13,958] INFO     {datahub.cli.ingest_cli:115} - Starting metadata ingestion
[2022-07-19 03:54:13,958] INFO     {datahub.cli.ingest_cli:133} - Finished metadata pipeline

Failed to create source due to lookml is disabled; try running: pip install 'acryl-datahub[lookml]'
While, lookml plugin already been installed

!566 $ pip install 'acryl-datahub[lookml]'
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: acryl-datahub[lookml] in /home/centos/.local/lib/python3.6/site-packages (0.8.41)
Requirement already satisfied: entrypoints in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.4)
Requirement already satisfied: dataclasses>=0.6 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.8)
Requirement already satisfied: expandvars>=0.6.5 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.9.0)
Requirement already satisfied: avro<1.11,>=1.10.2 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.10.2)
Requirement already satisfied: markupsafe<=2.0.1,>=1.1.1 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (2.0.1)
Requirement already satisfied: humanfriendly in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (10.0)
Requirement already satisfied: typing-inspect in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.7.1)
Requirement already satisfied: Deprecated in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.2.13)
Requirement already satisfied: mypy-extensions>=0.4.3 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.4.3)
Requirement already satisfied: mixpanel>=4.9.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (4.9.0)
Requirement already satisfied: progressbar2 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (3.55.0)
Requirement already satisfied: psutil>=5.8.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (5.9.1)
Requirement already satisfied: toml>=0.10.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.10.2)
Requirement already satisfied: PyYAML in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (6.0)
Requirement already satisfied: termcolor>=1.0.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.1.0)
Requirement already satisfied: types-termcolor>=1.0.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.1.5)
Requirement already satisfied: ratelimiter in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.2.0.post0)
Requirement already satisfied: click-default-group in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.2.2)
Requirement already satisfied: docker in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (5.0.3)
Requirement already satisfied: packaging in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (21.3)
Requirement already satisfied: python-dateutil>=2.8.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (2.8.2)
Requirement already satisfied: pydantic>=1.5.1 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.9.1)
Requirement already satisfied: click>=6.0.0 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (8.0.4)
Requirement already satisfied: types-Deprecated in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.2.9)
Requirement already satisfied: tabulate in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.8.10)
Requirement already satisfied: avro-gen3==0.7.4 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.7.4)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (4.1.1)
Requirement already satisfied: stackprinter in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (0.2.6)
Requirement already satisfied: looker-sdk==22.2.1 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (22.2.1)
Requirement already satisfied: sql-metadata==2.2.2 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (2.2.2)
Requirement already satisfied: sqllineage==1.3.5 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.3.5)
Requirement already satisfied: lkml>=1.1.2 in /home/centos/.local/lib/python3.6/site-packages (from acryl-datahub[lookml]) (1.2.0)
Requirement already satisfied: pytz in /home/centos/.local/lib/python3.6/site-packages (from avro-gen3==0.7.4->acryl-datahub[lookml]) (2022.1)
Requirement already satisfied: six in /home/centos/.local/lib/python3.6/site-packages (from avro-gen3==0.7.4->acryl-datahub[lookml]) (1.16.0)
Requirement already satisfied: tzlocal in /home/centos/.local/lib/python3.6/site-packages (from avro-gen3==0.7.4->acryl-datahub[lookml]) (4.2)
Requirement already satisfied: cattrs<1.1.0 in /home/centos/.local/lib/python3.6/site-packages (from looker-sdk==22.2.1->acryl-datahub[lookml]) (1.0.0)
Requirement already satisfied: attrs>=18.2.0 in /home/centos/.local/lib/python3.6/site-packages (from looker-sdk==22.2.1->acryl-datahub[lookml]) (21.4.0)
Requirement already satisfied: requests>=2.22 in /home/centos/.local/lib/python3.6/site-packages (from looker-sdk==22.2.1->acryl-datahub[lookml]) (2.27.1)
Requirement already satisfied: sqlparse<0.5.0,>=0.4.1 in /home/centos/.local/lib/python3.6/site-packages (from sql-metadata==2.2.2->acryl-datahub[lookml]) (0.4.2)
Requirement already satisfied: flask in /home/centos/.local/lib/python3.6/site-packages (from sqllineage==1.3.5->acryl-datahub[lookml]) (2.0.3)
Requirement already satisfied: werkzeug in /home/centos/.local/lib/python3.6/site-packages (from sqllineage==1.3.5->acryl-datahub[lookml]) (2.0.3)
Requirement already satisfied: networkx>=2.4 in /home/centos/.local/lib/python3.6/site-packages (from sqllineage==1.3.5->acryl-datahub[lookml]) (2.5.1)
Requirement already satisfied: flask-cors in /home/centos/.local/lib/python3.6/site-packages (from sqllineage==1.3.5->acryl-datahub[lookml]) (3.0.10)
Requirement already satisfied: importlib-metadata in /home/centos/.local/lib/python3.6/site-packages (from click>=6.0.0->acryl-datahub[lookml]) (4.8.3)
Requirement already satisfied: urllib3 in /home/centos/.local/lib/python3.6/site-packages (from mixpanel>=4.9.0->acryl-datahub[lookml]) (1.26.10)
Requirement already satisfied: wrapt<2,>=1.10 in /home/centos/.local/lib/python3.6/site-packages (from Deprecated->acryl-datahub[lookml]) (1.14.1)
Requirement already satisfied: websocket-client>=0.32.0 in /home/centos/.local/lib/python3.6/site-packages (from docker->acryl-datahub[lookml]) (1.3.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /home/centos/.local/lib/python3.6/site-packages (from packaging->acryl-datahub[lookml]) (3.0.9)
Requirement already satisfied: python-utils>=2.3.0 in /home/centos/.local/lib/python3.6/site-packages (from progressbar2->acryl-datahub[lookml]) (3.3.3)
Requirement already satisfied: decorator<5,>=4.3 in /home/centos/.local/lib/python3.6/site-packages (from networkx>=2.4->sqllineage==1.3.5->acryl-datahub[lookml]) (4.4.2)
Requirement already satisfied: charset-normalizer~=2.0.0 in /home/centos/.local/lib/python3.6/site-packages (from requests>=2.22->looker-sdk==22.2.1->acryl-datahub[lookml]) (2.0.12)
Requirement already satisfied: idna<4,>=2.5 in /home/centos/.local/lib/python3.6/site-packages (from requests>=2.22->looker-sdk==22.2.1->acryl-datahub[lookml]) (3.3)
Requirement already satisfied: certifi>=2017.4.17 in /home/centos/.local/lib/python3.6/site-packages (from requests>=2.22->looker-sdk==22.2.1->acryl-datahub[lookml]) (2022.6.15)
Requirement already satisfied: Jinja2>=3.0 in /home/centos/.local/lib/python3.6/site-packages (from flask->sqllineage==1.3.5->acryl-datahub[lookml]) (3.0.3)
Requirement already satisfied: itsdangerous>=2.0 in /home/centos/.local/lib/python3.6/site-packages (from flask->sqllineage==1.3.5->acryl-datahub[lookml]) (2.0.1)
Requirement already satisfied: zipp>=0.5 in /home/centos/.local/lib/python3.6/site-packages (from importlib-metadata->click>=6.0.0->acryl-datahub[lookml]) (3.6.0)
Requirement already satisfied: backports.zoneinfo in /home/centos/.local/lib/python3.6/site-packages (from tzlocal->avro-gen3==0.7.4->acryl-datahub[lookml]) (0.2.1)
Requirement already satisfied: pytz-deprecation-shim in /home/centos/.local/lib/python3.6/site-packages (from tzlocal->avro-gen3==0.7.4->acryl-datahub[lookml]) (0.1.0.post0)
Requirement already satisfied: importlib-resources in /home/centos/.local/lib/python3.6/site-packages (from backports.zoneinfo->tzlocal->avro-gen3==0.7.4->acryl-datahub[lookml]) (5.4.0)
Requirement already satisfied: tzdata in /home/centos/.local/lib/python3.6/site-packages (from pytz-deprecation-shim->tzlocal->avro-gen3==0.7.4->acryl-datahub[lookml]) (2022.1)
 version info

!568 $ datahub --version
acryl-datahub, version 0.8.41 

!567 $ python3 --version
Python 3.6.8
Could you edit the main message to just be -> Error in using lookml connector ๐Ÿงต
meanwhile, can you run
datahub check plugins --verbose
c
I tried and get following info
Copy code
lookml         (disabled)          ModuleNotFoundError('The lookml plugin requires Python 3.7 or newer.',)
OK. I will try to update python3. Any suggested version, where datahub also works.
m
3.7 onwards should work for lookml
the devs are usually working with 3.9
c
thx
n
Hi @mammoth-bear-12532, I'm having the same issue, I'm using python 3.10. @clean-tomato-22549update python worked for you?
c
Yes. Although it is not easy to update python version, it does work. Thx to check.