https://datahubproject.io logo
Join Slack
Powered by
thrift.transport.TTransport.TTransportException: C...
# ingestion
b
thrift.transport.TTransport.TTransportException: Could not start SASL: b’Error in sasl_client_start (-4) SASL(-4): no mechanism available: No worthy mechs found’
m
Hi @brief-insurance-68141, I have seen this error reported a couple of days as well. I'll tag you on that thread. Could you share your recipe? And if possible a full log as well.
b
@miniature-tiger-96062
source: type: hive config: # Coordinates host_port: ip-10-0-10-20.ec2.internal:9083 # database: DemoDatabase # optional, if not specified, ingests from all databases # Credentials # username: user # optional # password: pass # optional # For more details on authentication, see the PyHive docs: # https://github.com/dropbox/PyHive#passing-session-configuration. # LDAP, Kerberos, etc. are supported using connect_args, which can be # added under the 
options
config parameter. # scheme: ‘hive+http’ # set this if Thrift should use the HTTP transport #scheme: ‘hive+https’ # set this if Thrift should use the HTTP with SSL transport sink: type: “datahub-rest” config: server: “http://datahub-datahub-gms:8080”
cursor = hive.Connection(host=“http://ip-10-0-10-20.ec2.internal”, port=9083)
>> from pyhive import hive
>> from TCLIService.ttypes import TOperationState
>> cursor = hive.Connection(host=“10.0.15.26", port=9083)
Traceback (most recent call last): File “<stdin>“, line 1, in <module> File “/usr/local/lib/python3.8/site-packages/pyhive/hive.py”, line 267, in init self._transport.open() File “/usr/local/lib/python3.8/site-packages/thrift_sasl/__init__.py”, line 84, in open raise TTransportException(type=TTransportException.NOT_OPEN, thrift.transport.TTransport.TTransportException: Could not start SASL: b’Error in sasl_client_start (-4) SASL(-4): no mechanism available: No worthy mechs found’
@miniature-tiger-96062 that is the whole log
✔️ 1
thank you
@miniature-tiger-96062, is that recent image has issume.
datahub-ingestion-cron: enabled: true image: repository: linkedin/datahub-ingestion tag: “v0.8.14”
@miniature-tiger-96062 do you which tag I can try?
m
@brief-insurance-68141: if you want to try an older image: you can try 
v0.8.10
and let us know if that ingestion works
@brief-insurance-68141: did you set 
scheme: 'hive+https'
like the docs say
@brief-insurance-68141 @polite-flower-25924 : which hadoop platform are you using?
m
I got the same error. and after a while for investigation, it's turn out missing 
libsasl2-modules
package.
m
did you resolve this using a 
yum install
?
m
apt
actually
b
I resolved this using previous tag in ingestion.
m
oh that is interesting and disappointing... which tag was that
0.8.10 ?
and @brief-insurance-68141: can you let us know what your Hadoop cluster is? on-prem / Azure HDInsight / Databricks / ... since all these behave a bit differently
b
@mammoth-bear-12532, EMR
c9c1ba4, Img tag
p
@mammoth-bear-12532 AWS EMR 5.30-1: • Hadoop 2.8.5 • Hive 2.3.6 • HCatalog 2.3.6
m
Thanks both. @polite-flower-25924 could you see if installing 
libsasl-modules
works for you?
p
I will try it tomorrow and let you know 🙂 Thanks
@mammoth-bear-12532 you mean install 
libsasl-modules
in datahub-ingestion image, right ?
Adding 
libsasl2-modules
library here fixed the issue. Should I create a PR for that?
m
oh nice! that’s great @polite-flower-25924 please send that PR!
p
h
hi @mammoth-bear-12532 any update for this issues I sill get this error when ingest from HIVE with kerberos enabled
finally, I installed 
libsasl2-modules-gssapi-mit
for GSSAPI authentication and it's worked
16 Views
Open in Slack
PreviousNext
Powered by