Hi , has anyone had any success using

PyFlink

1.16.0 or 1.17.0 with a kerberized Hive cluster ? Using the below config in my

flink-conf.yaml

works only if i perform a

kinit

with

*.keytab

file prior to starting the pyflink job.

security.kerberos.login.use-ticket-cache: true

Without the

kinit

, if i use the following configs, i experience an error when the job attempts to connect to the

Hive-MetaStore

security.kerberos.login.use-ticket-cache: true 
security.kerberos.login.keytab: /app/home/user/pyflink.keytab
security.kerberos.login.principal: pyflink@DOMAIN.COM
security.kerberos.krb5-conf.path': /etc/krb5.conf

Exception:

Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: GSS initiate failed

Using the

keytab

is the ideal solution considering it is a long running streaming mode job and the ticket would expire and need to be renewed. Any suggestions will be highly appreciated. 🙏. #PyFlink #FlinkSQL