https://pinot.apache.org/ logo
Join Slack
Powered by
<@UGRJA9TEH> I am starting all these components o...
# troubleshooting
r
@Xiang Fu I am starting all these components on single node. How to check that Hadoop conf dir is mounted to pinot or not? Yes, pinot has access to hdfs.
x
Enter into container and check if you have /etc/hadoop directory
You need to change helmChart to mount those hadoop directories
k8s container shouldn’t have access to your local machine directory
r
Okay @Xiang Fu I tried by changing zookeeper address in that case it's showing this issue. Related to Kerberos authentication
x
how do you mount your hadoop directory?
r
I have executed these commonly only @Xiang Fu. Do I need to do some more setups to mount?
x
Have you tried this
r
Yes followed this link only , but was nt able to understand where should I use -Dplugins.dir=/opt/pinot/plugins -Dplugins.include=pinot-hdfs .shall I use this in start-controller.conf(default file in pinot bin directory) or controller.conf file(which I have created and passing as -ConfFileName for starting the controller) @Xiang Fu
Same process worked for non kerberous I am using exactly same configurations only adding Hadoop keytab name and principle here.
p
hadoop.http.authentication.type
is set to 
kerberos
for kerberos cluster right?
r
Yes @pragya
x
Have you tried this?
How does your principal and keytab look
r
Yes tried followed this doc
Here is the principal and keytab details .using rpsm as keytab and RPSMSITHDP.COM as principal @Xiang Fu
x
ok
have you seen logs of
Copy code
Trying to authenticate user {} with keytab {}..
or
Copy code
Failed to authenticate user principal [%s] with keytab [%s]
r
Ok @Xiang Fu let me chk these keywords in logs
x
principle is the username, keytab is the filepath
r
I have updated that and checked the log but couldn't find any line with keyword autheticate.
In log it's showing only this msg authentication is nt enabled. @Xiang Fu
x
did you see any log related to plugin ?
r
@Xiang Fu cheked this link and verified the details still it's showing same issue.I am attaching my controller.conf file and issue here. Kindly suggest if I need to add/ check any extra configuration.
Pinot_Kerberous_hdfs_issue
x
this should be Pinot.controller
pinot.server.segment.fetcher.hdfs.hadoop.kerberos.principle='rpsl@RPSLSITHDP.COM' pinot.server.segment.fetcher.hdfs.hadoop.kerberos.keytab='/home/dev/rpsl.keytab'
Why put server?
Also add two Kerberos configs pinot.controller.storage.factory.hdfs.hadoop.Kerberos.xxxx
r
Okay Thanks alot @Xiang Fu
Open in Slack
PreviousNext
Powered by