Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

If you take a look at the jiras then ..33 is the newly opened same issue which is discussed on ..55. The quality of the logs are the exact same which is useless for real analysis... Not going too far spark-submit has cluster mode, the logs are partial and contains client mode (so they don't

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

What is the JIRA ticket for this problem? SPARK-25355 was marked as resolved for 2 years ago. But now there are a lot of new comments on whether things work and not. SPARK-39033 Support --proxy-user for Spark on K8s not working

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

Hi Steve Thx for the input . Actually I have wrongly put the error stack trace(complete error trace and other details are available in the Jira , apologies for the same. ) . The error is related to authenticatication and it's happening only when the proxy user option is being used , otherwise

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

Prablah, did you follow the URL provided in the exception message? i put a lot of effort in to improving the diagnostics, where the wiki articles are part of the troubleshooing process https://issues.apache.org/jira/browse/HADOOP-7469 it's really disappointing when people escalate the problem to

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

Hi, Please be aware that ConnectionRefused exception is has nothing to do w/ authentication. See the description from Hadoop wiki: "You get a ConnectionRefused Exception when there is a machine at the address specified, but

Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

Hi dev Team Spark-25355 added the functionality of the proxy user on K8s . However proxy user on K8s with Kerberized HDFS is not working . It is throwing exception and 22/04/21 17:50:30 WARN Client: Exception encountered while connecting to the server :