Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

2022-05-03 Thread Gabor Somogyi
If you take a look at the jiras then ..33 is the newly opened same issue which is discussed on ..55. The quality of the logs are the exact same which is useless for real analysis... Not going too far spark-submit has cluster mode, the logs are partial and contains client mode (so they don't

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

2022-05-03 Thread Bjørn Jørgensen
What is the JIRA ticket for this problem? SPARK-25355 was marked as resolved for 2 years ago. But now there are a lot of new comments on whether things work and not. SPARK-39033 Support --proxy-user for Spark on K8s not working

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

2022-05-03 Thread Pralabh Kumar
Hi Steve Thx for the input . Actually I have wrongly put the error stack trace(complete error trace and other details are available in the Jira , apologies for the same. ) . The error is related to authenticatication and it's happening only when the proxy user option is being used , otherwise

Re: Issue on Spark on K8s with Proxy user on Kerberized HDFS : Spark-25355

2022-05-03 Thread Steve Loughran
Prablah, did you follow the URL provided in the exception message? i put a lot of effort in to improving the diagnostics, where the wiki articles are part of the troubleshooing process https://issues.apache.org/jira/browse/HADOOP-7469 it's really disappointing when people escalate the problem to

REMINDER - Travel Assistance available for ApacheCon NA New Orleans 2022

2022-05-03 Thread Gavin McDonald
Hi All Contributors and Committers, This is a first reminder email that travel assistance applications for ApacheCon NA 2022 are now open! We will be supporting ApacheCon North America in New Orleans, Louisiana, on October 3rd through 6th, 2022. TAC exists to help those that would like to