Github user Cangyl commented on the issue:
https://github.com/apache/spark/pull/22876
What changes were proposed in this pull request?
When set configs in yarn as below:
yarn.scheduler.minimum-allocation-mb 50mb
yarn.scheduler.increment-allocation-mb 50mb
And submit
GitHub user Cangyl opened a pull request:
https://github.com/apache/spark/pull/22876
[SPARK-25869] [YARN] the original diagnostics is missing when job failed
maâ¦
When submit spark on yarn jobs, the diagnostics message may be missing when
job failed maxAppAttempts times
