xkrogen commented on pull request #30450: URL: https://github.com/apache/spark/pull/30450#issuecomment-732509456
Managed to get a test going in `YarnClusterSuite`. It was more challenging than expected because capturing the output of `yarn.Client`, which runs within the `spark-submit` process, isn't very straightforward, since Spark doesn't provide many mechanisms to customize that environment (understandably). This led me to discover a bug that the report fetch can fail after the app stops running, presumably since the driver container no longer exists. I limited the driver log fetch to only `RUNNING` state apps. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
