[GitHub] [spark] viirya commented on pull request #28376: [SPARK-31582] [Yarn] Being able to not populate Hadoop classpath

2020-04-28 Thread GitBox
viirya commented on pull request #28376: URL: https://github.com/apache/spark/pull/28376#issuecomment-620920044 @dbtsai @adamkennedy Thanks for clarifying that. Making sense. This is an automated message from the Apache Git S

[GitHub] [spark] viirya commented on pull request #28376: [SPARK-31582] [Yarn] Being able to not populate Hadoop classpath

2020-04-28 Thread GitBox
viirya commented on pull request #28376: URL: https://github.com/apache/spark/pull/28376#issuecomment-620717201 @tgravescs I see. That makes sense. So users still need to pay attention on dependencies issue if any when running multiple versions there. -

[GitHub] [spark] viirya commented on pull request #28376: [SPARK-31582] [Yarn] Being able to not populate Hadoop classpath

2020-04-28 Thread GitBox
viirya commented on pull request #28376: URL: https://github.com/apache/spark/pull/28376#issuecomment-620437448 One question, for the case mentioned in the description, "One case we have is when a user uses an Apache Spark distribution with its-own embedded hadoop, and submits a job to Clo