HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-736214769
Oh, maybe I will use tar.gz and tgz in the integration test. That will
address https://github.com/apache/spark/pull/30486#discussion_r532678330
together.
I
HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-735225924
Yeah, that's correct. One thing is though, if there's anything wrong in
terms of conflict between Yarn distributed cach (spark.yarn.dist.* vs spark.*
like
HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-734037334
It will be exactly same as `spark.files` and `spark.yarn.dist.files` since I
am reusing `spark.files` code path (`spark.jars` vs `spark.yarn.dist.jars`
too). To be
HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-734037334
It will be exactly same as `spark.files` and `spark.yarn.dist.files` since I
am reusing `spark.files` code path (`spark.jars` vs `spark.yarn.dist.jars`
too). To be
HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-734037334
It will be exactly same as `spark.files` and `spark.yarn.dist.files` since I
am reusing `spark.files` code path. To be honest, I am not exactly sure how
they resolve
HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-734037334
It will be exactly same as `spark.files` and `spark.yarn.dist.files`. To be
honest, I am not exactly sure how they resolve the conflict to each other but
both work
HyukjinKwon edited a comment on pull request #30486:
URL: https://github.com/apache/spark/pull/30486#issuecomment-734037334
It will be exactly same as `spark.files` and `spark.yarn.dist.files`. To be
honest, I am not exactly sure how they will conflict to each other but both
work together
