GitHub user tgravescs opened a pull request:
https://github.com/apache/spark/pull/9035
[SPARK-10858] YARN: archives/jar/files rename with # doesn't work unl
https://issues.apache.org/jira/browse/SPARK-10858
The issue here is that in resolveURI we default to calling new
File(path).getAbsoluteFile().toURI(). But if the path passed in already has a
# in it then File(path) will think that is supposed to be part of the actual
file path and not a fragment so it changes # to %23. Then when we try to parse
that later in Client as a URI it doesn't recognize there is a fragment.
so to fix we just check if there is a fragment, still create the File like
we did before and then add the fragment back on.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tgravescs/spark SPARK-10858
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9035.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9035
----
commit 6f5469084b9e4c362c7d9f1869f41888d7ee6649
Author: Tom Graves <tgra...@yahoo-inc.com>
Date: 2015-10-08T20:37:49Z
[SPARK-10858] YARN: archives/jar/files rename with # doesn't work unless
scheme given
commit 4cd89124e835bf4cd0252f02fde78e22e125fd89
Author: Tom Graves <tgra...@yahoo-inc.com>
Date: 2015-10-08T20:43:45Z
Fix unit tests
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
