[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/7089#discussion_r48923007
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -922,6 +922,15 @@ private[spark] object SparkSubmitUtils {
// A Module descriptor must be specified. Entries are dummy strings
val md = getModuleDescriptor
+// clear ivy resolution from previous launches. The resolution
file is usually at
+// ~/.ivy2/org.apache.spark-spark-submit-parent-default.xml. In
between runs, this file
--- End diff --
@brkyvz, what determines the name of this file? I'm curious how often it's
"usually" at this filename and whether it could sometimes be published at
different names.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user brkyvz commented on a diff in the pull request:
https://github.com/apache/spark/pull/7089#discussion_r48931472
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -922,6 +922,15 @@ private[spark] object SparkSubmitUtils {
// A Module descriptor must be specified. Entries are dummy strings
val md = getModuleDescriptor
+// clear ivy resolution from previous launches. The resolution
file is usually at
+// ~/.ivy2/org.apache.spark-spark-submit-parent-default.xml. In
between runs, this file
--- End diff --
Hi Josh, I believe the filename comes from the combination of these lines:
https://github.com/apache/spark/blob/d1fea41363c175a67b97cb7b3fe89f9043708739/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L979
and
https://github.com/apache/spark/blob/d1fea41363c175a67b97cb7b3fe89f9043708739/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L1005
Therefore it should always be the same.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/7089 [SPARK-8410][SPARK-8475] remove previous ivy resolution when using spark-submit This PR also includes re-ordering the order that repositories are used when resolving packages. User provided repositories will be prioritized. cc @andrewor14 You can merge this pull request into a Git repository by running: $ git pull https://github.com/brkyvz/spark delete-prev-ivy-resolution Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/7089.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #7089 commit a21f95a25e48e2fd6099ce948bc72f6b51e3ba84 Author: Burak Yavuz brk...@gmail.com Date: 2015-06-29T18:28:36Z remove previous ivy resolution when using spark-submit --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116789983 [Test build #36010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36010/consoleFull) for PR 7089 at commit [`a21f95a`](https://github.com/apache/spark/commit/a21f95a25e48e2fd6099ce948bc72f6b51e3ba84). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116787969 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116787888 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116846397 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116846278 [Test build #36010 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36010/console) for PR 7089 at commit [`a21f95a`](https://github.com/apache/spark/commit/a21f95a25e48e2fd6099ce948bc72f6b51e3ba84). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/7089#issuecomment-116886558 OK, merging into master 1.4, thanks @brkyvz. Do we need a fix for 1.3 as well? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-8410][SPARK-8475] remove previous ivy r...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7089 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
