[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user yhuai closed the pull request at: https://github.com/apache/spark/pull/8296 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132778004 I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132760497 [Test build #1671 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1671/console) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). * This patch **passes all tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132697924 [Test build #1671 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1671/consoleFull) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132693400 [Test build #1669 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1669/console) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132619920 [Test build #1669 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1669/consoleFull) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132617493 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41235/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132617490 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132617375 **[Test build #41235 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41235/console)** for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9) after a configured wait of `175m`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132554058 [Test build #41235 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41235/consoleFull) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132552593 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132552618 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132551589 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132474471 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41208/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132474415 **[Test build #41208 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41208/console)** for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9) after a configured wait of `175m`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132474468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132441641 [Test build #41208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41208/consoleFull) for PR 8296 at commit [`40e28e3`](https://github.com/apache/spark/commit/40e28e3f0101a04884b61d77ebdc4911128ce4f9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132441408 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132441423 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132440566 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41194/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132440564 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132440472 [Test build #41194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41194/console) for PR 8296 at commit [`90b25a3`](https://github.com/apache/spark/commit/90b25a3585cdce1f0fac9c8e43152e5efd8fed13). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132415166 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132414842 [Test build #41194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/41194/consoleFull) for PR 8296 at commit [`90b25a3`](https://github.com/apache/spark/commit/90b25a3585cdce1f0fac9c8e43152e5efd8fed13). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132414617 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8296#issuecomment-132414636 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-10087] [CORE] [BRANCH-1.5] Disable spar...
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/8296 [SPARK-10087] [CORE] [BRANCH-1.5] Disable spark.shuffle.reduceLocality.enabled by default. https://issues.apache.org/jira/browse/SPARK-10087 In some cases, when spark.shuffle.reduceLocality.enabled is enabled, we are scheduling all reducers to the same executor (the cluster has plenty of resources). Changing spark.shuffle.reduceLocality.enabled to false resolve the problem. Comments of https://github.com/apache/spark/pull/8280 provide more details of the symptom of this issue. This PR changes the default setting of `spark.shuffle.reduceLocality.enabled` to `false` for branch 1.5. You can merge this pull request into a Git repository by running: $ git pull https://github.com/yhuai/spark setNumPartitionsCorrectly-branch1.5 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/8296.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #8296 commit 90b25a3585cdce1f0fac9c8e43152e5efd8fed13 Author: Yin Huai Date: 2015-08-19T01:48:23Z Disable spark.shuffle.reduceLocality.enabled by default. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org