[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-13 Thread squito
Github user squito closed the pull request at: https://github.com/apache/spark/pull/6648 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155564301 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155564296 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155564092 **[Test build #45533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45533/consoleFull)** for PR 6648 at commit [`fbd129b`](https://git

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155516219 **[Test build #45533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45533/consoleFull)** for PR 6648 at commit [`fbd129b`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155515272 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155515244 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155514893 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155497993 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155497998 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155497795 **[Test build #45528 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45528/consoleFull)** for PR 6648 at commit [`fbd129b`](https://git

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155441284 **[Test build #45528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45528/consoleFull)** for PR 6648 at commit [`fbd129b`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155439233 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155439196 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-10 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155439140 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155267487 **[Test build #45484 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45484/consoleFull)** for PR 6648 at commit [`fbd129b`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155267494 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155267429 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155267492 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155267449 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155267074 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155264424 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155264423 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155264348 **[Test build #45437 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45437/consoleFull)** for PR 6648 at commit [`fbd129b`](https://git

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155231380 **[Test build #45437 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45437/consoleFull)** for PR 6648 at commit [`fbd129b`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155228605 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155228626 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155228271 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155192069 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155191969 **[Test build #45389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45389/consoleFull)** for PR 6648 at commit [`fbd129b`](https://git

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155149920 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155150330 **[Test build #45389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45389/consoleFull)** for PR 6648 at commit [`fbd129b`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155149944 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-12 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-147553320 BTW, with that design, I also wouldn't even implement the delete message in the first patch, unless we've actually seen block corruptions happen; but it sounds like we ha

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-12 Thread mateiz
Github user mateiz commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-147552582 Hey Imran, Given the number of changes required for this approach, I wonder whether an atomic rename design wouldn't be simpler (in particular, the "first attempt

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-12 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-147519993 I will get @JoshRosen to take a look at this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146979682 I looked at the diffs since my last review, looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146973041 @vanzin @JoshRosen made external shuffle service backwards compatible and got rid of DAGSchedulerFailureRecoverySuite --- If your project is set up for it, you can reply

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146946481 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146946480 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146946253 [Test build #43475 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43475/console) for PR 6648 at commit [`c9a9e08`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146904630 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146904627 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146903055 [Test build #43475 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43475/consoleFull) for PR 6648 at commit [`c9a9e08`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146900480 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146902032 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146901974 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146900537 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146900213 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146893976 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146893923 [Test build #43470 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43470/console) for PR 6648 at commit [`37ac799`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146893979 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146889726 [Test build #43470 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43470/consoleFull) for PR 6648 at commit [`37ac799`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146886622 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146886660 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41575239 --- Diff: core/src/main/java/org/apache/spark/shuffle/unsafe/UnsafeShuffleWriter.java --- @@ -125,6 +129,7 @@ public UnsafeShuffleWriter( taskContext

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41575081 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java --- @@ -163,12 +163,12 @@ public void registerExecu

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146659581 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146659319 [Test build #43401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43401/console) for PR 6648 at commit [`f37be91`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146659579 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41548771 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java --- @@ -163,12 +163,12 @@ public void registerEx

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146639169 Looks sane, but this isn't really my area of expertise. Just a reminder that you should either enable DAGSchedulerFailureRecoverySuite or remove it from the patch.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41546189 --- Diff: network/shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java --- @@ -163,12 +163,12 @@ public void registerExecu

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41544610 --- Diff: core/src/main/scala/org/apache/spark/shuffle/ShuffleManager.scala --- @@ -36,8 +43,15 @@ private[spark] trait ShuffleManager { numMaps: In

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/6648#discussion_r41543763 --- Diff: core/src/main/java/org/apache/spark/shuffle/unsafe/UnsafeShuffleWriter.java --- @@ -125,6 +129,7 @@ public UnsafeShuffleWriter( taskContext

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146608768 [Test build #43401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43401/consoleFull) for PR 6648 at commit [`f37be91`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146603453 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146603482 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146578338 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146578278 [Test build #43396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43396/console) for PR 6648 at commit [`c7b3017`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146578332 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146574433 [Test build #43396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43396/consoleFull) for PR 6648 at commit [`c7b3017`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146572501 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146572450 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146567168 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146567159 [Test build #43395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43395/console) for PR 6648 at commit [`5547611`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146567165 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146566496 [Test build #43395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43395/consoleFull) for PR 6648 at commit [`5547611`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146564323 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-10-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-146564355 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128171315 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128171222 [Test build #237 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/237/console) for PR 6648 at commit [`26b6ea6`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128160443 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128160391 [Test build #39908 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39908/console) for PR 6648 at commit [`26b6ea6`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128132364 [Test build #39908 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39908/consoleFull) for PR 6648 at commit [`26b6ea6`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128131872 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128131741 [Test build #237 has started](https://amplab.cs.berkeley.edu/jenkins/job/SlowSparkPullRequestBuilder/237/consoleFull) for PR 6648 at commit [`26b6ea6`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128131850 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128131589 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128131558 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128131451 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128122426 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128122356 [Test build #39883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39883/console) for PR 6648 at commit [`26b6ea6`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128071372 [Test build #39883 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39883/consoleFull) for PR 6648 at commit [`26b6ea6`](https://gith

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128070990 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-08-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-128070970 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-124159452 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-124159280 [Test build #38226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38226/console) for PR 6648 at commit [`90ee54a`](https://github.

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-124141027 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-07-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-124140799 [Test build #38221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/38221/console) for PR 6648 at commit [`9cd9c75`](https://github.

  1   2   3   >