[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-06-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r32817019 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-06-18 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r32766630 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations within Spa

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-06-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r32702504 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-06-17 Thread harishreedharan
Github user harishreedharan commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r32698212 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-06-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r32690833 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations within Spa

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5074 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-29 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27359387 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-29 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-87399655 Since this is looking good to me and @ilganeli has been patient, I'd like to just merge this and make that last edit manually today. --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-28 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27343042 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-87017830 [Test build #29309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29309/consoleFull) for PR 5074 at commit [`6178e24`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-87017867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27310026 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations withi

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27309620 --- Diff: docs/programming-guide.md --- @@ -1090,6 +1090,67 @@ for details. +### Shuffle operations + +Certain operations withi

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86986624 [Test build #29309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29309/consoleFull) for PR 5074 at commit [`6178e24`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27305674 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27305262 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27292232 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-27 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27292233 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27271303 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27270534 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27270282 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27262874 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27262363 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86728749 Looks good. I'll pause a little longer for final comments from @sryza. --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86722671 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86722662 [Test build #29253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29253/consoleFull) for PR 5074 at commit [`7a0b96f`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86690329 [Test build #29253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29253/consoleFull) for PR 5074 at commit [`7a0b96f`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27249407 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27248089 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86639374 [Test build #29238 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29238/consoleFull) for PR 5074 at commit [`2c5df08`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86639403 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86600615 [Test build #29238 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29238/consoleFull) for PR 5074 at commit [`2c5df08`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27227699 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-26 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27212304 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86237451 [Test build #29178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29178/consoleFull) for PR 5074 at commit [`85f9c6e`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86237478 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86221381 [Test build #29170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29170/consoleFull) for PR 5074 at commit [`349d1fa`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86221392 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86218933 [Test build #29178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29178/consoleFull) for PR 5074 at commit [`85f9c6e`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86216245 Done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27163365 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27163313 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27163323 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27162494 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86194435 [Test build #29170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29170/consoleFull) for PR 5074 at commit [`349d1fa`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86192574 I added the last remaining thing (the cross-page link). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-25 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-86103049 @ilganeli Don't worry about Jenkins here since it won't test docs. I'll build docs before merging to verify it's OK. (You can check locally with `SKIP_API=1 jekyll build`

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27094525 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,66 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-85656471 [Test build #29097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29097/consoleFull) for PR 5074 at commit [`eeb5a7a`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-85656510 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-85626734 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-85623695 [Test build #29097 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29097/consoleFull) for PR 5074 at commit [`eeb5a7a`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27055193 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-24 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r27054643 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26988014 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26987918 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26987728 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26987607 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26987355 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26987263 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26987121 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26986920 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,62 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-23 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-85229756 @srowen I've got some more comments. Going to be fairly nitpicky on this because I think it'd benefit people to be as clear as possible. --- If your project is set up for

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-22 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-84600412 @sryza any more thoughts? I think this is pretty good now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-84092317 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-84092300 [Test build #28925 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28925/consoleFull) for PR 5074 at commit [`dd5cc9d`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-20 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-84067645 [Test build #28925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28925/consoleFull) for PR 5074 at commit [`dd5cc9d`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-20 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-84066703 @sryza I updated the description of the internals based on your feedback - does this look better now? --- If your project is set up for it, you can reply to this email

Re: [GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-20 Thread Sean Owen
It won't affect the markdown rendering, but just affects how things like diffs work. If a paragraph is on one line then any edit to it looks like a change to the line as a whole. I think it's more for ease of diffing and editing as source. On Fri, Mar 20, 2015 at 12:21 PM, ilganeli wrote: > W

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-20 Thread ilganeli
Github user ilganeli commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26852763 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,29 @@ for details. +### Shuffle operations + +Certain operations within

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83755126 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83755115 [Test build #28882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28882/consoleFull) for PR 5074 at commit [`a8adb57`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26791494 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,29 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread sryza
Github user sryza commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83738297 The doc here should be broken up across multiple lines. The programming guide is kind of inconsistent on this, but I think the move is towards keeping lines under 100 char

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26791062 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,29 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26790966 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,29 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26790986 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,29 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread sryza
Github user sryza commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26790878 --- Diff: docs/programming-guide.md --- @@ -1086,6 +1086,29 @@ for details. +### Shuffle operations + +Certain operations within Sp

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83727152 [Test build #28882 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28882/consoleFull) for PR 5074 at commit [`a8adb57`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread ilganeli
Github user ilganeli commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83726002 Thanks for the review, Sean - I've incorporated your recommendations and added a short discussion on sort-based shuffle. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751857 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751924 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751786 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751479 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751403 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751288 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26751143 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within S

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83002990 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-83002942 [Test build #28799 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28799/consoleFull) for PR 5074 at commit [`159dd1c`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-18 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-82970327 [Test build #28799 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28799/consoleFull) for PR 5074 at commit [`159dd1c`](https://githu

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-17 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26636863 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within Spa

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-17 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26636796 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within Spa

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-17 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/5074#discussion_r26636713 --- Diff: docs/programming-guide.md --- @@ -1022,6 +1022,27 @@ for details. +### Shuffle operations + +Certain operations within Spa

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-82600613 [Test build #28732 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/28732/consoleFull) for PR 5074 at commit [`75ef67b`](https://gith

[GitHub] spark pull request: [SPARK-5750][SPARK-3441][SPARK-5836][CORE] Add...

2015-03-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5074#issuecomment-82600638 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28