[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74776721 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/4629 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74776715 [Test build #27657 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27657/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74789577 Thanks for adding the test. LGTM, so I'm going to merge this into `master` (1.4.0) and `branch-1.3` (1.3.0). Thanks! --- If your project is set up for it,

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24852684 --- Diff: python/pyspark/tests.py --- @@ -740,6 +739,27 @@ def test_multiple_python_java_RDD_conversions(self): converted_rdd =

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24853424 --- Diff: python/pyspark/tests.py --- @@ -740,6 +739,27 @@ def test_multiple_python_java_RDD_conversions(self): converted_rdd =

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24857765 --- Diff: python/pyspark/tests.py --- @@ -740,6 +739,27 @@ def test_multiple_python_java_RDD_conversions(self): converted_rdd =

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74763180 [Test build #27657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27657/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24857907 --- Diff: python/pyspark/tests.py --- @@ -740,6 +739,27 @@ def test_multiple_python_java_RDD_conversions(self): converted_rdd =

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-17 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24861247 --- Diff: python/pyspark/tests.py --- @@ -740,6 +739,27 @@ def test_multiple_python_java_RDD_conversions(self): converted_rdd =

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74575564 [Test build #27573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27573/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24778077 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -961,7 +961,14 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24778143 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -330,6 +331,15 @@ private[spark] object PythonRDD extends Logging {

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/4629 [SPARK-5785] [PySpark] narrow dependency for cogroup/join in PySpark Currently, PySpark does not support narrow dependency during cogroup/join when the two RDDs have the partitioner, another

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74579230 [Test build #27582 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27582/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74581079 [Test build #27587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27587/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74585242 [Test build #27582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27582/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74585248 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24778859 --- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala --- @@ -330,6 +331,15 @@ private[spark] object PythonRDD extends Logging { }

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24780473 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -961,7 +961,14 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74583747 [Test build #27573 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27573/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74583752 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74579783 [Test build #27583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27583/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74628437 [Test build #611 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/611/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74597976 [Test build #610 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/610/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/4629#discussion_r24787685 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -961,11 +961,18 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74590143 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74590132 [Test build #27583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27583/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74589214 [Test build #610 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/610/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74590835 [Test build #27587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27587/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74590851 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74607728 LGTM overall; this is tricky logic, though, so I'll take one more pass through when I get home. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74621492 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74621421 [Test build #27612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27612/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74621490 [Test build #27612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/27612/consoleFull) for PR 4629 at commit

[GitHub] spark pull request: [SPARK-5785] [PySpark] narrow dependency for c...

2015-02-16 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/4629#issuecomment-74622588 [Test build #611 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/611/consoleFull) for PR 4629 at commit