[GitHub] spark pull request: [FLAKY-TEST-FIX][STREAMING][TEST] Make sure St...

2015-12-02 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/10124 [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test You can merge this pull request into a Git repository by running: $ git pull https://github.com/tdas/spark

[GitHub] spark pull request: [SPARK-10263] [ML] Add @Since annotation to ml...

2015-12-02 Thread taishi-oss
Github user taishi-oss commented on the pull request: https://github.com/apache/spark/pull/8935#issuecomment-161544658 in Pipeline.scala, I have some questions. 1. for example, Pipeline.fit was introduced in v1.2.0. but, signature was changed in v1.4.0 ``

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161544537 @srowen I think we have the consistent idea that to provide both ```getNumPartitions``` and ```numPartitions``` at SparkR side, and mark ```numPartitions``` as depre

[GitHub] spark pull request: [SPARK-10263] [ML] Add @Since annotation to ml...

2015-12-02 Thread taishi-oss
Github user taishi-oss commented on the pull request: https://github.com/apache/spark/pull/8935#issuecomment-161544578 @yu-iskw Sorry for being late, I modify my miss and add anotation to all public class, object, methods, and variables. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Deprecate the JAVA-spe...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161543721 **[Test build #47125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47125/consoleFull)** for PR 10092 at commit [`014a3a8`](https://gi

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Deprecate the JAVA-spe...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161543749 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Deprecate the JAVA-spe...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161543752 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161543557 @felixcheung Thanks for your comments. I got it's not an exposed API, but I think to provide consistent function name is necessary especially when we want to expose

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161543452 Yeah, it's unfortunately because until a change 3 days ago, we had 3 different methods in 4 languages for this simple function. Now everything but R uses `getNumPartitio

[GitHub] spark pull request: [SPARK-12084][Core]Fix codes that uses ByteBuf...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10083#issuecomment-161543004 **[Test build #47126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47126/consoleFull)** for PR 10083 at commit [`81d1812`](https://gi

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10037#issuecomment-161542798 **[Test build #47127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47127/consoleFull)** for PR 10037 at commit [`3ee7d5c`](https://gi

[GitHub] spark pull request: [SPARK-10263] [ML] Add @Since annotation to ml...

2015-12-02 Thread taishi-oss
Github user taishi-oss commented on a diff in the pull request: https://github.com/apache/spark/pull/8935#discussion_r46520868 --- Diff: mllib/src/main/scala/org/apache/spark/ml/Pipeline.scala --- @@ -82,8 +82,11 @@ abstract class PipelineStage extends Params with Logging { *

[GitHub] spark pull request: [SPARK-12084][Core]Fix codes that uses ByteBuf...

2015-12-02 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10083#issuecomment-161542010 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fe

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10092#discussion_r46520645 --- Diff: python/pyspark/storagelevel.py --- @@ -49,12 +51,8 @@ def __str__(self): StorageLevel.DISK_ONLY = StorageLevel(True, False, False, Fal

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10037#issuecomment-161541160 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10037#issuecomment-161541156 **[Test build #47123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47123/consoleFull)** for PR 10037 at commit [`95fdd2c`](https://g

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10037#issuecomment-161541158 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10037#issuecomment-161540871 **[Test build #47123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47123/consoleFull)** for PR 10037 at commit [`95fdd2c`](https://gi

[GitHub] spark pull request: [SPARK-12016][MLlib][PySpark] Wrap Word2VecMod...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10100#issuecomment-161539791 **[Test build #47122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47122/consoleFull)** for PR 10100 at commit [`56c250e`](https://gi

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10120#issuecomment-161537145 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10120#issuecomment-161537147 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161537094 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161537095 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10120#issuecomment-161537070 **[Test build #47117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47117/consoleFull)** for PR 10120 at commit [`5d23a6a`](https://g

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161537019 **[Test build #47121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47121/consoleFull)** for PR 10123 at commit [`6870073`](https://g

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9657#issuecomment-161536165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9657#issuecomment-161536163 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161536076 This is actually not exported from SparkR - since it is first integrated in Spark 1.4, SparkR is exporting a smaller/different set of API. You can see in https:/

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9657#issuecomment-161536062 **[Test build #47118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47118/consoleFull)** for PR 9657 at commit [`657ba5a`](https://git

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10120#discussion_r46518529 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -42,7 +47,18 @@ public void grow(int neededSi

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10120#discussion_r46518443 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -42,7 +47,18 @@ public void grow(int neededSi

[GitHub] spark pull request: [SPARK-12016][MLlib][PySpark] Wrap Word2VecMod...

2015-12-02 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/10100#issuecomment-161535500 It makes sense. Thanks. I will update this later. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10123#issuecomment-161534084 **[Test build #47121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47121/consoleFull)** for PR 10123 at commit [`6870073`](https://gi

[GitHub] spark pull request: Join nondeterministic

2015-12-02 Thread zhonghaihua
Github user zhonghaihua commented on the pull request: https://github.com/apache/spark/pull/10122#issuecomment-161533958 I am so sorry to create this pull request, this pr is not on the right branch.I will close it right now. This is my mistake, cause trouble, very sorry. --- If

[GitHub] spark pull request: Join nondeterministic

2015-12-02 Thread zhonghaihua
Github user zhonghaihua closed the pull request at: https://github.com/apache/spark/pull/10122 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] spark pull request: [SPARK-12115] [SparkR] Change numPartitions() ...

2015-12-02 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/10123 [SPARK-12115] [SparkR] Change numPartitions() to getNumPartitions() to be consistent with Scala/Python Change ```numPartitions()``` to ```getNumPartitions()``` to be consistent with Scala/Pytho

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10120#discussion_r46515884 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/codegen/BufferHolder.java --- @@ -42,7 +47,18 @@ public void grow(int neededSi

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10120#discussion_r46515840 --- Diff: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java --- @@ -445,7 +450,13 @@ public UTF8String getUTF8String(int or

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10120#issuecomment-161532033 **[Test build #47120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47120/consoleFull)** for PR 10120 at commit [`c8fc2ec`](https://gi

[GitHub] spark pull request: [SPARK-12019][SPARKR] Support character vector...

2015-12-02 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/10034#issuecomment-161526172 @shivaram we might want this PR in Spark 1.6 ... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: Join nondeterministic

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10122#issuecomment-161531329 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: Join nondeterministic

2015-12-02 Thread zhonghaihua
GitHub user zhonghaihua opened a pull request: https://github.com/apache/spark/pull/10122 Join nondeterministic You can merge this pull request into a Git repository by running: $ git pull https://github.com/zhonghaihua/spark join_nondeterministic Alternatively you can review

[GitHub] spark pull request: [SPARK-12032] [SQL] Re-order inner joins to do...

2015-12-02 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/10073#issuecomment-161529960 @marmbrus @nongli @cloud-fan Is this ready to go? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10092#discussion_r46516167 --- Diff: python/pyspark/storagelevel.py --- @@ -49,12 +51,8 @@ def __str__(self): StorageLevel.DISK_ONLY = StorageLevel(True, False, False, False)

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161529592 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161529523 **[Test build #47119 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47119/consoleFull)** for PR 10092 at commit [`0e074b6`](https://g

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161529591 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9026] [SPARK-4514] Modifications to Job...

2015-12-02 Thread reggert
Github user reggert commented on the pull request: https://github.com/apache/spark/pull/9264#issuecomment-161528329 @zsxwing @JoshRosen I just want to make sure that you guys haven't forgotten about this. I haven't heard anything in a week and a half. --- If your project is set up fo

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161524007 **[Test build #47119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47119/consoleFull)** for PR 10092 at commit [`0e074b6`](https://gi

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/10118#discussion_r46514380 --- Diff: R/pkg/R/DataFrame.R --- @@ -822,21 +822,21 @@ setMethod("collect", # Get a column of complex type returns a list.

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread sun-rui
Github user sun-rui commented on a diff in the pull request: https://github.com/apache/spark/pull/10118#discussion_r46514455 --- Diff: R/pkg/R/DataFrame.R --- @@ -822,21 +822,21 @@ setMethod("collect", # Get a column of complex type returns a list.

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161522366 Based on the comments of @mateiz , the extra changes are made: - Renaming MEMORY_ONLY_SER to MEMORY_ONLY - Renaming MEMORY_ONLY_SER_2 to MEMORY_ONLY_2 - Re

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread falaki
Github user falaki commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161522008 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread falaki
Github user falaki commented on a diff in the pull request: https://github.com/apache/spark/pull/10118#discussion_r46514167 --- Diff: R/pkg/R/DataFrame.R --- @@ -822,21 +822,21 @@ setMethod("collect", # Get a column of complex type returns a list.

[GitHub] spark pull request: [DOCUMENTATION]fix typo

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10121#issuecomment-161521749 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9657#issuecomment-161521736 **[Test build #47118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47118/consoleFull)** for PR 9657 at commit [`657ba5a`](https://gith

[GitHub] spark pull request: [DOC]fix typo

2015-12-02 Thread microwishing
GitHub user microwishing opened a pull request: https://github.com/apache/spark/pull/10121 [DOC]fix typo this is to fix some typo in external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161521581 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161521582 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161521520 **[Test build #47116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47116/consoleFull)** for PR 10092 at commit [`a6b7dd9`](https://g

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10120#issuecomment-161521319 **[Test build #47117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47117/consoleFull)** for PR 10120 at commit [`5d23a6a`](https://gi

[GitHub] spark pull request: [SPARK-12116][SPARKR][DOCS] document how to wo...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10119#issuecomment-161520169 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12116][SPARKR][DOCS] document how to wo...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10119#issuecomment-161520171 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12116][SPARKR][DOCS] document how to wo...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10119#issuecomment-161519905 **[Test build #47115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47115/consoleFull)** for PR 10119 at commit [`2ce01f3`](https://g

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2015-12-02 Thread zjffdu
Github user zjffdu commented on the pull request: https://github.com/apache/spark/pull/9657#issuecomment-161519077 Never mind, I change back to 1.7.0 since 1.6 is in rc1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SQL] [DO NOT MERGE] Try to log some useful th...

2015-12-02 Thread yhuai
GitHub user yhuai opened a pull request: https://github.com/apache/spark/pull/10120 [SQL] [DO NOT MERGE] Try to log some useful things to catch the cause of SPARK-12089. This PR adds logs in different place and hopefully we can catch the cause of https://issues.apache.org/jira/brow

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161515703 Just saw the comments and will change the names soon. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-12116][SPARKR][DOCS] document how to wo...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10119#issuecomment-161515603 **[Test build #47115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47115/consoleFull)** for PR 10119 at commit [`2ce01f3`](https://gi

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161514977 - Removed all the constants whose `deserialized` values are true. - Update the comments of StorageLevel - Change the default storage levels of Kinesis level f

[GitHub] spark pull request: [SPARK-12091] [PYSPARK] Removal of the JAVA-sp...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10092#issuecomment-161514887 **[Test build #47116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47116/consoleFull)** for PR 10092 at commit [`a6b7dd9`](https://gi

[GitHub] spark pull request: [SPARK-12116][SPARKR][DOCS] document how to wo...

2015-12-02 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/10119 [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr @shivaram You can merge this pull request into a Git repository by running: $ git pull https://g

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-161513697 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-161513700 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-161513618 **[Test build #47113 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47113/consoleFull)** for PR 9756 at commit [`89d84b8`](https://git

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161513324 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161513325 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161513330 looks good --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161513272 **[Test build #47114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47114/consoleFull)** for PR 10118 at commit [`b3c654f`](https://g

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161511330 **[Test build #47114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47114/consoleFull)** for PR 10118 at commit [`b3c654f`](https://gi

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread shivaram
Github user shivaram commented on the pull request: https://github.com/apache/spark/pull/10118#issuecomment-161511220 cc @falaki --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-12019][SPARKR] Support character vector...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10034#issuecomment-161511097 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12019][SPARKR] Support character vector...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10034#issuecomment-161511094 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12019][SPARKR] Support character vector...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10034#issuecomment-161511041 **[Test build #47112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47112/consoleFull)** for PR 10034 at commit [`bc98d5b`](https://g

[GitHub] spark pull request: [SPARK-12104][SPARKR] collect() does not handl...

2015-12-02 Thread sun-rui
GitHub user sun-rui opened a pull request: https://github.com/apache/spark/pull/10118 [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name. You can merge this pull request into a Git repository by running: $ git pull https://github.com/sun-rui/spark

[GitHub] spark pull request: [SPARK-12114][SQL]Bug fix for Column Pruning r...

2015-12-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10117#discussion_r46510956 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -246,6 +247,16 @@ object ColumnPruning extends Rule[L

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-161509507 **[Test build #47113 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47113/consoleFull)** for PR 9756 at commit [`89d84b8`](https://gith

[GitHub] spark pull request: [SPARK-12019][SPARKR] Support character vector...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10034#issuecomment-161509399 **[Test build #47112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47112/consoleFull)** for PR 10034 at commit [`bc98d5b`](https://gi

[GitHub] spark pull request: [SPARK-12019][SPARKR] Support character vector...

2015-12-02 Thread felixcheung
Github user felixcheung commented on the pull request: https://github.com/apache/spark/pull/10034#issuecomment-161509279 Updated to support both "abc,def" and c("abc", "def") - we would need to remove empty string anyway (""), so not much more work to split by ',' --- If your project

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-12-02 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-161508966 Also like +1 on having more of the R code in the tests comments so its easier to regenerate the next time we need to. --- If your project is set up for it, you can repl

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/10037#discussion_r46510599 --- Diff: R/pkg/R/generics.R --- @@ -796,9 +800,17 @@ setGeneric("initcap", function(x) { standardGeneric("initcap") }) #' @export setGeneric("

[GitHub] spark pull request: [SPARK-12044] [SparkR] Fix usage of isnan, isn...

2015-12-02 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/10037#discussion_r46510538 --- Diff: R/pkg/R/generics.R --- @@ -623,6 +623,10 @@ setGeneric("getItem", function(x, ...) { standardGeneric("getItem") }) #' @rdname column

[GitHub] spark pull request: [SPARK-11439][ML] Optimization of creating spa...

2015-12-02 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/9756#issuecomment-161508795 LGTM pending tests - maybe @mengxr or @srowen who are two of the more recent committers working in this file could take a look. --- If your project is set up for it, yo

[GitHub] spark pull request: [DOCUMENTATION][MLLIB] typo in mllib doc

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10093#issuecomment-161508543 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [DOCUMENTATION][MLLIB] typo in mllib doc

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10093#issuecomment-161508545 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [DOCUMENTATION][MLLIB] typo in mllib doc

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10093#issuecomment-161508473 **[Test build #47111 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47111/consoleFull)** for PR 10093 at commit [`024dd5e`](https://g

[GitHub] spark pull request: [SPARK-12032] [SQL] Re-order inner joins to do...

2015-12-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10073#discussion_r46510157 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -133,6 +132,45 @@ object ExtractEquiJoinKeys extends Lo

[GitHub] spark pull request: [SPARK-11958] [SPARK-11957] [ML] [Doc] SQLTran...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10006#issuecomment-161507440 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-11569] [ML] Fix StringIndexer to handle...

2015-12-02 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/9920#issuecomment-161507452 Sorry for my slow reply - looking at this it seems like you've updated the meaning of handleInvalid - it no longer serves its original purposes (unless I've missed somet

[GitHub] spark pull request: [SPARK-11958] [SPARK-11957] [ML] [Doc] SQLTran...

2015-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10006#issuecomment-161507438 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-11958] [SPARK-11957] [ML] [Doc] SQLTran...

2015-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10006#issuecomment-161507351 **[Test build #47110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/47110/consoleFull)** for PR 10006 at commit [`ab44e9a`](https://g

  1   2   3   4   5   6   7   >