[GitHub] spark pull request: [SPARK-12963] Improve performance of stddev/va...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10960#issuecomment-176068656 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Changes to support KMeans with large feature s...

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10739#issuecomment-176069009 Read https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark first. You may want to search for duplicate JIRAs too. There are several on this topic and

[GitHub] spark pull request: [SPARK-12818][SQL] Specialized integral and st...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10968#issuecomment-176080459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12818][SQL] Specialized integral and st...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10968#issuecomment-176080460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12689][SQL] Migrate DDL parsing to the ...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10723#issuecomment-176049783 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12689][SQL] Migrate DDL parsing to the ...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10723#issuecomment-176049782 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-13052 waitingApps metric doesn't show th...

2016-01-28 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10959#discussion_r51092784 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/MasterSource.scala --- @@ -42,6 +42,6 @@ private[spark] class MasterSource(val master:

[GitHub] spark pull request: [SPARK-13032] [ML] [PySpark] PySpark support m...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10469#issuecomment-176057088 **[Test build #50267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50267/consoleFull)** for PR 10469 at commit

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176157120 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176157117 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-176154928 **[Test build #50273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50273/consoleFull)** for PR 9532 at commit

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176156921 **[Test build #50275 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50275/consoleFull)** for PR 10922 at commit

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-176186278 I'm sort of surprised that it was not necessary to update the file listing all of the project dependencies? The change is looking fairly good, except that the

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-176155359 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-176155365 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Changes to support KMeans with large feature s...

2016-01-28 Thread levin-royl
Github user levin-royl commented on the pull request: https://github.com/apache/spark/pull/10739#issuecomment-176178297 Hi, there are indeed some similar issues I found, e.g.: https://issues.apache.org/jira/browse/SPARK-4039 https://issues.apache.org/jira/browse/SPARK-1212

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-176113342 **[Test build #50273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50273/consoleFull)** for PR 9532 at commit

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10890#issuecomment-176115457 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10890#issuecomment-176115460 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10890#issuecomment-176115335 **[Test build #50271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50271/consoleFull)** for PR 10890 at commit

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-176123187 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-176123063 **[Test build #50269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50269/consoleFull)** for PR 10966 at commit

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176112499 **[Test build #50270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50270/consoleFull)** for PR 10922 at commit

[GitHub] spark pull request: Fix for [SPARK-12854][SQL] Implement complex t...

2016-01-28 Thread jaceklaskowski
Github user jaceklaskowski commented on the pull request: https://github.com/apache/spark/pull/10946#issuecomment-176115262 I'd appreciate having it merged since the current master is broken without the fix - checked early morning today. --- If your project is set up for it, you can

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10890 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10890#issuecomment-176121885 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10762#issuecomment-176123877 **[Test build #50274 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50274/consoleFull)** for PR 10762 at commit

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-176142187 **[Test build #50272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50272/consoleFull)** for PR 10874 at commit

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10890#issuecomment-176104639 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-176105036 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176104800 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-17614 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-176110426 **[Test build #50268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50268/consoleFull)** for PR 10966 at commit

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-17622 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176114766 **[Test build #50270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50270/consoleFull)** for PR 10922 at commit

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176114773 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176114772 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread adrian-wang
Github user adrian-wang commented on a diff in the pull request: https://github.com/apache/spark/pull/10762#discussion_r51106564 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -919,6 +919,7 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-176123185 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: SPARK-11565 Replace deprecated DigestUtils.sha...

2016-01-28 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9532#issuecomment-176103990 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12689][SQL] Migrate DDL parsing to the ...

2016-01-28 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/10723#discussion_r51105544 --- Diff: sql/catalyst/src/main/antlr3/org/apache/spark/sql/catalyst/parser/SparkSqlLexer.g --- @@ -465,7 +467,7 @@ Identifier fragment

[GitHub] spark pull request: [SPARK-12926][SQL] SQLContext to display warni...

2016-01-28 Thread tejasapatil
Github user tejasapatil commented on the pull request: https://github.com/apache/spark/pull/10849#issuecomment-176122957 @marmbrus : Updated the title and description. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-12637] [CORE] Print stage info of finis...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10922#issuecomment-176124334 **[Test build #50275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50275/consoleFull)** for PR 10922 at commit

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-176107969 **[Test build #50272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50272/consoleFull)** for PR 10874 at commit

[GitHub] spark pull request: Provide same info as in spark-submit --help

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10890#issuecomment-176109173 **[Test build #50271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50271/consoleFull)** for PR 10890 at commit

[GitHub] spark pull request: [SPARK-5174][SPARK-5175] add more APIs to acto...

2016-01-28 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/10892#discussion_r51106802 --- Diff: external/akka/src/main/scala/org/apache/spark/streaming/akka/ActorReceiver.scala --- @@ -90,6 +90,48 @@ object ActorReceiver {

[GitHub] spark pull request: [SPARK-5174][SPARK-5175] add more APIs to acto...

2016-01-28 Thread ScrapCodes
Github user ScrapCodes commented on the pull request: https://github.com/apache/spark/pull/10892#issuecomment-176122545 @CodingCat and @zsxwing Thanks for the PR and letting me take a look, I am a bit unsure about having these as API methods. I want to know what others opinion is on

[GitHub] spark pull request: [SPARK-12689][SQL] Migrate DDL parsing to the ...

2016-01-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/10723#discussion_r51107309 --- Diff: sql/catalyst/src/main/antlr3/org/apache/spark/sql/catalyst/parser/SparkSqlLexer.g --- @@ -465,7 +467,7 @@ Identifier fragment

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10762#issuecomment-176127037 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10762#issuecomment-176127014 **[Test build #50274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50274/consoleFull)** for PR 10762 at commit

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10762#issuecomment-176127032 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-176142622 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5865] [API DOC] Add doc warnings for me...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10874#issuecomment-176142614 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10873] Support column sort and search f...

2016-01-28 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/10648#issuecomment-176299122 mostly looks good a few more minor things. - can you highlight the page you are on - file a jira to have attemptid always show up in rest api so spark

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-176299436 **[Test build #50278 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50278/consoleFull)** for PR 10841 at commit

[GitHub] spark pull request: [SPARK-12269][Streaming][Kinesis] Update aws-j...

2016-01-28 Thread cowtowncoder
Github user cowtowncoder commented on the pull request: https://github.com/apache/spark/pull/10256#issuecomment-176300804 I know this issue is closed, but one suggestion I have would be to specify the latest Jackson 2.5 version, 2.5.5 instead of 2.5.3. While I understand caution in

[GitHub] spark pull request: [SPARK-10873] Support column sort and search f...

2016-01-28 Thread zhuoliu
Github user zhuoliu commented on the pull request: https://github.com/apache/spark/pull/10648#issuecomment-176303757 JIRA file here: https://issues.apache.org/jira/browse/SPARK-13064 --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-12269][Streaming][Kinesis] Update aws-j...

2016-01-28 Thread cowtowncoder
Github user cowtowncoder commented on the pull request: https://github.com/apache/spark/pull/10256#issuecomment-176310354 @srowen Ah. Yes, just wanted to mention it; I don't have enough context so there may be specific reasons for picking up particular versions. Glad to see version

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10762#issuecomment-176310229 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12818][SQL] Specialized integral and st...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10968#issuecomment-176314290 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-01-28 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-176323543 Looking at params.scala shouldOwn uses a require which we should probably stay consistent with (not saying we _shouldn't_ change it per-se just if we do we should

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-01-28 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-176325696 Good point about mirroring Scala. In that case, it is probably best not to change it. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10762#discussion_r51159429 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -104,6 +105,9 @@ trait CheckAnalysis {

[GitHub] spark pull request: [SPARK-12818][SQL] Specialized integral and st...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10968#issuecomment-176305245 **[Test build #2468 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2468/consoleFull)** for PR 10968 at commit

[GitHub] spark pull request: [SPARK-12828][SQL]add natural join support

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10762#issuecomment-176311144 **[Test build #50282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50282/consoleFull)** for PR 10762 at commit

[GitHub] spark pull request: [SPARK-12818][SQL] Specialized integral and st...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10968#issuecomment-176314296 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12818][SQL] Specialized integral and st...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10968#issuecomment-176314889 **[Test build #50283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50283/consoleFull)** for PR 10968 at commit

[GitHub] spark pull request: [SPARK-12963] Improve performance of stddev/va...

2016-01-28 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/10960#issuecomment-176315428 @davies Did you get a chance to test whole-stage codegen with higher-order statistics like skewness? If it works, the cleanest solution would be changing

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-01-28 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10966#issuecomment-176318629 I remember @tdas was considering the scalability of this approach. Replaying event logs for a long running Streaming application is terrible. Ideally, there should be

[GitHub] spark pull request: [SPARK-13047][PYSPARK][ML] Pyspark Params.hasP...

2016-01-28 Thread sethah
Github user sethah commented on the pull request: https://github.com/apache/spark/pull/10962#issuecomment-176319087 I wonder if there is support for also changing `_shouldOwn` to return True/False instead of True/ValueError? The only placed it is currently used is in `_resolveParam`,

[GitHub] spark pull request: [SPARK-12656] [SQL] Implement Intersect with L...

2016-01-28 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10630#discussion_r51163511 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -388,57 +445,18 @@ class Analyzer(

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-176325012 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-176325002 **[Test build #50284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50284/consoleFull)** for PR 10841 at commit

[GitHub] spark pull request: [SPARK-12469][CORE][RFC/WIP] Add Consistent Ac...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10841#issuecomment-176325014 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13031] [SQL] cleanup codegen and improv...

2016-01-28 Thread nongli
Github user nongli commented on a diff in the pull request: https://github.com/apache/spark/pull/10944#discussion_r51166249 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegen.scala --- @@ -162,37 +206,48 @@ case class InputAdapter(child: SparkPlan)

[GitHub] spark pull request: [SPARK-12966][SQL] ArrayType(DecimalType) supp...

2016-01-28 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10928#issuecomment-176517539 I'm not sure how to fix though, there is the idea I have; we just throw an unsupported exception when this type passed. This is because an array type actually is unique

[GitHub] spark pull request: [SPARK-12989] [SQL] Delaying Alias Cleanup aft...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10963#issuecomment-176522869 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Docs] Fix the jar location of datanucleus in ...

2016-01-28 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10901#issuecomment-176522896 @marmbrus This is a trivial fix, so could you check this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-12989] [SQL] Delaying Alias Cleanup aft...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10963#issuecomment-176522874 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-176523842 **[Test build #50319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50319/consoleFull)** for PR 9893 at commit

[GitHub] spark pull request: [SPARK-13070][SQL] Better error message when P...

2016-01-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/10972#discussion_r51217905 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetRelation.scala --- @@ -799,9 +799,31 @@ private[sql] object

[GitHub] spark pull request: [SPARK-12799] Simplify various string output f...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10757#issuecomment-176524236 **[Test build #2471 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2471/consoleFull)** for PR 10757 at commit

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-176524163 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-176524164 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [ML][PYTHON][SPARK-12780][BACKPORT] Inconsiste...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10950#issuecomment-176526553 **[Test build #50329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50329/consoleFull)** for PR 10950 at commit

[GitHub] spark pull request: [SPARK-12463][SPARK-12464][SPARK-12465][SPARK-...

2016-01-28 Thread tnachen
Github user tnachen commented on the pull request: https://github.com/apache/spark/pull/10057#issuecomment-176526642 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13050] [Build] Scalatest tags fail buil...

2016-01-28 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/10954#issuecomment-176528787 spark-test-tags is declared with a test dependency in the root pom, and the scope is inherited. You can check these things with `mvn dependency:tree`. --- If your

[GitHub] spark pull request: [SPARK-13070][SQL] Better error message when P...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10972#issuecomment-176532399 **[Test build #50331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50331/consoleFull)** for PR 10972 at commit

[GitHub] spark pull request: [SPARK-13001] [CORE] [MESOS] Prevent getting o...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10924#issuecomment-176544434 **[Test build #50334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50334/consoleFull)** for PR 10924 at commit

[GitHub] spark pull request: [SPARK-13071] Coalescing HadoopRDD overwrites ...

2016-01-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10973#issuecomment-176545687 **[Test build #50335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50335/consoleFull)** for PR 10973 at commit

[GitHub] spark pull request: [SPARK-12968][SQL] Implement command to set cu...

2016-01-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/10916#discussion_r51221439 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientInterface.scala --- @@ -109,6 +109,9 @@ private[hive] trait ClientInterface {

[GitHub] spark pull request: [SPARK-13070][SQL] Better error message when P...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10972#issuecomment-176550457 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13070][SQL] Better error message when P...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10972#issuecomment-176550456 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6363][BUILD] Make Scala 2.11 the defaul...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10608#issuecomment-176552575 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-6363][BUILD] Make Scala 2.11 the defaul...

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10608#issuecomment-176552578 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Test][DO_NO_MERGE]Try to reproduce the bug

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10904#issuecomment-176555212 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2016-01-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/9657#discussion_r51222766 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InsertIntoHadoopFsRelation.scala --- @@ -57,7 +57,8 @@ import

[GitHub] spark pull request: [SPARK-11691][SQL] Allow to specify compressio...

2016-01-28 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/9657#discussion_r51222742 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -120,7 +120,7 @@ private[sql] object

[GitHub] spark pull request: [Test][DO_NO_MERGE]Try to reproduce the bug

2016-01-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10904#issuecomment-176555211 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Test][DO_NO_MERGE]Try to reproduce the bug

2016-01-28 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10904#issuecomment-176562480 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

<    1   2   3   4   5   6   7   >