[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167063931 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167063910 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167063911 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167063904 **[Test build #48291 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48291/consoleFull)** for PR 10435 at commit [`fcb5af9`](https://g

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167063932 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167063848 **[Test build #48290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48290/consoleFull)** for PR 10427 at commit [`40d52c9`](https://g

[GitHub] spark pull request: [SPARK-12409][SPARK-12387][SPARK-12391][SQL] S...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10468#issuecomment-167061262 **[Test build #48297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48297/consoleFull)** for PR 10468 at commit [`7f0a2e6`](https://gi

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167061071 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167061036 **[Test build #48288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48288/consoleFull)** for PR 10368 at commit [`a4173eb`](https://g

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167061069 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12409][SPARK-12387][SPARK-12391][SQL] S...

2015-12-23 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/10468 [SPARK-12409][SPARK-12387][SPARK-12391][SQL] Support AND/OR/IN/LIKE push-down filters for JDBC This is rework from #10386 and add more tests and LIKE push-down support. You can merge this pull requ

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167060473 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167060472 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48400022 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin extend

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167060381 **[Test build #48287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48287/consoleFull)** for PR 10427 at commit [`8d5710a`](https://g

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167060213 **[Test build #48293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48293/consoleFull)** for PR 10427 at commit [`3fb9199`](https://gi

[GitHub] spark pull request: [SPARK-8641][SPARK-12455][SQL] Native Spark Wi...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10402#issuecomment-167060193 **[Test build #48294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48294/consoleFull)** for PR 10402 at commit [`cf58954`](https://gi

[GitHub] spark pull request: [SPARK-12289][SQL] Support UnsafeRow in TakeOr...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10330#issuecomment-167059780 **[Test build #48296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48296/consoleFull)** for PR 10330 at commit [`fdc0097`](https://gi

[GitHub] spark pull request: [SPARK-10427][SQL]Respect -S option for spark-...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8915#issuecomment-167059552 **[Test build #48295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48295/consoleFull)** for PR 8915 at commit [`592ed63`](https://gith

[GitHub] spark pull request: [SPARK-12289][SQL] Support UnsafeRow in TakeOr...

2015-12-23 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/10330#discussion_r48399567 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -200,6 +204,10 @@ case class TakeOrderedAndProject( proj

[GitHub] spark pull request: [SPARK-9578] [ML] Stemmer feature transformer

2015-12-23 Thread hhbyyh
Github user hhbyyh commented on the pull request: https://github.com/apache/spark/pull/10272#issuecomment-167059047 Current implementation still outperforms the one from https://github.com/utcompling/Scalabha/blob/master/src/main/scala/opennlp/scalabha/lang/eng/PorterStemmer.scala, by

[GitHub] spark pull request: [SPARK-10427][SQL]Respect -S option for spark-...

2015-12-23 Thread zhichao-li
Github user zhichao-li commented on the pull request: https://github.com/apache/spark/pull/8915#issuecomment-167058985 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11394][SQL] Throw IllegalArgumentExcept...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9350#issuecomment-167058892 **[Test build #48292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48292/consoleFull)** for PR 9350 at commit [`c2363aa`](https://gith

[GitHub] spark pull request: [SPARK-11394][SQL] Throw IllegalArgumentExcept...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/9350#issuecomment-167056743 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-11624][SPARK-11972][SQL]fix commands th...

2015-12-23 Thread zhichao-li
Github user zhichao-li commented on a diff in the pull request: https://github.com/apache/spark/pull/9589#discussion_r48398910 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -151,29 +152,34 @@ private[hive] class ClientWrapper(

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167056106 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167056107 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167056049 **[Test build #48286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48286/consoleFull)** for PR 10463 at commit [`8157ee0`](https://g

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167055194 **[Test build #48291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48291/consoleFull)** for PR 10435 at commit [`fcb5af9`](https://gi

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9992#issuecomment-167055004 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9992#issuecomment-167055003 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9992#issuecomment-167054764 **[Test build #48289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48289/consoleFull)** for PR 9992 at commit [`de8f4c7`](https://git

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-12-23 Thread mwws
Github user mwws commented on the pull request: https://github.com/apache/spark/pull/8760#issuecomment-167052293 @squito @mridulm I am afraid an additional state can not help here, your use case requires "TaskSet related nodeBlacklist" which is not supported with current implementatio

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167051327 **[Test build #48290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48290/consoleFull)** for PR 10427 at commit [`40d52c9`](https://gi

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167050976 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167050979 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167050810 **[Test build #48285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48285/consoleFull)** for PR 10463 at commit [`8157ee0`](https://g

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9992#issuecomment-167048778 **[Test build #48289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48289/consoleFull)** for PR 9992 at commit [`de8f4c7`](https://gith

[GitHub] spark pull request: Branch 1.6

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10467#issuecomment-167047758 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167047677 **[Test build #48288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48288/consoleFull)** for PR 10368 at commit [`a4173eb`](https://gi

[GitHub] spark pull request: Branch 1.6

2015-12-23 Thread yuzhanghan1982
GitHub user yuzhanghan1982 opened a pull request: https://github.com/apache/spark/pull/10467 Branch 1.6 You can merge this pull request into a Git repository by running: $ git pull https://github.com/dukedbgroup/spark branch-1.6 Alternatively you can review and apply these ch

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167046672 **[Test build #48287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48287/consoleFull)** for PR 10427 at commit [`8d5710a`](https://gi

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167046527 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167046506 ``` [info] PostgresIntegrationSuite: [info] Exception encountered when attempting to run a suite with class name: org.apache.spark.sql.jdbc.PostgresIntegrationSuit

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167045790 @HyukjinKwon Anyway, I added a test by reflecting this discussion. thanks. --- If your project is set up for it, you can reply to this email and have your reply appear o

[GitHub] spark pull request: [SPARK-12515][SQL][DOC] minor doc update for r...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10465#issuecomment-167045672 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12515][SQL][DOC] minor doc update for r...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10465#issuecomment-167045673 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12515][SQL][DOC] minor doc update for r...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10465#issuecomment-167045613 **[Test build #48282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48282/consoleFull)** for PR 10465 at commit [`d68f856`](https://g

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167044665 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167044664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167044643 **[Test build #48283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48283/consoleFull)** for PR 10368 at commit [`a4173eb`](https://g

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10466#issuecomment-167044424 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10466#issuecomment-167044425 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10466#issuecomment-167044370 **[Test build #48284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48284/consoleFull)** for PR 10466 at commit [`6a0efed`](https://g

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167044200 @maropu I agree that can be another way! but I just think an interface should be inclusive not exclusive. Handing in `ParquetRelation` might mean other datasources

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167043478 **[Test build #48286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48286/consoleFull)** for PR 10463 at commit [`8157ee0`](https://gi

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167043114 add to whitelist. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-2827][GraphX] Add collectDegreeDist to ...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/4399#issuecomment-167042951 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167042504 **[Test build #48285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48285/consoleFull)** for PR 10463 at commit [`8157ee0`](https://gi

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48395965 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin ex

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167042310 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167042309 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167042286 **[Test build #48281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48281/consoleFull)** for PR 10435 at commit [`e4d7b82`](https://g

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167042101 Adding a special handing for Parquet is better? I think that required columns for push-down filters should be passed to each data sources, and this is a more natural wa

[GitHub] spark pull request: add default RDD name for one created via sc.te...

2015-12-23 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/10456#issuecomment-167041948 LGTM as well. Could you add testcases for this change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. I

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10466#issuecomment-167041784 **[Test build #48284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48284/consoleFull)** for PR 10466 at commit [`6a0efed`](https://gi

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167041637 ok to test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread hhbyyh
GitHub user hhbyyh opened a pull request: https://github.com/apache/spark/pull/10466 [SPARK-12375] [ML] add handleinvalid for vectorindexer jira: https://issues.apache.org/jira/browse/SPARK-12375 >"Add option for allowing unknown categories, probably via a parameter like "allowU

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167040023 And you are right I think the comments I said is not related with this PR. Let's wait for their comments! --- If your project is set up for it, you can reply to th

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167039836 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167039831 If this patch merged, the comment below is not suitable for `JDBCRelation`. https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167039814 **[Test build #48279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48279/consoleFull)** for PR 10368 at commit [`5011926`](https://g

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167039837 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167039644 @maropu I believe it is a Parquet stuff. AFAIK, the columns in filters should be set to `requestedSchema` for Parquet. But [this](https://github.com/apache/spark/bl

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167039229 @HyukjinKwon ISTM the root problem is that catalyst cannot fill required columns on-the-fly for data sources. `unhandleFilters` is little related to the problem. --- I

[GitHub] spark pull request: [SPARK-12515][SQL][DOC] minor doc update for r...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10465#issuecomment-167038901 **[Test build #48282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48282/consoleFull)** for PR 10465 at commit [`d68f856`](https://gi

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167038607 **[Test build #48283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48283/consoleFull)** for PR 10368 at commit [`a4173eb`](https://gi

[GitHub] spark pull request: [SPARK-12513] [Streaming] SocketReceiver hang ...

2015-12-23 Thread guoxu1231
Github user guoxu1231 commented on the pull request: https://github.com/apache/spark/pull/10464#issuecomment-167038464 Not sure why 2 commits in this PR? Do I need t re-submit this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-12515][SQL][DOC] minor doc update for r...

2015-12-23 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/10465 [SPARK-12515][SQL][DOC] minor doc update for read.jdbc You can merge this pull request into a Git repository by running: $ git pull https://github.com/felixcheung/spark dfreaderjdbcdoc A

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167037408 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167037407 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167037362 **[Test build #48277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48277/consoleFull)** for PR 10427 at commit [`56d14cf`](https://g

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167036143 **[Test build #48281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48281/consoleFull)** for PR 10435 at commit [`e4d7b82`](https://gi

[GitHub] spark pull request: [SPARK-12513] [Streaming] SocketReceiver hang ...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10464#issuecomment-167036016 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12513] [Streaming] SocketReceiver hang ...

2015-12-23 Thread guoxu1231
GitHub user guoxu1231 opened a pull request: https://github.com/apache/spark/pull/10464 [SPARK-12513] [Streaming] SocketReceiver hang in Netcat example Close client side socket connection before restart socket receiver. You can merge this pull request into a Git repository by runnin

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167035310 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167035311 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10463#issuecomment-167035212 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-12502][Build][Python] Script /dev/run-t...

2015-12-23 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/10463 [SPARK-12502][Build][Python] Script /dev/run-tests fails when IBM Java is used fix an exception with IBM JDK by removing update field from a JavaVersion tuple. This is because IBM JDK does not have

[GitHub] spark pull request: [Core] remove redundant collection conversion.

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10462#issuecomment-167035224 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [Core] remove redundant collection conversion.

2015-12-23 Thread yaooqinn
GitHub user yaooqinn opened a pull request: https://github.com/apache/spark/pull/10462 [Core] remove redundant collection conversion. remove redundant collection conversion. Array toArray You can merge this pull request into a Git repository by running: $ git pull http

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033978 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033952 **[Test build #48274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48274/consoleFull)** for PR 10435 at commit [`207ca84`](https://g

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033976 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12439][SQL] Fix toCatalystArray and Map...

2015-12-23 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/10391#issuecomment-167033940 @cloud-fan @marmbrus Are you ok for latest updates? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48393687 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin ext

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167033459 **[Test build #48279 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48279/consoleFull)** for PR 10368 at commit [`5011926`](https://gi

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167033198 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have thi

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033099 **[Test build #48272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48272/consoleFull)** for PR 10435 at commit [`f12cbb6`](https://g

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033130 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

  1   2   3   4   5   >