[GitHub] spark issue #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & Set(2, 3...

2017-08-24 Thread iamhumanbeing
Github user iamhumanbeing commented on the issue: https://github.com/apache/spark/pull/19037 ok. I will close this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & S...

2017-08-24 Thread iamhumanbeing
Github user iamhumanbeing closed the pull request at: https://github.com/apache/spark/pull/19037 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 When would the history server receive events from clusters with different resource managers? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81118/ Test PASSed. ---

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81118/testReport)** for PR 19029 at commit [`c24292c`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 Sorry,I do not understand what you mean. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 This still isn't addressing the point: when would they not _all_ be YARN? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 For example, I would like to view some of the applications of the resource schedule of yarn, I can sort the 'master' column. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 What does knowing the resource scheduler help? but my point is, it's already known in general. A history server most certainly collects history from different users' apps, but not from different

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 1.It is more convenient for the observer to more easily know the resource scheduling mode of the current spark application. 2.For the 'Spark User' column. It would be identical in alm

[GitHub] spark pull request #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating e...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder ...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18488 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19051 **[Test build #81120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81120/testReport)** for PR 19051 at commit [`29fd7d7`](https://github.com/apache/spark/commit/29

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-24 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19051#discussion_r135190132 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tuning/CrossValidatorSuite.scala --- @@ -187,14 +187,13 @@ class CrossValidatorSuite cv2.getEstim

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-24 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19051#discussion_r135190085 --- Diff: common/kvstore/src/main/java/org/apache/spark/util/kvstore/KVStoreIterator.java --- @@ -31,7 +32,7 @@ * */ @Private -public

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-24 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19051#discussion_r135190194 --- Diff: pom.xml --- @@ -2058,7 +2058,7 @@ ${java.version} -target ${java.version} -

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-24 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/19051 [MINOR][BUILD] Fix build warnings and Java lint errors ## What changes were proposed in this pull request? Fix build warnings and Java lint errors. This just helps a bit in evaluating (new)

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 What's the value of this column? In just about all cases it will have the same value in every row, like 'yarn'. Even if not, why is it useful? --- If your project is set up for it, you can reply to

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 Sorry, I did not understand what you meant. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #81119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81119/testReport)** for PR 15435 at commit [`1395de2`](https://github.com/apache/spark/commit/13

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-24 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15435 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 Why? It would be identical in almost all use cases. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & Set(2, 3...

2017-08-24 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19037 Same, why do you think the test can or should be more specific? There is no motivation --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18991: [SPARK-21783][SQL] Turn on ORC filter push-down by defau...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18991 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18991: [SPARK-21783][SQL] Turn on ORC filter push-down by defau...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18991 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81114/ Test PASSed. ---

[GitHub] spark issue #18991: [SPARK-21783][SQL] Turn on ORC filter push-down by defau...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18991 **[Test build #81114 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81114/testReport)** for PR 18991 at commit [`2bc2b17`](https://github.com/apache/spark/commit/2

[GitHub] spark pull request #17357: [SPARK-20025][CORE] Ignore SPARK_LOCAL* env, whil...

2017-08-24 Thread ScrapCodes
Github user ScrapCodes commented on a diff in the pull request: https://github.com/apache/spark/pull/17357#discussion_r135187410 --- Diff: core/src/main/scala/org/apache/spark/deploy/rest/StandaloneRestServer.scala --- @@ -139,7 +139,9 @@ private[rest] class StandaloneSubmitRequest

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81118/testReport)** for PR 19029 at commit [`c24292c`](https://github.com/apache/spark/commit/c2

[GitHub] spark issue #18956: [SPARK-21726][SQL] Check for structural integrity of the...

2017-08-24 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18956 `RewritePredicateSubquery` fails structural integrity check because it can produce `Join` with conflicting attributes in its left and right plans. I submitted #19050 to fix it. --- If your

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19050 **[Test build #81117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81117/testReport)** for PR 19050 at commit [`edb6271`](https://github.com/apache/spark/commit/ed

[GitHub] spark pull request #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery ...

2017-08-24 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/19050 [SPARK-21835][SQL][WIP] RewritePredicateSubquery should not produce unresolved query plans ## What changes were proposed in this pull request? `RewritePredicateSubquery` rewrites correlated

[GitHub] spark pull request #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateO...

2017-08-24 Thread WeichenXu123
Github user WeichenXu123 commented on a diff in the pull request: https://github.com/apache/spark/pull/19029#discussion_r135186430 --- Diff: mllib/src/main/scala/org/apache/spark/ml/stat/Summarizer.scala --- @@ -438,6 +438,10 @@ private[ml] object SummaryBuilderImpl extends Logging

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19049 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #19049: [WEB-UI]Add the 'master' column to identify the t...

2017-08-24 Thread guoxiaolongzte
GitHub user guoxiaolongzte opened a pull request: https://github.com/apache/spark/pull/19049 [WEB-UI]Add the 'master' column to identify the type of resource management for the spark job, in the history server web ui. ## What changes were proposed in this pull request? Add the '

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81113/ Test PASSed. ---

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19044 **[Test build #81113 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81113/testReport)** for PR 19044 at commit [`e042621`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-24 Thread caneGuy
Github user caneGuy commented on the issue: https://github.com/apache/spark/pull/18730 @cloud-fan can we retest this?Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18730 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81112/ Test FAILed. ---

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18730 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18730 **[Test build #81112 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81112/testReport)** for PR 18730 at commit [`14ca824`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/8/ Test FAILed. ---

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19048 **[Test build #81116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81116/testReport)** for PR 19048 at commit [`e000db3`](https://github.com/apache/spark/commit/e0

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #8 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/8/testReport)** for PR 15435 at commit [`1395de2`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-24 Thread sitalkedia
Github user sitalkedia commented on the issue: https://github.com/apache/spark/pull/19048 cc - @markhamstra , @sameeragarwal, @rxin, @vanzin, --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #18953: [SPARK-20682][SQL] Update ORC data source based on Apach...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18953 Hi, @cloud-fan . Could you review this again when you have sometime? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18966 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18966 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81109/ Test PASSed. ---

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18966 **[Test build #81109 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81109/testReport)** for PR 18966 at commit [`ea9fea4`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17886 **[Test build #81115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81115/testReport)** for PR 17886 at commit [`e752d42`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17886 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81115/ Test PASSed. ---

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17886 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19048 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81110/ Test FAILed. ---

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19048 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19048 **[Test build #81110 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81110/testReport)** for PR 19048 at commit [`e30bbac`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #18991: [SPARK-21783][SQL] Turn on ORC filter push-down by defau...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18991 Hi, @cloud-fan, @gatorsmile , @sameeragarwal , @rxin , @mridulm . Could you reivew this one liner PR about ORC PPD configuration? --- If your project is set up for it, you can reply to thi

[GitHub] spark issue #18991: [SPARK-21783][SQL] Turn on ORC filter push-down by defau...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18991 **[Test build #81114 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81114/testReport)** for PR 18991 at commit [`2bc2b17`](https://github.com/apache/spark/commit/2b

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17886 **[Test build #81115 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81115/testReport)** for PR 17886 at commit [`e752d42`](https://github.com/apache/spark/commit/e7

[GitHub] spark issue #18991: [SPARK-21783][SQL] Turn on ORC filter push-down by defau...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18991 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19044 **[Test build #81113 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81113/testReport)** for PR 19044 at commit [`e042621`](https://github.com/apache/spark/commit/e0

[GitHub] spark issue #19034: [SPARK-21821][CORE]Support to force kill the CoarseGrain...

2017-08-24 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19034 Agree with @vanzin , if you really want to fix this issue I think you should find out the root cause and fix the code in Spark. --- If your project is set up for it, you can reply to this email a

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19044 Retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #18315: [SPARK-21108] [ML] convert LinearSVC to aggregato...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18315 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #18315: [SPARK-21108] [ML] convert LinearSVC to aggregator frame...

2017-08-24 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/18315 Merged into master. Thanks for all. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request #18315: [SPARK-21108] [ML] convert LinearSVC to aggregato...

2017-08-24 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/18315#discussion_r135172322 --- Diff: mllib/src/test/scala/org/apache/spark/ml/optim/aggregator/HingeAggregatorSuite.scala --- @@ -0,0 +1,150 @@ +/* + * Licensed to the Apa

[GitHub] spark issue #19039: [SPARK-21829][CORE] Enable config to permanently blackli...

2017-08-24 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19039 The changes you made in `BlacklistTracker` seems break the design purpose of backlist. The blacklist in Spark as well as in MR/TEZ assumes bad nodes/executors will be back to normal in several hou

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18730 **[Test build #81112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81112/testReport)** for PR 18730 at commit [`14ca824`](https://github.com/apache/spark/commit/14

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19044 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81107/ Test FAILed. ---

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19044 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19044 **[Test build #81107 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81107/testReport)** for PR 19044 at commit [`e042621`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #8 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/8/testReport)** for PR 15435 at commit [`1395de2`](https://github.com/apache/spark/commit/13

[GitHub] spark issue #19046: [SPARK-18769][yarn] Limit resource requests based on RM'...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19046 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19046: [SPARK-18769][yarn] Limit resource requests based on RM'...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19046 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81108/ Test PASSed. ---

[GitHub] spark issue #19046: [SPARK-18769][yarn] Limit resource requests based on RM'...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19046 **[Test build #81108 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81108/testReport)** for PR 19046 at commit [`03477f5`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19048 **[Test build #81110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81110/testReport)** for PR 19048 at commit [`e30bbac`](https://github.com/apache/spark/commit/e3

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19044 Thank you for review, @gatorsmile ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #19048: [SPARK-21834] Incorrect executor request in case ...

2017-08-24 Thread sitalkedia
GitHub user sitalkedia opened a pull request: https://github.com/apache/spark/pull/19048 [SPARK-21834] Incorrect executor request in case of dynamic allocation ## What changes were proposed in this pull request? killExecutor api currently does not allow killing an executor w

[GitHub] spark issue #19031: [SPARK-21603][SQL][FOLLOW-UP] Use -1 to disable maxLines...

2017-08-24 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/19031 ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featur

[GitHub] spark issue #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions counts ...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18966 **[Test build #81109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81109/testReport)** for PR 18966 at commit [`ea9fea4`](https://github.com/apache/spark/commit/ea

[GitHub] spark issue #16422: [SPARK-17642] [SQL] support DESC EXTENDED/FORMATTED tabl...

2017-08-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16422 ping @wzhfy --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark pull request #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions ...

2017-08-24 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18966#discussion_r135164815 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/BenchmarkWideTable.scala --- @@ -42,12 +42,16 @@ class BenchmarkWideTable extends

[GitHub] spark issue #19046: [SPARK-18769][yarn] Limit resource requests based on RM'...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19046 **[Test build #81108 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81108/testReport)** for PR 19046 at commit [`03477f5`](https://github.com/apache/spark/commit/03

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19044 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81106/ Test PASSed. ---

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19044 **[Test build #81106 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81106/testReport)** for PR 19044 at commit [`bc906c8`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & Set(2, 3...

2017-08-24 Thread iamhumanbeing
Github user iamhumanbeing commented on the issue: https://github.com/apache/spark/pull/19037 @srowen How about "assert(exchanges.map(_.outputPartitioning.numPartitions).sorted === List(2, 2, 2, 3))"? --- If your project is set up for it, you can reply to this email and have your re

[GitHub] spark pull request #19040: [SPARK-21826][SQL][2.1][2.0] outer broadcast hash...

2017-08-24 Thread cloud-fan
Github user cloud-fan closed the pull request at: https://github.com/apache/spark/pull/19040 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #19045: [WIP][SPARK-20628][CORE] Keep track of nodes (/ spot ins...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19045 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81103/ Test PASSed. ---

[GitHub] spark issue #19045: [WIP][SPARK-20628][CORE] Keep track of nodes (/ spot ins...

2017-08-24 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19045 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #19045: [WIP][SPARK-20628][CORE] Keep track of nodes (/ spot ins...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19045 **[Test build #81103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81103/testReport)** for PR 19045 at commit [`65a29c1`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #18704: [SPARK-20783][SQL] Create ColumnVector to abstract exist...

2017-08-24 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18704 @cloud-fan could you please review this again? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark issue #18837: [Spark-20812][Mesos] Add secrets support to the dispatch...

2017-08-24 Thread ArtRand
Github user ArtRand commented on the issue: https://github.com/apache/spark/pull/18837 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wis

[GitHub] spark issue #18956: [SPARK-21726][SQL] Check for structural integrity of the...

2017-08-24 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/18956 Seems there are other issues caused by `RewritePredicateSubquery` rule. I'll investigate and fix it. --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Exp...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19044#discussion_r135158510 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/ExpressionSQLBuilderSuite.scala --- @@ -19,12 +19,28 @@ package org.apache.spark.sql.

[GitHub] spark issue #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Expression...

2017-08-24 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19044 **[Test build #81107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81107/testReport)** for PR 19044 at commit [`e042621`](https://github.com/apache/spark/commit/e0

[GitHub] spark pull request #19044: [SPARK-21832][TEST] Merge SQLBuilderTest into Exp...

2017-08-24 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19044#discussion_r135157926 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/ExpressionSQLBuilderSuite.scala --- @@ -19,12 +19,28 @@ package org.apache.spark.sql.

[GitHub] spark pull request #18966: [SPARK-21751][SQL] CodeGeneraor.splitExpressions ...

2017-08-24 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18966#discussion_r135157982 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/BenchmarkWideTable.scala --- @@ -42,12 +42,16 @@ class BenchmarkWideTable ext

  1   2   3   4   >