[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11428 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190601335 LGTM. Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-13232][YARN] Fix executor node label

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/11129#issuecomment-190599752 Any further updates on it? CC @sryza about this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark pull request: [SPARK-13548][BUILD] Move tags and unsafe modu...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11426#issuecomment-190597216 **[Test build #2596 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2596/consoleFull)** for PR 11426 at commit [`0c967cc`](https://g

[GitHub] spark pull request: [SPARK-13029][ml] fix a logistic regression is...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/10940#issuecomment-190593882 Had an offline discussion with @dbtsai and @coderxiang . We agreed to keep the current behavior and have it well documented. I will mark this JIRA as "won't" and created

[GitHub] spark pull request: [SPARK-6735][YARN] Add window based executor f...

2016-02-29 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/10241#discussion_r54530945 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -152,7 +164,17 @@ private[yarn] class YarnAllocator( def

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190591444 **[Test build #52227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52227/consoleFull)** for PR 11136 at commit [`007a4ec`](https://gi

[GitHub] spark pull request: [SPARK-13385][MLlib] Enable AssociationRules t...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11411#issuecomment-190587137 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13385][MLlib] Enable AssociationRules t...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11411#issuecomment-190587133 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13385][MLlib] Enable AssociationRules t...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11411#issuecomment-190586830 **[Test build #52221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52221/consoleFull)** for PR 11411 at commit [`9c3a8c3`](https://g

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54529927 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala --- @@ -78,4 +78,21 @@ class WholeStageCodegenSuite extends Spa

[GitHub] spark pull request: [SPARK-12817] Add BlockManager.getOrElseUpdate...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11436#issuecomment-190586185 **[Test build #52226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52226/consoleFull)** for PR 11436 at commit [`f8cccea`](https://gi

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54529803 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala --- @@ -78,4 +78,21 @@ class WholeStageCodegenSuite extends Spa

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190585130 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190585131 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190585033 **[Test build #52218 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52218/consoleFull)** for PR 11419 at commit [`bbf9432`](https://g

[GitHub] spark pull request: [SPARK-13139][SQL] Create native DDL commands

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-190584968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13139][SQL] Create native DDL commands

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-190584967 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54529510 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala --- @@ -78,4 +78,21 @@ class WholeStageCodegenSuite extends Spa

[GitHub] spark pull request: [SPARK-13139][SQL] Create native DDL commands

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-190584474 **[Test build #52217 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52217/consoleFull)** for PR 11048 at commit [`6032268`](https://g

[GitHub] spark pull request: [SPARK-12552][Core]Correctly count the driver ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10506#issuecomment-190579869 **[Test build #52225 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52225/consoleFull)** for PR 10506 at commit [`7cec07c`](https://gi

[GitHub] spark pull request: [SPARK-13404] [SQL] Create variables for input...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11274#issuecomment-190577409 **[Test build #52224 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52224/consoleFull)** for PR 11274 at commit [`1a1452e`](https://gi

[GitHub] spark pull request: [SPARK-13404] [SQL] Create variables for input...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11274#issuecomment-190576044 **[Test build #2595 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2595/consoleFull)** for PR 11274 at commit [`ca8fe0f`](https://g

[GitHub] spark pull request: [SPARK-12552][Core]Correctly count the driver ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10506#issuecomment-190575725 **[Test build #52223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52223/consoleFull)** for PR 10506 at commit [`a117dcd`](https://g

[GitHub] spark pull request: [SPARK-12552][Core]Correctly count the driver ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10506#issuecomment-190575732 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12552][Core]Correctly count the driver ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10506#issuecomment-190575730 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190575477 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12552][Core]Correctly count the driver ...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10506#issuecomment-190575489 @andrewor14 , would you please review this patch again, it is pending here a long time and I think it is actually a bug here. Thanks a lot. --- If your project is se

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190575220 **[Test build #52220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52220/consoleFull)** for PR 11428 at commit [`4f0e3b9`](https://g

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190575482 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13404] [SQL] Create variables for input...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11274#issuecomment-190575463 **[Test build #2594 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2594/consoleFull)** for PR 11274 at commit [`ca8fe0f`](https://g

[GitHub] spark pull request: [SPARK-12552][Core]Correctly count the driver ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10506#issuecomment-190575051 **[Test build #52223 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52223/consoleFull)** for PR 10506 at commit [`a117dcd`](https://gi

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190575061 **[Test build #5 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/5/consoleFull)** for PR 11391 at commit [`b64e52d`](https://gi

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54528196 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala --- @@ -78,4 +78,21 @@ class WholeStageCodegenSuite extends Spa

[GitHub] spark pull request: [SPARK-13444] [MLlib] QuantileDiscretizer choo...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11402#issuecomment-190571986 @oliverpierson I haven't seen this test fails in the master build. If I'm correct, we control the random seed in the master branch resulting deterministic behavior. But

[GitHub] spark pull request: [SPARK-13586][STREAMING]add config to skip gen...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/11440#issuecomment-190570144 For example, if your sliding duration is 1, window duration is 4, and batch duration is 1, and the down time is 3. If you skip this this 3 batches, IIUC the result wi

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190569078 **[Test build #52220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52220/consoleFull)** for PR 11428 at commit [`4f0e3b9`](https://gi

[GitHub] spark pull request: [SPARK-13385][MLlib] Enable AssociationRules t...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11411#issuecomment-190569087 **[Test build #52221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52221/consoleFull)** for PR 11411 at commit [`9c3a8c3`](https://gi

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-13586][STREAMING]add config to skip gen...

2016-02-29 Thread jeanlyn
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/11440#issuecomment-190568465 Thanks @jerryshao for suggestion! > Jobs generated in the down time can be used for WAL replay, did you test when these down jobs are removed, the behavior of WAL re

[GitHub] spark pull request: [SPARK-13551] [MLLib] Fix wrong comment and re...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11429#issuecomment-190568451 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-13385][MLlib] Enable AssociationRules t...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11411#issuecomment-190568059 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190567560 **[Test build #52219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52219/consoleFull)** for PR 11391 at commit [`8d254d2`](https://gi

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190567826 @srowen It would be nice to have example code in the user guide for every algorithm. And this PR helps. --- If your project is set up for it, you can reply to this emai

[GitHub] spark pull request: [SPARK-13550] [ML] Add java example for ml.clu...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11428#issuecomment-190567858 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190567555 **[Test build #52218 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52218/consoleFull)** for PR 11419 at commit [`bbf9432`](https://gi

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190566838 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark pull request: [SPARK-13538][ML] Add GaussianMixture to ML

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/11419#issuecomment-190566812 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54526775 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/BufferedRowIterator.java --- @@ -35,6 +35,8 @@ // used when there is no column in out

[GitHub] spark pull request: [SPARK-13582] [SQL] defer dictionary decoding ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11437#issuecomment-190563231 **[Test build #2593 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2593/consoleFull)** for PR 11437 at commit [`6fce801`](https://g

[GitHub] spark pull request: [SPARK-13583][BUILD] Enforce `UnusedImports` J...

2016-02-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11438#issuecomment-190562653 Rebased to trigger the Jenkins test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-12977][Streaming][WIP] Support Streamin...

2016-02-29 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/10966 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12941][SQL][BRANCH-1.4] Spark-SQL JDBC ...

2016-02-29 Thread thomastechs
Github user thomastechs commented on a diff in the pull request: https://github.com/apache/spark/pull/10912#discussion_r54525699 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -445,4 +445,9 @@ class JDBCSuite extends SparkFunSuite with BeforeAnd

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54525690 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/BufferedRowIterator.java --- @@ -35,6 +35,8 @@ // used when there is no column in out

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11391#discussion_r54525659 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/BufferedRowIterator.java --- @@ -35,6 +35,8 @@ // used when there is no column in out

[GitHub] spark pull request: [SPARK-12981][SQL] Fix Python UDF extraction f...

2016-02-29 Thread xguo27
Github user xguo27 commented on the pull request: https://github.com/apache/spark/pull/10935#issuecomment-190554648 Using these two functionally equavalent code snippets: Scala ``` val data = Seq((1, "1"), (2, "2"), (3, "2"), (1, "3")).toDF("a","b") val my_filter =

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54524989 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/GeneralizedLinearRegression.scala --- @@ -0,0 +1,577 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13029][ml] fix a logistic regression is...

2016-02-29 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/10940#issuecomment-190553302 @coderxiang @dbtsai Sorry for late response! I actually thought this PR already got merged ... Anyway, I tested `glmnet` and found that `glmnet` outputs zero coefficient

[GitHub] spark pull request: [SPARK-12817] Add BlockManager.getOrElseUpdate...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11436#issuecomment-190552987 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12817] Add BlockManager.getOrElseUpdate...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11436#issuecomment-190552985 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12817] Add BlockManager.getOrElseUpdate...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11436#issuecomment-190552868 **[Test build #52212 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52212/consoleFull)** for PR 11436 at commit [`50f66d1`](https://g

[GitHub] spark pull request: [SPARK-13457][SQL] Removes DataFrame RDD opera...

2016-02-29 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11388#discussion_r54524553 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala --- @@ -1427,30 +1427,6 @@ class DataFrame private[sql]( def transform[U](t: D

[GitHub] spark pull request: [SPARK-13457][SQL] Removes DataFrame RDD opera...

2016-02-29 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/11388#discussion_r54524448 --- Diff: mllib/src/main/scala/org/apache/spark/ml/evaluation/RegressionEvaluator.scala --- @@ -85,7 +85,8 @@ final class RegressionEvaluator @Since("1.4.

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190551990 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190551991 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190551827 **[Test build #52213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52213/consoleFull)** for PR 11391 at commit [`c887cf4`](https://g

[GitHub] spark pull request: [SPARK-12893][YARN] Fix history URL redirect e...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/10821#issuecomment-190551333 @steveloughran , here "1" is the number of attempts [here](https://github.com/apache/spark/blob/master/core/src/main/resources/org/apache/spark/ui/static/historypage.j

[GitHub] spark pull request: [SPARK-13139][SQL] Create native DDL commands

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11048#issuecomment-190548517 **[Test build #52217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52217/consoleFull)** for PR 11048 at commit [`6032268`](https://gi

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190538874 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190538867 **[Test build #52216 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52216/consoleFull)** for PR 11136 at commit [`31a912c`](https://g

[GitHub] spark pull request: [SPARK-13123][SQL] Implement whole state codeg...

2016-02-29 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11359#discussion_r54522189 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/Sort.scala --- @@ -93,4 +97,74 @@ case class Sort( sortedIterator }

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190538871 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13583][BUILD] Enforce `UnusedImports` J...

2016-02-29 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/11438#issuecomment-190537588 It seems that Jenkins fails due to irrelevant things like the following. ``` Error instrumenting class:org.apache.spark.mllib.regression.IsotonicRegressio

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190537367 **[Test build #52216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52216/consoleFull)** for PR 11136 at commit [`31a912c`](https://gi

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54521794 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala --- @@ -0,0 +1,499 @@ +/* + * Licensed to th

[GitHub] spark pull request: [SPARK-13586][STREAMING]add config to skip gen...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/11440#issuecomment-190531231 Also for some windowing operations, I think this removal of down time jobs may possibly lead to the inconsistent result of windowing aggregation. --- If your project

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190530641 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190530637 **[Test build #52215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52215/consoleFull)** for PR 11136 at commit [`314b562`](https://g

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190530642 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13586][STREAMING]add config to skip gen...

2016-02-29 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/11440#issuecomment-190530543 Jobs generated in the down time can be used for WAL replay, did you test when these down jobs are removed, the behavior of WAL replay is still correct? --- If your p

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190529580 **[Test build #52215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52215/consoleFull)** for PR 11136 at commit [`314b562`](https://gi

[GitHub] spark pull request: [SPARK-13583][BUILD] Enforce `UnusedImports` J...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11438#issuecomment-190529756 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-13583][BUILD] Enforce `UnusedImports` J...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11438#issuecomment-190529757 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-13583][BUILD] Enforce `UnusedImports` J...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11438#issuecomment-190529610 **[Test build #52203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52203/consoleFull)** for PR 11438 at commit [`5e82490`](https://g

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190528993 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11517][SQL]Calc partitions in parallel ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9483#issuecomment-190527518 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/5

[GitHub] spark pull request: [SPARK-11517][SQL]Calc partitions in parallel ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9483#issuecomment-190527517 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11517][SQL]Calc partitions in parallel ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9483#issuecomment-190527389 **[Test build #52210 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52210/consoleFull)** for PR 9483 at commit [`fdac95b`](https://git

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190527136 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190527127 **[Test build #52214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52214/consoleFull)** for PR 11136 at commit [`314b562`](https://g

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190527134 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-9325][SPARK-R] collect() head() and sho...

2016-02-29 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/11336#issuecomment-190526619 @olarayej, I am not sure if it is conceptually correct to associate a Column to only one DF. Conceptually, a Column could be depend on 0, 1, 2 or more DataFrames. For e

[GitHub] spark pull request: [SPARK-13511][SQL] Add wholestage codegen for ...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11391#issuecomment-190526392 **[Test build #52213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52213/consoleFull)** for PR 11391 at commit [`c887cf4`](https://gi

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54519291 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala --- @@ -0,0 +1,499 @@ +/* + * Licensed to th

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190526388 **[Test build #52214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52214/consoleFull)** for PR 11136 at commit [`314b562`](https://gi

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/11136#issuecomment-190526311 Jenkins, test this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-12811] [ML] Estimator for Generalized L...

2016-02-29 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/11136#discussion_r54519070 --- Diff: mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala --- @@ -0,0 +1,499 @@ +/* + * Licensed to th

[GitHub] spark pull request: [SPARK-12817] Add BlockManager.getOrElseUpdate...

2016-02-29 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/11436#discussion_r54518895 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -852,18 +878,20 @@ private[spark] class BlockManager( Awa

[GitHub] spark pull request: [SPARK-12817] Add BlockManager.getOrElseUpdate...

2016-02-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11436#issuecomment-190522557 **[Test build #52212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/52212/consoleFull)** for PR 11436 at commit [`50f66d1`](https://gi

[GitHub] spark pull request: [SPARK-13586]add config to skip generate down ...

2016-02-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11440#issuecomment-190522437 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

  1   2   3   4   5   >