[GitHub] spark pull request: upgrade joda-time: 2.9 -> 2.9.2

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11847#issuecomment-198853307 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: upgrade joda-time: 2.9 -> 2.9.2

2016-03-19 Thread sullis
GitHub user sullis opened a pull request: https://github.com/apache/spark/pull/11847 upgrade joda-time: 2.9 -> 2.9.2 You can merge this pull request into a Git repository by running: $ git pull https://github.com/sullis/spark joda-time-2.9.2 Alternatively you can review and

[GitHub] spark pull request: [SPARK-13289][MLLIB] Fix infinite distances be...

2016-03-19 Thread flyjy
Github user flyjy commented on the pull request: https://github.com/apache/spark/pull/11812#issuecomment-198852800 Thanks. I have checked that the problem still exists with only the adaptive learning rate change. So, I will fix this bug without change the existing interface.

[GitHub] spark pull request: [SPARK-13764][SQL] Parse modes in JSON data so...

2016-03-19 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11756#issuecomment-197629010 LGTM, cc @davies for another look. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12469][CORE][WIP/RFC] Consistent accumu...

2016-03-19 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r56426605 --- Diff: core/src/main/scala/org/apache/spark/Accumulable.scala --- @@ -146,6 +212,32 @@ class Accumulable[R, T] private ( def merge(term: R) {

[GitHub] spark pull request: [SPARK-13988][Core] Make replaying event logs ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11800#issuecomment-198112103 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198082685 **[Test build #53468 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53468/consoleFull)** for PR 11636 at commit

[GitHub] spark pull request: [SPARK-12182][ML] Distributed binning for tree...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/10231#discussion_r56441090 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/RandomForest.scala --- @@ -842,60 +842,59 @@ private[ml] object RandomForest extends Logging

[GitHub] spark pull request: [SPARK-13958]Executor OOM due to unbounded gro...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11794#issuecomment-198535076 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13761] [ML] Deprecate validateParams

2016-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/11620#discussion_r56513463 --- Diff: mllib/src/main/scala/org/apache/spark/ml/param/params.scala --- @@ -549,7 +548,9 @@ trait Params extends Identifiable with Serializable { *

[GitHub] spark pull request: [SPARK-13764][SQL] Parse modes in JSON data so...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11756#issuecomment-198214354 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13974][SQL] sub-query names do not need...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11783#issuecomment-197913617 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198084216 **[Test build #53468 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53468/consoleFull)** for PR 11636 at commit

[GitHub] spark pull request: [SPARK-13852][YARN]handle the InterruptedExcep...

2016-03-19 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/11692#issuecomment-197342124 So inside of hadoop in the getApplicationReport call, it was in RetryInvocationHandler which was doing a sleep and got an interrupted exception. That ended up

[GitHub] spark pull request: [SPARK-13017][Docs] Replace example code in ml...

2016-03-19 Thread keypointt
Github user keypointt commented on the pull request: https://github.com/apache/spark/pull/11142#issuecomment-197375803 cc @mengxr --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13982][SparkR] Fixed features column he...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11793#issuecomment-198066744 **[Test build #53464 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53464/consoleFull)** for PR 11793 at commit

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-19 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197535055 Since all of this code is going to be changed heavily / removed after your final patch, I'm going to go ahead and just leave the Maven test path unchanged so that we

[GitHub] spark pull request: [SPARK-13997][SQL] Use Hadoop 2.0 default valu...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11806#issuecomment-198207204 The efficiency of compression algorithms usually goes down as the frame (block) size goes down. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: SPARK-13034[ML]:PySpark ml.classification supp...

2016-03-19 Thread wangmiao1981
Github user wangmiao1981 commented on the pull request: https://github.com/apache/spark/pull/11582#issuecomment-198064456 close this one as it has been merged with 11707. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-13904][Scheduler]Add support for plugga...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11723#issuecomment-198256400 **[Test build #53525 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53525/consoleFull)** for PR 11723 at commit

[GitHub] spark pull request: [SPARK-13950] [SQL] generate code for sort mer...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11771#issuecomment-197592210 **[Test build #53371 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53371/consoleFull)** for PR 11771 at commit

[GitHub] spark pull request: [SPARK-14007] [SQL] Manage the memory used by ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11826#issuecomment-198481175 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13981][SQL] Defer evaluating variables ...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11792#issuecomment-198090295 **[Test build #53463 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53463/consoleFull)** for PR 11792 at commit

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197553484 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13957] [SQL] Support Group By Ordinal i...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11846#issuecomment-198846521 **[Test build #53624 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53624/consoleFull)** for PR 11846 at commit

[GitHub] spark pull request: [SPARK-13914] [Scheduler] Add functionality to...

2016-03-19 Thread paragpc
Github user paragpc closed the pull request at: https://github.com/apache/spark/pull/11736 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13922][SQL] Filter rows with null attri...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11749#issuecomment-197556324 **[Test build #53354 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53354/consoleFull)** for PR 11749 at commit

[GitHub] spark pull request: [SPARK-13976][SQL] do not remove sub-queries a...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11786#issuecomment-197955452 **[Test build #53435 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53435/consoleFull)** for PR 11786 at commit

[GitHub] spark pull request: [Minor][DOC] Fix nits in JavaStreamingTestExam...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11821#issuecomment-198317555 **[Test build #53532 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53532/consoleFull)** for PR 11821 at commit

[GitHub] spark pull request: SPARK-13991 - Extend the enforcer plugin Maven...

2016-03-19 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/11803#discussion_r56646795 --- Diff: pom.xml --- @@ -1733,7 +1733,7 @@ -${maven.version} +

[GitHub] spark pull request: [SPARK-13923] [SQL] Implement SessionCatalog

2016-03-19 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/11750#discussion_r56422492 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/interface.scala --- @@ -211,8 +214,7 @@ case class CatalogTablePartition( *

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197467017 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13908][SQL] Add a LocalLimit for Collec...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11817#issuecomment-198414800 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13826][SQL] Addendum: update documentat...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11814#issuecomment-198239537 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13937][PySpark][ML] Change JavaWrapper ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11767#issuecomment-197490633 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13430][PySpark][ML] Python API for trai...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11621#issuecomment-197492294 **[Test build #53335 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53335/consoleFull)** for PR 11621 at commit

[GitHub] spark pull request: [SPARK-13629] [ML] Add binary toggle Param to ...

2016-03-19 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11536#issuecomment-198505962 @hhbyyh Thanks for the PR! LGTM, I agree with the use of minTF --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-13926] Automatically use Kryo serialize...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11755#issuecomment-197560970 **[Test build #53353 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53353/consoleFull)** for PR 11755 at commit

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-198845476 **[Test build #53622 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53622/consoleFull)** for PR 11486 at commit

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-198845488 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-198845487 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13826][SQL] Addendum: update documentat...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11814 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13993][PySpark] Add pyspark Rformula/Rf...

2016-03-19 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/11807#issuecomment-198147707 @jkbradley This is a follow-up for https://github.com/apache/spark/pull/9884 --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-13742][Core] Add non-iterator interface...

2016-03-19 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/11578#discussion_r56611345 --- Diff: core/src/main/scala/org/apache/spark/util/random/RandomSampler.scala --- @@ -155,6 +171,28 @@ class BernoulliSampler[T: ClassTag](fraction:

[GitHub] spark pull request: [SPARK-13839][SQL] Defer input evaluation and ...

2016-03-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11676#discussion_r56455098 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicOperators.scala --- @@ -80,12 +81,21 @@ case class Filter(condition: Expression, child:

[GitHub] spark pull request: [SPARK-13320] [SQL] Support Star in CreateStru...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11208#issuecomment-197606557 **[Test build #53376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53376/consoleFull)** for PR 11208 at commit

[GitHub] spark pull request: [SPARK-13839][SQL] Defer input evaluation and ...

2016-03-19 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/11676#issuecomment-197698865 cc @davies Can you please review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-13889][YARN][Branch-1.6]Fix the calcula...

2016-03-19 Thread carsonwang
GitHub user carsonwang opened a pull request: https://github.com/apache/spark/pull/11813 [SPARK-13889][YARN][Branch-1.6]Fix the calculation of the max number of executor failure ## What changes were proposed in this pull request? Backport #11713 to 1.6. The max number

[GitHub] spark pull request: [SPARK-13977] [SQL] Brings back Shuffled hash ...

2016-03-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11788#discussion_r56617782 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/ShuffledHashJoin.scala --- @@ -0,0 +1,95 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-14004][SQL] NamedExpressions should hav...

2016-03-19 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11822#issuecomment-198318534 Personally, I had once been quite confused by the fact that `NamedExpression.qualifiers` is a `Seq[String]` and thought that attributes can be qualified with

[GitHub] spark pull request: [SPARK-13989][SQL] Remove non-vectorized/unsaf...

2016-03-19 Thread sameeragarwal
Github user sameeragarwal commented on the pull request: https://github.com/apache/spark/pull/11799#issuecomment-198152113 Thanks, all comments addressed! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-13997][SQL] Use Hadoop 2.0 default valu...

2016-03-19 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/11806#issuecomment-198314857 It does mean each record is compressed separately. Maybe that makes sense for huge records, or somehow facilitates processing pieces of a block (since the whole block

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197641888 The log says: `java.lang.RuntimeException: spark-core: Binary compatibility check failed!`, but no reason is provided... cc @JoshRosen --- If your project is set

[GitHub] spark pull request: [SPARK-13320] [SQL] Support Star in CreateStru...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11208#issuecomment-197634039 **[Test build #53376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53376/consoleFull)** for PR 11208 at commit

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197763593 **[Test build #53407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53407/consoleFull)** for PR 11769 at commit

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-19 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/11815#discussion_r56620898 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -202,3 +203,14 @@ object Unions { } }

[GitHub] spark pull request: [SPARK-13957] [SQL] Support Group By Ordinal i...

2016-03-19 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/11846 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-13957] [SQL] Support Group By Ordinal i...

2016-03-19 Thread gatorsmile
GitHub user gatorsmile reopened a pull request: https://github.com/apache/spark/pull/11846 [SPARK-13957] [SQL] Support Group By Ordinal in SQL What changes were proposed in this pull request? This PR is to support group by position in SQL. For example, when users input the

[GitHub] spark pull request: [SPARK-13957] [SQL] Support Group By Ordinal i...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11846#issuecomment-198845243 **[Test build #53623 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53623/consoleFull)** for PR 11846 at commit

[GitHub] spark pull request: [SPARK-14012][SQL] Extract VectorizedColumnRea...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11834#issuecomment-198571979 **[Test build #53578 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53578/consoleFull)** for PR 11834 at commit

[GitHub] spark pull request: [SPARK-13923] [SQL] Implement SessionCatalog

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11750#issuecomment-197620375 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Minor][DOC] Add JavaStreamingTestExample

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11776#issuecomment-197732446 **[Test build #53399 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53399/consoleFull)** for PR 11776 at commit

[GitHub] spark pull request: [SPARK-12379][ML][MLLIB] Copy GBT implementati...

2016-03-19 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/10607#issuecomment-198033902 Thanks for doing this migration. I checked the PR and it LGTM Your tests look good to me. The tests all seem fairly close, except for a couple of outliers,

[GitHub] spark pull request: [SPARK-12469][CORE][WIP/RFC] Consistent accumu...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11105#issuecomment-197716738 **[Test build #53389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53389/consoleFull)** for PR 11105 at commit

[GitHub] spark pull request: [SPARK-12789] [SQL] Support Order By Ordinal i...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11815#issuecomment-198245857 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13602][CORE] Add shutdown hook to Drive...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11746#issuecomment-198142673 **[Test build #53475 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53475/consoleFull)** for PR 11746 at commit

[GitHub] spark pull request: [SPARK-12719][HOTFIX] Fix compilation against ...

2016-03-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/11787#issuecomment-197977494 Thanks. I am merging this to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [MINOR][SQL][BUILD] Remove duplicated lines

2016-03-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/11773#discussion_r56431109 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala --- @@ -49,7 +49,6 @@ class JoinSuite extends QueryTest with SharedSQLContext {

[GitHub] spark pull request: [SPARK-13957] [SQL] Support Group By Ordinal i...

2016-03-19 Thread gatorsmile
GitHub user gatorsmile opened a pull request: https://github.com/apache/spark/pull/11846 [SPARK-13957] [SQL] Support Group By Ordinal in SQL What changes were proposed in this pull request? This PR is to support group by position in SQL. For example, when users input the

[GitHub] spark pull request: [SPARK-12182][ML] Distributed binning for tree...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10231#issuecomment-198504543 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197700493 **[Test build #53392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53392/consoleFull)** for PR 11764 at commit

[GitHub] spark pull request: [SPARK-13958]Executor OOM due to unbounded gro...

2016-03-19 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11794#discussion_r56697868 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -320,7 +320,15 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [Spark-13034] PySpark ml.classification suppor...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11707#issuecomment-197553310 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11663#discussion_r56406664 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -275,23 +382,9 @@ def _set(self, **kwargs): """ for param, value in

[GitHub] spark pull request: [MINOR][SQL][BUILD] Remove duplicated lines

2016-03-19 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/11773#discussion_r56431084 --- Diff: project/MimaExcludes.scala --- @@ -299,13 +299,11 @@ object MimaExcludes { // [SPARK-13244][SQL] Migrates DataFrame to Dataset

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197407360 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [WIP][SPARK-13809][SQL] State store for stream...

2016-03-19 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/11645#discussion_r56386741 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala --- @@ -0,0 +1,200 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-13805][SQL] Generate code that get a va...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11636#issuecomment-198598006 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-19 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11663#discussion_r56406609 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -32,13 +35,17 @@ class Param(object): .. versionadded:: 1.3.0 """ -def

[GitHub] spark pull request: [SPARK-13958]Executor OOM due to unbounded gro...

2016-03-19 Thread sitalkedia
Github user sitalkedia commented on a diff in the pull request: https://github.com/apache/spark/pull/11794#discussion_r56696662 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/ShuffleExternalSorter.java --- @@ -320,7 +320,15 @@ private void growPointerArrayIfNecessary()

[GitHub] spark pull request: [SPARK-11891] Model export/import for RFormula...

2016-03-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9884 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13921] Store serialized blocks as multi...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11748#issuecomment-198007459 **[Test build #53442 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53442/consoleFull)** for PR 11748 at commit

[GitHub] spark pull request: [SPARK-13449] Naive Bayes wrapper in SparkR

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11486#issuecomment-198841429 **[Test build #53622 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53622/consoleFull)** for PR 11486 at commit

[GitHub] spark pull request: [SPARK-14000][SQL] case class with a tuple fie...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11816#issuecomment-198283547 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13068][PYSPARK][ML] Type conversion for...

2016-03-19 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/11663#discussion_r56548536 --- Diff: python/pyspark/ml/param/__init__.py --- @@ -65,6 +72,106 @@ def __eq__(self, other): return False +class

[GitHub] spark pull request: [SPARK-13977] [SQL] Brings back Shuffled hash ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11788#issuecomment-198070544 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13808][test-maven] Don't build assembly...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11701#issuecomment-197513303 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11888] [ML] Decision tree persistence i...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11581#issuecomment-197552020 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13997][SQL] Use Hadoop 2.0 default valu...

2016-03-19 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/11806#issuecomment-198364410 @tomwitte Sorry for adding more comments but does that mean the default value in Hadoop 1.x is BLOCK? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-13942][CORE][DOCS] Remove Shark-related...

2016-03-19 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11770#issuecomment-197561885 Removing Shark docs part looks OK. The slightly controversial bit is making `SparkEnv` private. People might depend on that. @rxin --- If your project is set up

[GitHub] spark pull request: [SPARK-13777] [ML] Remove constant features fr...

2016-03-19 Thread iyounus
Github user iyounus commented on the pull request: https://github.com/apache/spark/pull/11610#issuecomment-197468720 One problem with the eigen decomposition method is that for rank deficient matrix some of the eigenvalues can be extremely small (instead of being zero) and their

[GitHub] spark pull request: [SPARK-13826][SQL] Revises Dataset ScalaDoc

2016-03-19 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/11769#issuecomment-197512611 cc @rxin @marmbrus @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-14011][CORE][SQL] Enable `LineLength` J...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11831#issuecomment-198549526 **[Test build #53566 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53566/consoleFull)** for PR 11831 at commit

[GitHub] spark pull request: [SPARK-13816][Graphx] Add parameter checks for...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11655#issuecomment-197485725 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12789]Support order by index and group ...

2016-03-19 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10731#issuecomment-197698035 Also I'd say "by position", not "by index", since index usually refers to something else in databases. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [SPARK-13903][SQL] Modify output nullability w...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11722#issuecomment-197278897 **[Test build #53297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53297/consoleFull)** for PR 11722 at commit

[GitHub] spark pull request: [SPARK-13629] [ML] Add binary toggle Param to ...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11536#issuecomment-197782539 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13928] Move org.apache.spark.Logging in...

2016-03-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11764#issuecomment-197639904 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13430][PySpark][ML] Python API for trai...

2016-03-19 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11621#issuecomment-198026652 **[Test build #53449 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/53449/consoleFull)** for PR 11621 at commit

[GitHub] spark pull request: [SPARK-13294] [PROJECT INFRA] Remove MiMa's de...

2016-03-19 Thread nchammas
Github user nchammas commented on the pull request: https://github.com/apache/spark/pull/11178#issuecomment-197623653 For some reason, this PR breaks the following invocation: ``` ./dev/make-distribution.sh -T 1C -Phadoop-2.6 ``` The problem appears to be with

  1   2   3   4   5   6   7   8   9   10   >