[GitHub] spark pull request: [SPARK-7639] [PySpark] [MLlib] Python API for ...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6387#issuecomment-105782783 [Test build #33569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33569/consoleFull) for PR 6387 at commit [`324f60f`](https://gith

[GitHub] spark pull request: [SPARK-7639] [PySpark] [MLlib] Python API for ...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6387#issuecomment-105782153 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7639] [PySpark] [MLlib] Python API for ...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6387#issuecomment-105782239 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7639] [PySpark] [MLlib] Python API for ...

2015-05-26 Thread MechCoder
Github user MechCoder commented on the pull request: https://github.com/apache/spark/pull/6387#issuecomment-105781059 @mengxr done! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105779943 Merged into master and branch-1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6392 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-6590] [SQL] df.where accept a string co...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6429#issuecomment-105779820 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6590] [SQL] df.where accept a string co...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6429#issuecomment-105779808 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL][SPARK-6785] fix DateUtils.fromJavaDate(j...

2015-05-26 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/6242#issuecomment-105779801 Right now Spark is on Hive 0.12 / 0.13 although it will become more possible to use later Hive in the next version. So, that means our Hive comparison tests are going to

[GitHub] spark pull request: [SPARK-7863][Core] Create SimpleDateFormat for...

2015-05-26 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/6406#issuecomment-105779637 This LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-6590] [SQL] df.where accept a string co...

2015-05-26 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/6429 [SPARK-6590] [SQL] df.where accept a string conditionExpr cc @yhuai You can merge this pull request into a Git repository by running: $ git pull https://github.com/adrian-wang/spark spark6

[GitHub] spark pull request: [WIP][SPARK-7562][SPARK-6444][SQL] Improve err...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6405#discussion_r31107211 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -124,12 +124,45 @@ case class GroupExpression(children:

[GitHub] spark pull request: [WIP][SPARK-7562][SPARK-6444][SQL] Improve err...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6405#discussion_r31107192 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -124,12 +124,45 @@ case class GroupExpression(children:

[GitHub] spark pull request: [WIP][SPARK-7562][SPARK-6444][SQL] Improve err...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6405#discussion_r31107111 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -124,12 +124,45 @@ case class GroupExpression(children:

[GitHub] spark pull request: [WIP][SPARK-7562][SPARK-6444][SQL] Improve err...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6405#discussion_r31107091 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Expression.scala --- @@ -124,12 +124,45 @@ case class GroupExpression(children:

[GitHub] spark pull request: [SQL] Rename MathematicalExpression UnaryMathE...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6428#issuecomment-105777609 [Test build #33567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33567/consoleFull) for PR 6428 at commit [`5910df5`](https://gith

[GitHub] spark pull request: [SQL] Rename MathematicalExpression UnaryMathE...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6428#issuecomment-105776882 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SQL] Rename MathematicalExpression UnaryMathE...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6428#issuecomment-105776876 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SQL] Rename MathematicalExpression UnaryMathE...

2015-05-26 Thread brkyvz
Github user brkyvz commented on the pull request: https://github.com/apache/spark/pull/6428#issuecomment-105776626 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SQL] Rename MathematicalExpression UnaryMathE...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6428#discussion_r31106806 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathfuncs/unary.scala --- @@ -25,7 +25,7 @@ import org.apache.spark.sql.types._

[GitHub] spark pull request: [SQL] Rename MathematicalExpression UnaryMathE...

2015-05-26 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/6428 [SQL] Rename MathematicalExpression UnaryMathExpression, and specify BinaryMathExpression's output data type as DoubleType. Two minor changes. cc @brkyvz You can merge this pull request into

[GitHub] spark pull request: [Spark-7780][MLLIB] Intercept in logisticregre...

2015-05-26 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/6386#issuecomment-105774535 Waiting https://github.com/databricks/spark-perf/pull/72 to see if there is performance regression. --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [WIP][SPARK-7562][SPARK-6444][SQL] Improve err...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6405#discussion_r31106159 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -69,23 +63,28 @@ case class Sqrt(child: Expression) exte

[GitHub] spark pull request: [WIP][SPARK-7562][SPARK-6444][SQL] Improve err...

2015-05-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/6405#discussion_r31105785 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -62,6 +62,10 @@ trait CheckAnalysis { v

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105767832 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105767826 [Test build #33562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33562/consoleFull) for PR 6392 at commit [`5ff5af8`](https://git

[GitHub] spark pull request: [SPARK-7887][SQL] Remove EvaluatedType from SQ...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6427#issuecomment-105767830 [Test build #33566 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33566/consoleFull) for PR 6427 at commit [`51a319a`](https://gith

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105767833 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7887][SQL] Remove EvaluatedType from SQ...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6427#issuecomment-105767760 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7887][SQL] Remove EvaluatedType from SQ...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6427#issuecomment-105767775 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7887][SQL] Remove EvaluatedType from SQ...

2015-05-26 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/6427 [SPARK-7887][SQL] Remove EvaluatedType from SQL Expression. This type is not really used. Might as well remove it. You can merge this pull request into a Git repository by running: $ git pull http

[GitHub] spark pull request: [SPARK-7887][SQL] Remove EvaluatedType from SQ...

2015-05-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6427#issuecomment-105767091 cc @davies this might have some conflict with your stuff (although should be minimal). --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-7864] [Web UI] Clicking a job's DAG gra...

2015-05-26 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/6407#issuecomment-105763191 Sorry for my late response and thanks for reporting and address this issue @andrewor14 , @carsonwang ! Actually, Timeline Views in AllJobPage and StagePage have same

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105763141 [Test build #33565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33565/consoleFull) for PR 6425 at commit [`4d37935`](https://gith

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105762918 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105762905 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105762499 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-7691] [SQL] [WIP] Refactor CatalystType...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6222#issuecomment-105761830 [Test build #861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/861/consoleFull) for PR 6222 at commit [`82447da`](https://gith

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105759718 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105759723 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105759694 [Test build #33560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33560/consoleFull) for PR 6425 at commit [`4d37935`](https://git

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread jeanlyn
Github user jeanlyn commented on the pull request: https://github.com/apache/spark/pull/6426#issuecomment-105759184 Thanks @JoshRosen @rxin for comment.I had meet at lease two group by cases of our production environment run long GC time and finally executor crash.These case has a co

[GitHub] spark pull request: [SPARK-7826][CORE] Suppress extra calling getC...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6352#issuecomment-105759037 [Test build #33559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33559/consoleFull) for PR 6352 at commit [`10b1b22`](https://git

[GitHub] spark pull request: [SPARK-7826][CORE] Suppress extra calling getC...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6352#issuecomment-105759045 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7826][CORE] Suppress extra calling getC...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6352#issuecomment-105759046 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7858] [SQL] Use output schema, not rela...

2015-05-26 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/6400#discussion_r31103405 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/sources/hadoopFsRelationSuites.scala --- @@ -76,6 +76,12 @@ abstract class HadoopFsRelationTest exte

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105756006 [Test build #33564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33564/consoleFull) for PR 6397 at commit [`71d76ff`](https://git

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105756012 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105756013 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105755636 [Test build #33564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33564/consoleFull) for PR 6397 at commit [`71d76ff`](https://gith

[GitHub] spark pull request: [MINOR] [CORE] Warn about caching if dynamic a...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6421#issuecomment-105755248 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [MINOR] [CORE] Warn about caching if dynamic a...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6421#issuecomment-105755243 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105755095 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [MINOR] [CORE] Warn about caching if dynamic a...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6421#issuecomment-105755216 [Test build #33561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33561/consoleFull) for PR 6421 at commit [`25cbb53`](https://git

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105755110 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6426#issuecomment-105754943 @jeanlyn a better way to do this is to actually run some partial aggregation, and if we see no reduction in data size, stop the partial aggregation and just run the aggrega

[GitHub] spark pull request: [SPARK-7855] Move bypassMergeSort-handling fro...

2015-05-26 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6397#issuecomment-105754795 I've addressed the review comments. I also ported BypassMergeSortShuffleWriter to Java and revised its Javadoc comment to try to better explain how it works. --- If

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105754430 [Test build #33563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33563/consoleFull) for PR 6393 at commit [`fb429ce`](https://gith

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread piaozhexiu
Github user piaozhexiu commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105754375 @rxin thank you! I'll look into SPARK-6909 this week. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105754262 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105754255 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105754239 @piaozhexiu looks good. I will merge once tests come back positive. It'd be great if you have some cycles to help out with SPARK-6909 to inline the Hive 13 stuff. --- If

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105754181 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have t

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105753693 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105753688 **[Test build #33556 timed out](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33556/consoleFull)** for PR 6393 at commit [`fb429ce`](https://gi

[GitHub] spark pull request: [SPARK-7850][BUILD] Hive 0.12.0 profile in POM...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6393#issuecomment-105753692 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7829][CORE][WIP] multiple attempts of s...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6420#issuecomment-105753092 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7829][CORE][WIP] multiple attempts of s...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6420#issuecomment-105753043 [Test build #33558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33558/consoleFull) for PR 6420 at commit [`0a47eb1`](https://git

[GitHub] spark pull request: [SPARK-7829][CORE][WIP] multiple attempts of s...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6420#issuecomment-105753090 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105749655 [Test build #33562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33562/consoleFull) for PR 6392 at commit [`5ff5af8`](https://gith

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105749437 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105749373 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7691] [SQL] [WIP] Refactor CatalystType...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6222#issuecomment-105748793 [Test build #861 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/861/consoleFull) for PR 6222 at commit [`82447da`](https://githu

[GitHub] spark pull request: [SPARK-7535.1] [MLLIB] minor changes to the pi...

2015-05-26 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/6392#issuecomment-105748583 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-7829][CORE][WIP] multiple attempts of s...

2015-05-26 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/6420#discussion_r31102003 --- Diff: core/src/test/scala/org/apache/spark/shuffle/unsafe/UnsafeShuffleSuite.scala --- @@ -41,6 +41,20 @@ class UnsafeShuffleSuite extends ShuffleSuite wit

[GitHub] spark pull request: [SPARK-7829][CORE][WIP] multiple attempts of s...

2015-05-26 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6420#discussion_r31101756 --- Diff: core/src/test/scala/org/apache/spark/shuffle/unsafe/UnsafeShuffleSuite.scala --- @@ -41,6 +41,20 @@ class UnsafeShuffleSuite extends ShuffleSuite

[GitHub] spark pull request: [SPARK-3674] [EC2] Clear SPARK_WORKER_INSTANCE...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6424#issuecomment-105746383 [Test build #33557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33557/consoleFull) for PR 6424 at commit [`db244ae`](https://git

[GitHub] spark pull request: [SPARK-3674] [EC2] Clear SPARK_WORKER_INSTANCE...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6424#issuecomment-105746392 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-3674] [EC2] Clear SPARK_WORKER_INSTANCE...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6424#issuecomment-105746393 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7862][SQL]Fix the deadlock in script tr...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6404#issuecomment-105746099 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33

[GitHub] spark pull request: [SPARK-7862][SQL]Fix the deadlock in script tr...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6404#issuecomment-105746085 [Test build #33554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33554/consoleFull) for PR 6404 at commit [`d9677e1`](https://git

[GitHub] spark pull request: [SPARK-7862][SQL]Fix the deadlock in script tr...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6404#issuecomment-105746098 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-7868] [SQL] Ignores _temporary director...

2015-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6411 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7868] [SQL] Ignores _temporary director...

2015-05-26 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/6411#issuecomment-105745899 LGTM. I am merging it to master and branch 1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/6426#discussion_r31101302 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -119,6 +119,15 @@ private[sql] abstract class SparkStrategies

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6426#issuecomment-105744401 One note on naming: I worry that "partial aggregation" will be confused with [partial pre-aggregation](http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=994787&url

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/6426#issuecomment-105743984 I guess that the GC benefits here are coming from the fact that the map-side aggregation must, in the worst case, allocate a map entry for every possible key, whereas

[GitHub] spark pull request: [SPARK-7308] prevent concurrent attempts for o...

2015-05-26 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/5964#discussion_r31100869 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1103,9 +1103,14 @@ class DAGScheduler( // multiple tasks runni

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6426#issuecomment-105743411 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-7885][SQL]add config to control map agg...

2015-05-26 Thread jeanlyn
GitHub user jeanlyn opened a pull request: https://github.com/apache/spark/pull/6426 [SPARK-7885][SQL]add config to control map aggregation in spark sql [SPARK-7885](https://issues.apache.org/jira/browse/SPARK-7885),we add `spark.sql.partialAggregation.enable`,it's true by default,w

[GitHub] spark pull request: [SPARK-7858] [SQL] Use output schema, not rela...

2015-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6400 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-7449][SQL]: RDD Schema mismatch fix

2015-05-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/5986 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread squito
Github user squito commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105742746 lgtm, just waiting on tests. (note this is a followup from https://github.com/apache/spark/pull/6377 for another "CST") --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-7858] [SQL] Use output schema, not rela...

2015-05-26 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/6400#issuecomment-105742714 LGTM. I am merging it to master and branch 1.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [MINOR] [CORE] Warn about caching if dynamic a...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6421#issuecomment-105742646 [Test build #33561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33561/consoleFull) for PR 6421 at commit [`25cbb53`](https://gith

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105742629 [Test build #33560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/33560/consoleFull) for PR 6425 at commit [`4d37935`](https://gith

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105742575 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [MINOR] [CORE] Warn about caching if dynamic a...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6421#issuecomment-105742562 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [CORE] [TEST] HistoryServerSuite failed due to...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6425#issuecomment-105742558 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [MINOR] [CORE] Warn about caching if dynamic a...

2015-05-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6421#issuecomment-105742574 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

  1   2   3   4   5   6   7   >