[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-146094148 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-146094144 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-146093947 [Test build #43322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43322/console) for PR 8920 at commit [`1f59bc2`](https://github.

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-146090399 [Test build #43322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43322/consoleFull) for PR 8920 at commit [`1f59bc2`](https://gith

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-146089823 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10836] [SparkR] Added sort(x, decreasin...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8920#issuecomment-146089844 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146089056 [Test build #43321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43321/consoleFull) for PR 9006 at commit [`681858f`](https://gith

[GitHub] spark pull request: [SPARK-10841][SQL] Add pushdown support of UDF...

2015-10-06 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8922#issuecomment-146088680 @marmbrus Thanks for clarifying that. I have scanned quickly the predicates in expressions. Actually, seems that I can't find any predicate that only takes a sing

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146088268 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146088289 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9006#discussion_r41354681 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -112,21 +115,21 @@ class CodeGenContext {

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8971#discussion_r41353513 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala --- @@ -365,32 +374,33 @@ private[sql] case class FIXED_DECIMAL(precision:

[GitHub] spark pull request: [SPARK-10668][ML] Use WeightedLeastSquares in ...

2015-10-06 Thread Lewuathe
Github user Lewuathe commented on the pull request: https://github.com/apache/spark/pull/8884#issuecomment-146080738 @dbtsai Thank you so much for caching up. Currently this patch fixed the latest issues based on your pointing out. Test failures does not seem to be related to this pat

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146080647 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146080646 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146080586 [Test build #43314 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43314/console) for PR 8931 at commit [`0d881ab`](https://github.

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146080183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146080181 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146080129 [Test build #43320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43320/console) for PR 8869 at commit [`e73c8f3`](https://github.

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8971#discussion_r41352948 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala --- @@ -399,24 +409,158 @@ private[sql] object BINARY extends ByteArrayCol

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146079626 [Test build #43319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43319/console) for PR 9006 at commit [`de4a247`](https://github.

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146079647 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146079646 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8971#discussion_r41352348 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnStats.scala --- @@ -254,7 +255,7 @@ private[sql] class FixedDecimalColumnStats(precisi

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8971#discussion_r41352081 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala --- @@ -399,24 +409,158 @@ private[sql] object BINARY extends ByteArrayCol

[GitHub] spark pull request: [SPARK-10917] [SQL] improve performance of com...

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8971#discussion_r41352041 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/columnar/ColumnType.scala --- @@ -399,24 +409,158 @@ private[sql] object BINARY extends ByteArrayCol

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146078664 [Test build #43320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43320/consoleFull) for PR 8869 at commit [`e73c8f3`](https://gith

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146078196 [Test build #43319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43319/consoleFull) for PR 9006 at commit [`de4a247`](https://gith

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146078080 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146078070 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146077642 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146077653 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8654][SQL] Fix Analysis exception when ...

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/8983#issuecomment-146077599 if `null in (true, array(2,3))` returns null in hive, then we probably should first cast `key` and all values in `list` to a common type. If there is no such a common

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146077592 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-10779][PYSPARK][MLLIB] Set initialModel...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8967#issuecomment-146077350 [Test build #1849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1849/console) for PR 8967 at commit [`fdde001`](https://github

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9006#discussion_r41351532 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -384,11 +387,23 @@ abstract class CodeGe

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9006#discussion_r41351350 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -112,21 +115,21 @@ class CodeGenContext

[GitHub] spark pull request: [SPARK-9478] [ml] Add class weights to Random ...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9008#issuecomment-146073764 [Test build #43318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43318/consoleFull) for PR 9008 at commit [`367a443`](https://gith

[GitHub] spark pull request: [SPARK-10779][PYSPARK][MLLIB] Set initialModel...

2015-10-06 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/8967#discussion_r41349993 --- Diff: python/pyspark/mllib/clustering.py --- @@ -90,6 +90,14 @@ class KMeansModel(Saveable, Loader): ... rmtree(path) ... except OS

[GitHub] spark pull request: [SPARK-10779][PYSPARK][MLLIB] Set initialModel...

2015-10-06 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/8967#discussion_r41349992 --- Diff: python/pyspark/mllib/clustering.py --- @@ -90,6 +90,14 @@ class KMeansModel(Saveable, Loader): ... rmtree(path) ... except OS

[GitHub] spark pull request: [SPARK-10779][PYSPARK][MLLIB] Set initialModel...

2015-10-06 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/8967#discussion_r41349995 --- Diff: python/pyspark/mllib/clustering.py --- @@ -144,10 +152,16 @@ class KMeans(object): @classmethod def train(cls, rdd, k, maxI

[GitHub] spark pull request: [SPARK-10779][PYSPARK][MLLIB] Set initialModel...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8967#issuecomment-146073431 [Test build #1849 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1849/consoleFull) for PR 8967 at commit [`fdde001`](https://git

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-146073349 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-146073351 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10064] [ML] Parallelize decision tree b...

2015-10-06 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/8246#issuecomment-146073328 OK thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-146073306 [Test build #43315 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43315/console) for PR 9007 at commit [`2aa200b`](https://github.

[GitHub] spark pull request: [SPARK-9478] [ml] Add class weights to Random ...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9008#issuecomment-146073233 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-9478] [ml] Add class weights to Random ...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9008#issuecomment-146073241 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146072984 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146072985 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146072983 [Test build #43317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43317/console) for PR 8934 at commit [`f7bdde3`](https://github.

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146072943 [Test build #43317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43317/consoleFull) for PR 8934 at commit [`f7bdde3`](https://gith

[GitHub] spark pull request: [SPARK-9478] [ml] Add class weights to Random ...

2015-10-06 Thread rotationsymmetry
GitHub user rotationsymmetry opened a pull request: https://github.com/apache/spark/pull/9008 [SPARK-9478] [ml] Add class weights to Random Forest This PR adds weight support to DecisionTreeClassifier DecisionTreeRegressor RandomForestClassifier RandomForestRegr

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146072671 [Test build #43316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43316/console) for PR 8869 at commit [`b05c443`](https://github.

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146072680 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146072678 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146072487 [Test build #43316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43316/consoleFull) for PR 8869 at commit [`b05c443`](https://gith

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146072238 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146072217 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/8934#issuecomment-146071744 @davies Yes. Currently as reported in the JIRA, using `x.asDict()["count"]` instead of `x.count` can be to work around this. But I think it would be better to avoid this.

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146071562 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8869#issuecomment-146071597 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-146070719 [Test build #43315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43315/consoleFull) for PR 9007 at commit [`2aa200b`](https://gith

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-146070202 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9007#issuecomment-146070196 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10963] [Streaming] [Kafka] make KafkaCl...

2015-10-06 Thread koeninger
GitHub user koeninger opened a pull request: https://github.com/apache/spark/pull/9007 [SPARK-10963] [Streaming] [Kafka] make KafkaCluster public You can merge this pull request into a Git repository by running: $ git pull https://github.com/koeninger/spark-1 SPARK-10963 Alte

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/8869#discussion_r41348531 --- Diff: R/pkg/R/stats.R --- @@ -0,0 +1,102 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/8869#discussion_r41348491 --- Diff: R/pkg/R/stats.R --- @@ -0,0 +1,102 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] spark pull request: [SPARK-10752][SPARKR] Implement corr() and cov...

2015-10-06 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/8869#discussion_r41348453 --- Diff: R/pkg/R/stats.R --- @@ -0,0 +1,102 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8973#discussion_r41348182 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -95,98 +92,192 @@ private[sql] case class

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146067798 [Test build #1848 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1848/console) for PR 9006 at commit [`de4a247`](https://github

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146067832 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10941] [SQL] Refactor AggregateFunction...

2015-10-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8973#discussion_r41348104 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala --- @@ -95,98 +92,192 @@ private[sql] case class

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146067831 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10337][SQL] fix hive views on non-hive-...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8990#issuecomment-146067781 [Test build #43310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43310/console) for PR 8990 at commit [`c388717`](https://github.

[GitHub] spark pull request: [SPARK-10964] [yarn] Correctly register the AM...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9005#issuecomment-146066362 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10964] [yarn] Correctly register the AM...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9005#issuecomment-146066217 [Test build #43307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43307/console) for PR 9005 at commit [`515e318`](https://github.

[GitHub] spark pull request: [SPARK-10964] [yarn] Correctly register the AM...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9005#issuecomment-146066357 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146064446 [Test build #1848 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1848/consoleFull) for PR 9006 at commit [`de4a247`](https://git

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146064389 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8934#discussion_r41347200 --- Diff: python/pyspark/sql/types.py --- @@ -1189,6 +1189,16 @@ class Row(tuple): >>> Person("Alice", 11) Row(name='Alice', age=11)

[GitHub] spark pull request: [SPARK-10852][PySpark][SQL] Override built-in ...

2015-10-06 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8934#discussion_r41346674 --- Diff: python/pyspark/sql/types.py --- @@ -1209,6 +1219,12 @@ def __new__(self, *args, **kwargs): else: raise ValueError("No ar

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146062259 @zsxwing can you have a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10887] [SQL] Build HashedRelation outsi...

2015-10-06 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8953#issuecomment-146062232 As discussed offline, we should explore alternatives where we don't have to wrap local nodes to avoid the wrapping logic. Right now we need to worry about the initial

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146061603 [Test build #43314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43314/consoleFull) for PR 8931 at commit [`0d881ab`](https://gith

[GitHub] spark pull request: [SPARK-10952] Only add hive to classpath if HI...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8994#issuecomment-146061508 [Test build #43305 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43305/console) for PR 8994 at commit [`72b88b2`](https://github.

[GitHub] spark pull request: [SPARK-10952] Only add hive to classpath if HI...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8994#issuecomment-146061574 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10952] Only add hive to classpath if HI...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8994#issuecomment-146061573 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146061210 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146061211 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146061187 [Test build #43313 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43313/console) for PR 9006 at commit [`de4a247`](https://github.

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146060898 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146060882 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9006#discussion_r41345699 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala --- @@ -112,21 +115,21 @@ class CodeGenContext {

[GitHub] spark pull request: [SPARK-9065][Streaming][PySpark] Add MessageHa...

2015-10-06 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/7410#issuecomment-146060171 @jerryshao Can you update this PR with latest master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If you

[GitHub] spark pull request: [SPARK-10887] [SQL] Build HashedRelation outsi...

2015-10-06 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/8953#discussion_r41345552 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/local/HashJoinNodeSuite.scala --- @@ -19,10 +19,12 @@ package org.apache.spark.sql.execut

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146059664 [Test build #43312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43312/console) for PR 8931 at commit [`59a23f7`](https://github.

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146059674 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10412][SQL] report memory usage for tun...

2015-10-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8931#issuecomment-146059680 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43

[GitHub] spark pull request: [SPARK-10966] Codegen framework cleanup

2015-10-06 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9006#issuecomment-146059183 [Test build #43313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43313/consoleFull) for PR 9006 at commit [`de4a247`](https://gith

  1   2   3   4   5   6   >