[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155225000 PySpark results are correct, just not in the correct form :(... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155224746 LGTM, pending a successful test build. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-11420 Updating Stddev support via Impera...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9380#issuecomment-155224857 Which part is boxing the result? I tested the following on master with changes from #9480: ~~~scala val df = sqlContext.range(1) df.select(var_sam

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9420#discussion_r44345630 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingListenerWrapper.scala --- @@ -0,0 +1,122 @@ +/* + * Licensed to t

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-155224361 **[Test build #45432 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45432/consoleFull)** for PR 7841 at commit [`1af796d`](https://gith

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155224308 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155224281 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155224100 **[Test build #45431 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45431/consoleFull)** for PR 9428 at commit [`676317b`](https://gith

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-155223812 **[Test build #45410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45410/consoleFull)** for PR 9229 at commit [`129c9aa`](https://git

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-155223930 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155223396 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155223300 **[Test build #45407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45407/consoleFull)** for PR 9556 at commit [`bad4184`](https://git

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155223319 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-155223213 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9420#discussion_r44344771 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingListenerWrapper.scala --- @@ -0,0 +1,122 @@ +/* + * Licensed to the

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-11-09 Thread aray
Github user aray commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-155223109 @rxin Updated, the values are now optional. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-155223235 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155223034 > Have you had a chance to test this on a real cluster? Yes. Tested this PR with Streaming `updateStateByKey`. --- If your project is set up for it, you can rep

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9428#discussion_r44344621 --- Diff: core/src/main/scala/org/apache/spark/util/CheckpointingIterator.scala --- @@ -0,0 +1,225 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44344541 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -146,148 +146,105 @@ private[sql] abstract class SparkStrategies e

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9576#discussion_r44344420 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -1235,6 +1232,26 @@ class HiveQuerySuite extends HiveCompari

[GitHub] spark pull request: [SPARK-10181][SQL] Do kerberos login for crede...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9272#discussion_r44344327 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala --- @@ -150,6 +152,21 @@ private[hive] class ClientWrapper( val

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9428#discussion_r44344237 --- Diff: core/src/main/scala/org/apache/spark/util/CheckpointingIterator.scala --- @@ -0,0 +1,225 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155222108 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155222125 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9421 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-155221407 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-155221237 **[Test build #45408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45408/consoleFull)** for PR 9165 at commit [`94a36b9`](https://git

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155221200 Perfect. Merging this to master and branch 1.6. Thanks @brkyvz for all the effort, and @zsxwing for reviewing. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155221046 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155220893 **[Test build #45421 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45421/consoleFull)** for PR 9421 at commit [`63d2e52`](https://git

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44343490 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -146,148 +146,105 @@ private[sql] abstract class SparkStrateg

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155220740 **[Test build #45429 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45429/consoleFull)** for PR 9555 at commit [`c88e6c0`](https://gith

[GitHub] spark pull request: [SPARK-11595] [SQL] Fixes ADD JAR when the inp...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9569 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155219986 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set and collect...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9526 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155219970 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11595] [SQL] Fixes ADD JAR when the inp...

2015-11-09 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9569#issuecomment-155220026 LGTM, merging this into master and 1.6 branch. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9576#discussion_r44342951 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala --- @@ -1235,6 +1232,26 @@ class HiveQuerySuite extends HiveComparis

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9576#discussion_r44342939 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala --- @@ -455,7 +455,15 @@ class HiveContext private[hive]( // Note that Hive

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set and collect...

2015-11-09 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9526#issuecomment-155219611 Hey, i just noticed this wasn't opened against master. In the future please always go against master unless creating a specific backport. We will cherry-pick when com

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set and collect...

2015-11-09 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9526#issuecomment-155219299 Thanks, merging to master and 1.6 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does n

[GitHub] spark pull request: [SPARK-10181][SQL] Do kerberos login for crede...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9272#issuecomment-155219421 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9519 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155219305 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-10181][SQL] Do kerberos login for crede...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9272#issuecomment-155219229 **[Test build #45392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45392/consoleFull)** for PR 9272 at commit [`7d09f5d`](https://git

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44342591 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-11595] [SQL] [BRANCH-1.5] Fixes ADD JAR...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9570#issuecomment-155219118 [Test build #2022 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2022/consoleFull) for PR 9570 at commit [`8d06b98`](https://git

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155219106 Merged into master and branch-1.6. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155218844 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155218811 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9539 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155218551 Merged into master and branch-1.6. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9576#issuecomment-155218052 **[Test build #45427 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45427/consoleFull)** for PR 9576 at commit [`db74784`](https://gith

[GitHub] spark pull request: [SPARK-7841] Stop using retrieveManaged to ret...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155217938 **[Test build #45428 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45428/consoleFull)** for PR 9575 at commit [`828c3b4`](https://gith

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9576#issuecomment-155217669 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-7841] Stop using retrieveManaged to ret...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155217730 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9576#issuecomment-155217704 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-7841] Stop using retrieveManaged to ret...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155217679 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11599] [SQL] fix NPE when resolve Hive ...

2015-11-09 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/9576 [SPARK-11599] [SQL] fix NPE when resolve Hive UDF in SQLParser The DataFrame APIs that takes a SQL expression always use SQLParser, then the HiveFunctionRegistry will called outside of Hive state, ca

[GitHub] spark pull request: [SPARK-11598] [SQL] enable tests for ShuffledH...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9573#issuecomment-155217428 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44341643 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-10838][SPARK-11576][SQL][WIP] Incorrect...

2015-11-09 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/9548#issuecomment-155217297 That particular example does not really seem like a problem to me. Its the same column logically that you are dropping. What if we make the change in the Colum

[GitHub] spark pull request: [SPARK-11598] [SQL] enable tests for ShuffledH...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9573#issuecomment-155217140 **[Test build #45403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45403/consoleFull)** for PR 9573 at commit [`6ee5130`](https://git

[GitHub] spark pull request: [SPARK-7841] Stop using retrieveManaged to ret...

2015-11-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/9575#issuecomment-155216947 By the way, this change stands a good chance of significantly speeding up our Jenkins builds since they'll no longer waste time re-downloading JARs (it may also reduce

[GitHub] spark pull request: [SPARK-11564][SQL] Fix documentation for DataF...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9557#issuecomment-155216753 **[Test build #2021 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2021/consoleFull)** for PR 9557 at commit [`8d10a25`](https://git

[GitHub] spark pull request: [SPARK-7841] Stop using retrieveManaged to ret...

2015-11-09 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/9575 [SPARK-7841] Stop using retrieveManaged to retrieve dependencies in SBT This patch modifies Spark's SBT build so that it no longer uses `retrieveManaged` / `lib_managed` to store its dependencies.

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44341246 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9420#issuecomment-155216274 **[Test build #45426 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45426/consoleFull)** for PR 9420 at commit [`c21e786`](https://gith

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9555#discussion_r44340946 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/SumOf.scala --- @@ -0,0 +1,19 @@ +/* + * Licensed to the Apache Software Found

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set and collect...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9526#issuecomment-155215327 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9301] [SQL] Add collect_set and collect...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9526#issuecomment-155215134 **[Test build #45404 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45404/consoleFull)** for PR 9526 at commit [`07de8a2`](https://git

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155215081 **[Test build #45425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45425/consoleFull)** for PR 9555 at commit [`0a5a161`](https://gith

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155214932 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155214638 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155214748 **[Test build #45418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45418/consoleFull)** for PR 9539 at commit [`8a24935`](https://git

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155214480 **[Test build #45419 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45419/consoleFull)** for PR 9519 at commit [`dcb2670`](https://git

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155214393 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155214348 **[Test build #45420 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45420/consoleFull)** for PR 9287 at commit [`8b8121c`](https://git

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155214248 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155214267 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9420#issuecomment-155214254 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155214151 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9420#issuecomment-155214284 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155213853 **[Test build #45423 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45423/consoleFull)** for PR 9143 at commit [`7ec55c5`](https://gith

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155213421 **[Test build #45424 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45424/consoleFull)** for PR 9555 at commit [`f559f5a`](https://gith

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155212954 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155212888 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155212619 **[Test build #45421 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45421/consoleFull)** for PR 9421 at commit [`63d2e52`](https://gith

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155209804 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155209961 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155209780 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155211487 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155211465 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155211130 **[Test build #45422 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45422/consoleFull)** for PR 9403 at commit [`932485a`](https://gith

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-11-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-155211191 BTW we can also later add a variant that allows users to specify values directly, in order to avoid materializing the intermediate data. --- If your project is set up for

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread brkyvz
Github user brkyvz commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155211188 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44338358 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/StateSpec.scala --- @@ -0,0 +1,196 @@ +/* + * Licensed to the Apache Software Foundation (A

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155208722 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155209777 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

<    3   4   5   6   7   8   9   10   11   12   >