[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155209805 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread brkyvz
Github user brkyvz commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155209271 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-2629][STREAMING] Basic implementation o...

2015-11-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9256#discussion_r44337618 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/State.scala --- @@ -0,0 +1,199 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9555#discussion_r44337520 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -24,12 +26,34 @@ import scala.util.Try import org.apache.spark.annotation.E

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155208875 **[Test build #45420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45420/consoleFull)** for PR 9287 at commit [`8b8121c`](https://gith

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-155208819 @jbonofre actually I do mind the whitespace changes. Elsewhere we try to use 2 space indentations in JavaScript instead of tabs. This PR currently makes the style inc

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155208584 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155208608 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155208527 **[Test build #45418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45418/consoleFull)** for PR 9539 at commit [`8a24935`](https://gith

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread jacek-lewandowski
Github user jacek-lewandowski commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155208288 jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9165#discussion_r44336961 --- Diff: core/src/main/scala/org/apache/spark/ui/jobs/ExecutorTable.scala --- @@ -89,6 +89,15 @@ private[ui] class ExecutorTable(stageId: Int, stageAttem

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155207810 **[Test build #45419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45419/consoleFull)** for PR 9519 at commit [`dcb2670`](https://gith

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9165#discussion_r44336821 --- Diff: core/src/main/resources/org/apache/spark/ui/static/sorttable.js --- @@ -134,35 +134,35 @@ sorttable = { this.className += ' sortta

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/9165#discussion_r44336716 --- Diff: core/src/main/resources/org/apache/spark/ui/static/sorttable.js --- @@ -81,18 +81,18 @@ sorttable = { if (!headrow[i].className.match(

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155204954 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155207197 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155207220 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155207190 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155207179 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155204978 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155205043 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9143#issuecomment-155204883 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8992] [SQL] Add pivot to dataframe api

2015-11-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/7841#issuecomment-155204885 @aray I talked to a few more people about this. Most like the 2nd API more (groupBy.pivot.agg). I think it'd also be better to remove the requirement to specify val

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155204647 **[Test build #45416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45416/consoleFull)** for PR 8639 at commit [`785e4ae`](https://gith

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155204419 LGTM merging into master and 1.6. Thanks for your work and patience! --- If your project is set up for it, you can reply to this email and have your reply appear on G

[GitHub] spark pull request: [SPARK-11401] [MLLIB] PMML export for Logistic...

2015-11-09 Thread selvinsource
Github user selvinsource commented on the pull request: https://github.com/apache/spark/pull/9397#issuecomment-155203822 @dbtsai I don't think the issue with failed Spark test is to do with my code. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155203660 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155203789 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155203661 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155203573 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155203520 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155203572 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155203528 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9420#discussion_r44334549 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingListener.scala --- @@ -0,0 +1,189 @@ +/* + * Licensed to the Apac

[GitHub] spark pull request: [SPARK-10471] [CORE] [MESOS] prevent getting o...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/8639#issuecomment-155202360 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155202070 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6157][CORE] Unrolling with MEMORY_AND_D...

2015-11-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/4887#issuecomment-155201997 @suyanNone have you had a chance to update this? If not shall we close this for now? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155201831 **[Test build #45402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45402/consoleFull)** for PR 9530 at commit [`87b7a91`](https://git

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155199627 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155199587 **[Test build #45411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45411/consoleFull)** for PR 9287 at commit [`8b8121c`](https://git

[GitHub] spark pull request: [SPARK-11462][Streaming]Add JavaStreamingListe...

2015-11-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9420#discussion_r44333044 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingListener.scala --- @@ -0,0 +1,189 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155197372 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155197363 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11140] [core] Transfer files using netw...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9530#issuecomment-155197443 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155197445 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155197444 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155197380 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-10280][MLlib][PySpark][Docs] Add @since...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/8690#issuecomment-155197160 Merged into master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11552][DOCS][Replaced example code in m...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9539#issuecomment-155196228 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-11548][DOCS] Replaced example code in m...

2015-11-09 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/9519#issuecomment-155196371 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44332592 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155195850 **[Test build #45393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45393/consoleFull)** for PR 9428 at commit [`647162f`](https://git

[GitHub] spark pull request: [SPARK-8582][Core]Optimize checkpointing to av...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9428#issuecomment-155196218 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155195194 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11198][STREAMING][KINESIS] Support de-a...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9403#issuecomment-155194861 **[Test build #45391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45391/consoleFull)** for PR 9403 at commit [`2ef1717`](https://git

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44332122 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155193723 **[Test build #45411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45411/consoleFull)** for PR 9287 at commit [`8b8121c`](https://gith

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155193346 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-11326: Split networking in standalone mo...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9287#issuecomment-155193304 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44331528 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,731 @@ +/* + * Licensed to the Apache Software Foundation (ASF

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-155192637 **[Test build #45410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45410/consoleFull)** for PR 9229 at commit [`129c9aa`](https://gith

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9555#discussion_r44331060 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/functions.scala --- @@ -24,12 +26,34 @@ import scala.util.Try import org.apache.spark.annotation.Exper

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-155192118 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155192069 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11262][ML] Unit test for gradient, loss...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9229#issuecomment-155192079 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-8029][core] shuffleoutput per attempt

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/6648#issuecomment-155191969 **[Test build #45389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45389/consoleFull)** for PR 6648 at commit [`fbd129b`](https://git

[GitHub] spark pull request: [SPARK-9926] [SPARK-10340] [SQL] Use S3 bulk l...

2015-11-09 Thread piaozhexiu
Github user piaozhexiu commented on a diff in the pull request: https://github.com/apache/spark/pull/8512#discussion_r44330648 --- Diff: core/pom.xml --- @@ -40,6 +40,11 @@ ${avro.mapred.classifier} + com.amazonaws + aws-java-sdk

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9421#discussion_r44330530 --- Diff: extras/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisCheckpointerSuite.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9421#issuecomment-155191287 LGTM except a suggestion for the flaky test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proj

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-155190941 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-155190761 **[Test build #45406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45406/consoleFull)** for PR 5267 at commit [`29ccdf9`](https://git

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155188203 **[Test build #45409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45409/consoleFull)** for PR 9555 at commit [`0a0a199`](https://git

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155188209 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11564][SQL][follow-up] clean up java tu...

2015-11-09 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9567#discussion_r44328940 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/Encoder.scala --- @@ -50,92 +50,10 @@ object Encoder { def DOUBLE: Encod

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155187488 **[Test build #45409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45409/consoleFull)** for PR 9555 at commit [`0a0a199`](https://gith

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44328340 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,731 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155186853 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9555#issuecomment-155186821 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-155186811 **[Test build #45408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45408/consoleFull)** for PR 9165 at commit [`94a36b9`](https://gith

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-155185761 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: SPARK-6541 - Sort executors by ID (numeric)

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9165#issuecomment-155185724 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on the pull request: https://github.com/apache/spark/pull/9513#issuecomment-155185664 Second pass. Most significant comments are about completely removing `Vector` from the public API and debating `DistributedLDAModel < LDAModel` vs `abstract class L

[GitHub] spark pull request: [SPARK-10371] [SQL] Implement subexpr eliminat...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9480#issuecomment-155185293 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10371] [SQL] Implement subexpr eliminat...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9480#issuecomment-155185089 **[Test build #45384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45384/consoleFull)** for PR 9480 at commit [`5dbc047`](https://git

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9556#discussion_r44327164 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -146,148 +146,105 @@ private[sql] abstract class SparkStrategies e

[GitHub] spark pull request: [SPARK-10838][SPARK-11576][SQL][WIP] Incorrect...

2015-11-09 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/9548#issuecomment-155183305 I can't fix the problem without a major code change. The current design of dataFrame has a fundamental problem. When using column references, we might hit various str

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155182875 **[Test build #45407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45407/consoleFull)** for PR 9556 at commit [`bad4184`](https://gith

[GitHub] spark pull request: [SPARK-11578] [SQL] User API for Typed Aggrega...

2015-11-09 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9555#discussion_r44326231 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/Aggregator.scala --- @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] spark pull request: [SPARK-11463] [PYSPARK] only install signal in...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9574#issuecomment-155182383 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11463] [PYSPARK] only install signal in...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9574#issuecomment-155182146 **[Test build #45405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45405/consoleFull)** for PR 9574 at commit [`1885ecb`](https://git

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155179711 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155180027 I think one follow-up work is to add tests in `ExpressionTypeCheckingSuite` to make sure those newly added agg functions (e.g. corr and variance) throw the right exception

[GitHub] spark pull request: [SPARK-9830] [SQL] Remove AggregateExpression1...

2015-11-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9556#issuecomment-155179635 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-11141][STREAMING] Batch ReceivedBlockTr...

2015-11-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/9143#discussion_r44324712 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceiverTracker.scala --- @@ -488,7 +493,24 @@ class ReceiverTracker(ssc: StreamingConte

[GitHub] spark pull request: [SPARK-11359][STREAMING][KINESIS] Checkpoint t...

2015-11-09 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9421#discussion_r44324452 --- Diff: extras/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisCheckpointerSuite.scala --- @@ -0,0 +1,156 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44324500 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-5565] [ML] LDA wrapper for Pipelines AP...

2015-11-09 Thread feynmanliang
Github user feynmanliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9513#discussion_r44324308 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/LDA.scala --- @@ -0,0 +1,740 @@ +/* + * Licensed to the Apache Software Foundation (

[GitHub] spark pull request: [SPARK-6517][mllib] Implement the Algorithm of...

2015-11-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/5267#issuecomment-155177514 **[Test build #45406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45406/consoleFull)** for PR 5267 at commit [`29ccdf9`](https://gith

<    4   5   6   7   8   9   10   11   12   13   >