[GitHub] spark pull request: [SPARK-11701][SPARK-13054] dynamic allocation ...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10951#issuecomment-182980180 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-182980532 **[Test build #51117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51117/consoleFull)** for PR 8 at commit

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-182980915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-182980939 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-182981619 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-182981415 **[Test build #51107 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51107/consoleFull)** for PR 9893 at commit

[GitHub] spark pull request: [SPARK-10521][SQL] Utilize Docker for test DB2...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9893#issuecomment-182981622 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12832][MESOS] mesos scheduler respect a...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10949#issuecomment-182981995 **[Test build #51113 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51113/consoleFull)** for PR 10949 at commit

[GitHub] spark pull request: [SPARK-12832][MESOS] mesos scheduler respect a...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10949#issuecomment-182982311 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12832][MESOS] mesos scheduler respect a...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10949#issuecomment-182982308 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [STREAMING][TEST] Fix flaky streaming.FailureS...

2016-02-11 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11166#issuecomment-182982724 LGTM. Merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [STREAMING][TEST] Fix flaky streaming.FailureS...

2016-02-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11166 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-182985985 **[Test build #51108 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51108/consoleFull)** for PR 11157 at commit

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-182986275 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13145] [SQL] checkAnswer in SQL query s...

2016-02-11 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/11086#issuecomment-182986048 There is already `checkAggregatesWithTol` defined in that class, is that sufficient? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-182986270 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13260][SQL] count(*) does not work with...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11169#issuecomment-182793278 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13260][SQL] count(*) does not work with...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11169#issuecomment-182792816 **[Test build #51091 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51091/consoleFull)** for PR 11169 at commit

[GitHub] spark pull request: [SPARK-13260][SQL] count(*) does not work with...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11169#issuecomment-182793280 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13148] [YARN] zero-keytab Oozie applica...

2016-02-11 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/11033#issuecomment-182809024 This is to handle the launch situation * secure cluster * Oozie acquires tokens, sets to env var {{HADOOP_TOKEN_FILE_LOCATION}} * launches client.

[GitHub] spark pull request: [SPARK-13282][SQL] LogicalPlan toSql should ju...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11171#issuecomment-182820588 **[Test build #51093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51093/consoleFull)** for PR 11171 at commit

[GitHub] spark pull request: [SPARK-13011] K-means wrapper in SparkR

2016-02-11 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/11124#discussion_r52635341 --- Diff: R/pkg/inst/tests/testthat/test_mllib.R --- @@ -113,3 +113,18 @@ test_that("summary works on base GLM models", { baseSummary <-

[GitHub] spark pull request: [SPARK-13011] K-means wrapper in SparkR

2016-02-11 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/11124#discussion_r52635130 --- Diff: R/pkg/R/mllib.R --- @@ -126,3 +126,27 @@ setMethod("summary", signature(object = "PipelineModel"), return(list(coefficients =

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-11 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/11051#issuecomment-182966961 jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-11 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/11051#issuecomment-182967337 im not totally sure... jenkins is picking up other PRB builds. i'll poke around the (horrific) jenkins logs and see if i can't find out. --- If your project is

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-11 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/11051#issuecomment-182968845 it's building now: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51120/ --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-12594] [SQL] Outer Join Elimination by ...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10567#issuecomment-182970289 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12594] [SQL] Outer Join Elimination by ...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10567#issuecomment-182970279 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on the pull request: https://github.com/apache/spark/pull/11051#issuecomment-182965414 @shaneknapp any idea why Jenkins is not picking this up? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-13154][PYTHON] Add linting for pydocs

2016-02-11 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/11109#issuecomment-182966518 Great, thanks :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12594] [SQL] Outer Join Elimination by ...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10567#issuecomment-182969820 **[Test build #51115 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51115/consoleFull)** for PR 10567 at commit

[GitHub] spark pull request: [SPARK-13011] K-means wrapper in SparkR

2016-02-11 Thread yinxusen
Github user yinxusen commented on a diff in the pull request: https://github.com/apache/spark/pull/11124#discussion_r52637690 --- Diff: R/pkg/R/mllib.R --- @@ -126,3 +126,27 @@ setMethod("summary", signature(object = "PipelineModel"), return(list(coefficients =

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-02-11 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-182972800 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-12982][SQL] Add table name validation i...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11051#issuecomment-182975000 **[Test build #51120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51120/consoleFull)** for PR 11051 at commit

[GitHub] spark pull request: [SPARK-6166] Limit number of in flight outboun...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-182993003 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-6166] Limit number of in flight outboun...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-182992993 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13149][SQL][FOLLOWUP]Make FileStreamSou...

2016-02-11 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/11162#issuecomment-182994760 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-6166] Limit number of in flight outboun...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10838#issuecomment-182991688 **[Test build #51118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51118/consoleFull)** for PR 10838 at commit

[GitHub] spark pull request: [SPARK-13252] [KAFKA] Bump up Kafka to 0.9.0.0

2016-02-11 Thread markgrover
Github user markgrover commented on the pull request: https://github.com/apache/spark/pull/11143#issuecomment-182996634 Thanks Mario. Do let us know what you think @tdas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-12630][Python][MLlib][DOC] Update param...

2016-02-11 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/10598#discussion_r52644739 --- Diff: python/pyspark/mllib/classification.py --- @@ -272,37 +275,42 @@ def train(cls, data, iterations=100, step=1.0, miniBatchFraction=1.0,

[GitHub] spark pull request: [SPARK-13139][SQL][WIP] Create native DDL comm...

2016-02-11 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/11048#discussion_r52644696 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala --- @@ -62,6 +66,458 @@ private[sql] class SparkQl(conf: ParserConf =

[GitHub] spark pull request: [SPARK-12705] [SQL] push missing attributes fo...

2016-02-11 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11153#discussion_r52645515 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/AnalysisSuite.scala --- @@ -90,7 +90,7 @@ class AnalysisSuite extends

[GitHub] spark pull request: remove flaky test

2016-02-11 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/11164#discussion_r52645513 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackendSuite.scala --- @@ -195,19 +195,6 @@ class

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-183001005 **[Test build #2536 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2536/consoleFull)** for PR 8 at commit

[GitHub] spark pull request: remove flaky test

2016-02-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11164#issuecomment-183001176 This test was added recently in #10993 so this is just reverting the test instead of reverting the whole patch. I do think we should use `ignore` since that's what

[GitHub] spark pull request: [SPARK-12962] [SQL] [PySpark] PySpark support ...

2016-02-11 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/10876#discussion_r52645800 --- Diff: python/pyspark/sql/functions.py --- @@ -254,15 +254,44 @@ def corr(col1, col2): >>> a = [x * x - 2 * x + 3.5 for x in range(20)]

[GitHub] spark pull request: remove flaky test

2016-02-11 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/11164#issuecomment-183001260 Also @mgummelt can you either file a JIRA or add the same JIRA to the title of this patch? --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request: [SPARK-12705] [SQL] push missing attributes fo...

2016-02-11 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/11153#discussion_r52646199 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -572,98 +572,64 @@ class Analyzer( // Skip

[GitHub] spark pull request: [SPARK-13149][SQL][FOLLOWUP]Make FileStreamSou...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11162#issuecomment-183002962 **[Test build #51122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51122/consoleFull)** for PR 11162 at commit

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-183004244 **[Test build #51119 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51119/consoleFull)** for PR 8 at commit

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-183005153 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [WebUI][SPARK-7889] HistoryServer updates UI f...

2016-02-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8#issuecomment-183005159 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13279] Remove unnecessary duplicate che...

2016-02-11 Thread sitalkedia
Github user sitalkedia commented on the pull request: https://github.com/apache/spark/pull/11167#issuecomment-183006784 As you can see from the jstack of the driver http://pastebin.com/m8CP6VMv. The dag-scheduler-event-loop thread has taken a lock and is spending a lot of time in

[GitHub] spark pull request: [SPARK-11714][Mesos] Make Spark on Mesos honor...

2016-02-11 Thread skonto
Github user skonto commented on the pull request: https://github.com/apache/spark/pull/11157#issuecomment-183007371 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12915] [SQL] add SQL metrics of numOutp...

2016-02-11 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/11170#issuecomment-183007352 @rxin Aggregation and joins have the same numOutputRows as without codegen, only datasize and spillsize are not included in this PR, because I think they are not

<    2   3   4   5   6   7