[GitHub] spark pull request: [SPARK-3829] Make Spark logo image on the head...

2014-10-07 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/2690 [SPARK-3829] Make Spark logo image on the header of HistoryPage as a link to HistoryPage's page #1 There is a Spark logo on the header of HistoryPage. We can have too many HistoryPages if we run

[GitHub] spark pull request: [SPARK-3829] Make Spark logo image on the head...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2690#issuecomment-58145012 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21369/consoleFull) for PR 2690 at commit [`dd87480`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3270] Spark API for Application Extensi...

2014-10-07 Thread mmalohlava
GitHub user mmalohlava opened a pull request: https://github.com/apache/spark/pull/2691 [SPARK-3270] Spark API for Application Extensions SPARK-3270: Initial proposal of application extensions. The change set introduces: * Spark extension API to implement *

[GitHub] spark pull request: [SPARK-3270] Spark API for Application Extensi...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2691#issuecomment-58146366 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-3270] Spark API for Application Extensi...

2014-10-07 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/2691#issuecomment-58146963 This seems quite heavyweight compared to Patrick's suggestion of just using a static object. Why the need for custom logic to load classes? (which even opens up security q

[GitHub] spark pull request: [SPARK-3412] [PySpark] Replace Epydoc with Sph...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2689#issuecomment-58148670 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3412] [PySpark] Replace Epydoc with Sph...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2689#issuecomment-58148662 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21367/consoleFull) for PR 2689 at commit [`d5b874a`](https://github.com/a

[GitHub] spark pull request: [SPARK-3762] clear reference of SparkEnv after...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2624#issuecomment-58149038 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21368/consoleFull) for PR 2624 at commit [`a69f30c`](https://github.com/a

[GitHub] spark pull request: [SPARK-3762] clear reference of SparkEnv after...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2624#issuecomment-58149042 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3829] Make Spark logo image on the head...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2690#issuecomment-58150433 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3829] Make Spark logo image on the head...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2690#issuecomment-58150425 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21369/consoleFull) for PR 2690 at commit [`dd87480`](https://github.com/a

[GitHub] spark pull request: [SPARK-3831] Filter rule Improvement and bool ...

2014-10-07 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/2692 [SPARK-3831] Filter rule Improvement and bool expression optimization. If we write the filter which is always FALSE like SELECT * from person WHERE FALSE; 200 tasks will run. I

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58178035 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21370/consoleFull) for PR 2692 at commit [`8ea872b`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58179115 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21370/consoleFull) for PR 2692 at commit [`8ea872b`](https://github.com/a

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58179119 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3119] Re-implementation of TorrentBroad...

2014-10-07 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/2030#issuecomment-58183559 We had a build against the spark master on Oct 2, and when ran our application with data around 600GB, we got the following exception. Does this PR fix this issue which is

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58186913 @sarutak LGTM. Can you take a look at the failing test? The log is ``` [info] - NOT (i < 88) *** FAILED *** [info] 2 did not equal 10 Wrong number of read

[GitHub] spark pull request: code style format

2014-10-07 Thread shijinkui
Github user shijinkui commented on the pull request: https://github.com/apache/spark/pull/2643#issuecomment-58187162 in the intellij IDEA, too much yellow tips to fix. after changing, the code looks better. --- If your project is set up for it, you can reply to this email and ha

[GitHub] spark pull request: [SPARK-3809][SQL] Fixes test suites in hive-th...

2014-10-07 Thread scwf
Github user scwf commented on the pull request: https://github.com/apache/spark/pull/2675#issuecomment-58188701 Hi @liancheng, I think i get the root cause here. In TestHive.scala we reset the log4j level ``` // HACK: Hive is too noisy by default. org.apache.log

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58190309 @yhuai Thanks picking this PR up and for your comment! I'll try soon. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-3832][MLlib] Upgrade Breeze dependency ...

2014-10-07 Thread dbtsai
GitHub user dbtsai opened a pull request: https://github.com/apache/spark/pull/2693 [SPARK-3832][MLlib] Upgrade Breeze dependency to 0.10 In Breeze 0.10, the L1regParam can be configured through anonymous function in OWLQN, and each component can be penalized differently. This is re

[GitHub] spark pull request: [SPARK-3832][MLlib] Upgrade Breeze dependency ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2693#issuecomment-58192163 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21371/consoleFull) for PR 2693 at commit [`7a0c45c`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3627] - [yarn] - fix exit code and fina...

2014-10-07 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/2577#issuecomment-58197006 Thanks @andrewor14. I've merged this into 1.2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-3627] - [yarn] - fix exit code and fina...

2014-10-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/2577 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-3119] Re-implementation of TorrentBroad...

2014-10-07 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/2030#issuecomment-58201237 It could be fixed by https://github.com/apache/spark/pull/2624 It's strange that I can not see this comment on PR #2030. On Tue, Oct 7, 2014 at 6:28 AM, DB

[GitHub] spark pull request: [SPARK-3832][MLlib] Upgrade Breeze dependency ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2693#issuecomment-58202720 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21371/consoleFull) for PR 2693 at commit [`7a0c45c`](https://github.com/a

[GitHub] spark pull request: [SPARK-3832][MLlib] Upgrade Breeze dependency ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2693#issuecomment-58202731 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58203345 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21372/consoleFull) for PR 2692 at commit [`a11b9f3`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3786] [PySpark] speedup tests

2014-10-07 Thread jameszhouyi
Github user jameszhouyi commented on the pull request: https://github.com/apache/spark/pull/2646#issuecomment-58205767 Hi @davies @JoshRosen Found below errors after add 'time' in run-tests Running PySpark tests. Output is in python/unit-tests.log. Testing with Python

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58209751 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3787] Assembly jar name is wrong when w...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2647#issuecomment-58209752 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3677] [BUILD] [YARN] pom.xml and SparkB...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2520#issuecomment-58209766 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58209763 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58210133 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-3677] [BUILD] [YARN] pom.xml and SparkB...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2520#issuecomment-58210179 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58210228 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-3787] Assembly jar name is wrong when w...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2647#issuecomment-58210261 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/2692#discussion_r18529676 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/columnar/PartitionBatchPruningSuite.scala --- @@ -67,10 +67,11 @@ class PartitionBatchPruningSuite exten

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58210908 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21379/consoleFull) for PR 2612 at commit [`b0585da`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3787] Assembly jar name is wrong when w...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2647#issuecomment-58210898 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21377/consoleFull) for PR 2647 at commit [`ad1f96e`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-5827 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-5823 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21372/consoleFull) for PR 2692 at commit [`a11b9f3`](https://github.com/a

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/2612#discussion_r18530534 --- Diff: dev/lint-windows-cmd --- @@ -0,0 +1,40 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/2612#discussion_r18530666 --- Diff: dev/lint-windows-cmd --- @@ -0,0 +1,40 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/2612#discussion_r18530699 --- Diff: dev/lint-windows-cmd --- @@ -0,0 +1,40 @@ +#!/usr/bin/env bash + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58211878 @yhuai Thanks, it make sense. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-3677] [BUILD] [YARN] pom.xml and SparkB...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2520#issuecomment-58210929 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21380/consoleFull) for PR 2520 at commit [`de91bbd`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58212070 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58212418 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21381/consoleFull) for PR 2692 at commit [`23c750c`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58212737 Thanks @nchammas , I've done. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58212936 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58213209 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21382/consoleFull) for PR 2612 at commit [`cfaa176`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58214144 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21383/consoleFull) for PR 2661 at commit [`8b64bb7`](https://github.com/ap

[GitHub] spark pull request: [SPARK-3119] Re-implementation of TorrentBroad...

2014-10-07 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/2030#issuecomment-58214186 I thought it was a close issue, so I moved my comment to JIRA. I ran into this issue in spark-shell not the standalone application, does SPARK-3762 apply in this sit

[GitHub] spark pull request: [SPARK-3786] [PySpark] speedup tests

2014-10-07 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/2646#issuecomment-58214253 What shell are you running it in? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-3812] [BUILD] Adapt maven build to publ...

2014-10-07 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/2673#issuecomment-58216712 Thanks for the explanation. The issue with the Scala versions makes sense. What threw me off was the Hadoop example: I've always seen people say that the Spark API is inde

[GitHub] spark pull request: [SPARK-3710] Fix Yarn integration tests on Had...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2682#issuecomment-58216947 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21384/consoleFull) for PR 2682 at commit [`701d4fb`](https://github.com/ap

[GitHub] spark pull request: [SPARK-2750] support https in spark web ui

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1980#discussion_r18532610 --- Diff: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala --- @@ -205,10 +231,74 @@ private[spark] object JettyUtils extends Logging { ServerI

[GitHub] spark pull request: [SPARK-2199] [mllib] topic modeling

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1269#issuecomment-58218797 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21385/consoleFull) for PR 1269 at commit [`cb951cc`](https://github.com/ap

[GitHub] spark pull request: [SPARK-2199] [mllib] topic modeling

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/1269#issuecomment-58218990 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21385/consoleFull) for PR 1269 at commit [`cb951cc`](https://github.com/a

[GitHub] spark pull request: [SPARK-2199] [mllib] topic modeling

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1269#issuecomment-58218992 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-2199] [mllib] topic modeling

2014-10-07 Thread akopich
Github user akopich commented on the pull request: https://github.com/apache/spark/pull/1269#issuecomment-58220390 Unfortunately, our cluster is unavailable due to some technical issues. Probably, the problem you report is related to the fact that `backgound : Array[Float]` in

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58220515 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21381/consoleFull) for PR 2692 at commit [`23c750c`](https://github.com/a

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58220527 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3831] [SQL] Filter rule Improvement and...

2014-10-07 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/2692#issuecomment-58221944 LGTM cc @marmbrus. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have th

[GitHub] spark pull request: [SPARK-3832][MLlib] Upgrade Breeze dependency ...

2014-10-07 Thread mengxr
Github user mengxr commented on the pull request: https://github.com/apache/spark/pull/2693#issuecomment-58221886 @dbtsai Could you check whether there is any dependency change in breeze-0.10 and the number of files in breeze-0.10 jar? Does it compatible with both Scala 2.10 and 2.11?

[GitHub] spark pull request: [SPARK-3677] [BUILD] [YARN] pom.xml and SparkB...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2520#issuecomment-58222074 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3787] Assembly jar name is wrong when w...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2647#issuecomment-58222518 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21377/consoleFull) for PR 2647 at commit [`ad1f96e`](https://github.com/a

[GitHub] spark pull request: [SPARK-3787] Assembly jar name is wrong when w...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2647#issuecomment-58222529 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58222629 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58222616 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21379/consoleFull) for PR 2612 at commit [`b0585da`](https://github.com/a

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18534397 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -142,48 +151,56 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18534494 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -142,48 +151,56 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-2199] [mllib] topic modeling

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/1269#issuecomment-58222849 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3677] [BUILD] [YARN] pom.xml and SparkB...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2520#issuecomment-58222059 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21380/consoleFull) for PR 2520 at commit [`de91bbd`](https://github.com/a

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18534683 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -142,48 +151,56 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-3133] embed small object in broadcast t...

2014-10-07 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/2681#discussion_r18534899 --- Diff: core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scala --- @@ -161,6 +178,10 @@ private[spark] class TorrentBroadcast[T: ClassTag](

[GitHub] spark pull request: [SPARK-3133] embed small object in broadcast t...

2014-10-07 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/2681#discussion_r18534919 --- Diff: core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala --- @@ -257,7 +257,7 @@ class BroadcastSuite extends FunSuite with LocalSparkConte

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18535127 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -214,29 +231,64 @@ private[history] class FsHistoryProvider(conf:

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58224711 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21382/consoleFull) for PR 2612 at commit [`cfaa176`](https://github.com/a

[GitHub] spark pull request: [SPARK-3758] [Windows] Wrong EOL character in ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2612#issuecomment-58224721 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-3788] [yarn] Fix compareFs to do the ri...

2014-10-07 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/2650#issuecomment-58224804 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18535195 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -688,41 +691,34 @@ private[spark] class Master( def rebuildSparkUI(app:

[GitHub] spark pull request: [SPARK-3788] [yarn] Fix compareFs to do the ri...

2014-10-07 Thread tgravescs
Github user tgravescs commented on the pull request: https://github.com/apache/spark/pull/2649#issuecomment-58225142 Ah so you really mean when using viewFS. You can use federation without viewfs. --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-3812] [BUILD] Adapt maven build to publ...

2014-10-07 Thread ueshin
Github user ueshin commented on the pull request: https://github.com/apache/spark/pull/2673#issuecomment-58225042 Hi @pwendell, I had a similar issue related to artifacts in Maven Central and Hadoop versions. Could you take a look at [SPARK-3764](https://issues.apache.org/jira/bro

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18535305 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -688,41 +691,34 @@ private[spark] class Master( def rebuildSparkUI(app:

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18535329 --- Diff: core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala --- @@ -58,43 +61,79 @@ private[spark] class EventLoggingListener( p

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58225743 [QA tests have finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21383/consoleFull) for PR 2661 at commit [`8b64bb7`](https://github.com/a

[GitHub] spark pull request: [SPARK-3802][BUILD] Scala version is wrong in ...

2014-10-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2661#issuecomment-58225756 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/2

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18535605 --- Diff: core/src/main/scala/org/apache/spark/scheduler/ReplayListenerBus.scala --- @@ -17,74 +17,43 @@ package org.apache.spark.scheduler

[GitHub] spark pull request: [SPARK-3788] [yarn] Fix compareFs to do the ri...

2014-10-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2650#issuecomment-58226025 [QA tests have started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/21387/consoleFull) for PR 2650 at commit [`0e36be7`](https://github.com/ap

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-10-07 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r18535871 --- Diff: core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala --- @@ -128,125 +165,140 @@ private[spark] class EventLoggingListener(

[GitHub] spark pull request: [SPARK-3788] [yarn] Fix compareFs to do the ri...

2014-10-07 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/2649#issuecomment-58227159 No necessarily; this affects HA too, which uses the hdfs protocol, not viewfs. --- If your project is set up for it, you can reply to this email and have your reply appea

[GitHub] spark pull request: [SPARK-3825] Log more detail when unrolling a ...

2014-10-07 Thread pwendell
Github user pwendell commented on the pull request: https://github.com/apache/spark/pull/2688#issuecomment-58227253 This is a little wordy. Throughout Spark the log messages are intentionally terse. Something like below cuts down on words a lot but has just as much information.

[GitHub] spark pull request: [SPARK-3250] Implement Gap Sampling optimizati...

2014-10-07 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/2455#discussion_r18536661 --- Diff: core/src/test/scala/org/apache/spark/util/random/RandomSamplerSuite.scala --- @@ -18,96 +18,547 @@ package org.apache.spark.util.random

[GitHub] spark pull request: [SPARK-3250] Implement Gap Sampling optimizati...

2014-10-07 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/2455#discussion_r18536639 --- Diff: core/src/main/scala/org/apache/spark/util/random/RandomSampler.scala --- @@ -39,13 +42,46 @@ trait RandomSampler[T, U] extends Pseudorandom with Clo

[GitHub] spark pull request: [SPARK-3250] Implement Gap Sampling optimizati...

2014-10-07 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/2455#discussion_r18536657 --- Diff: core/src/test/scala/org/apache/spark/util/random/RandomSamplerSuite.scala --- @@ -18,96 +18,547 @@ package org.apache.spark.util.random

[GitHub] spark pull request: [SPARK-3250] Implement Gap Sampling optimizati...

2014-10-07 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/2455#discussion_r18536653 --- Diff: core/src/test/scala/org/apache/spark/util/random/RandomSamplerSuite.scala --- @@ -18,96 +18,547 @@ package org.apache.spark.util.random

[GitHub] spark pull request: [SPARK-3250] Implement Gap Sampling optimizati...

2014-10-07 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/2455#discussion_r18536673 --- Diff: core/src/test/scala/org/apache/spark/util/random/RandomSamplerSuite.scala --- @@ -18,96 +18,547 @@ package org.apache.spark.util.random

[GitHub] spark pull request: [SPARK-3250] Implement Gap Sampling optimizati...

2014-10-07 Thread mengxr
Github user mengxr commented on a diff in the pull request: https://github.com/apache/spark/pull/2455#discussion_r18536693 --- Diff: core/src/test/scala/org/apache/spark/util/random/RandomSamplerSuite.scala --- @@ -18,96 +18,547 @@ package org.apache.spark.util.random

  1   2   3   4   5   6   >