[GitHub] spark pull request: [SPARK-4576][SQL] Add concatenation operator

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3433#issuecomment-66389406 [Test build #24278 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24278/consoleFull) for PR 3433 at commit

[GitHub] spark pull request: [SPARK-4453][SPARK-4213][SQL] Additional test ...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/#issuecomment-66389384 [Test build #24277 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24277/consoleFull) for PR at commit

[GitHub] spark pull request: [SPARK-3382] GradientDescent convergence toler...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3636#discussion_r21578119 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/optimization/GradientDescentSuite.scala --- @@ -138,6 +138,45 @@ class GradientDescentSuite extends

[GitHub] spark pull request: SPARK-4159 [CORE] [WIP] Maven build doesn't ru...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3651#issuecomment-66389931 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-66389892 [Test build #24280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24280/consoleFull) for PR 2914 at commit

[GitHub] spark pull request: SPARK-4159 [CORE] [WIP] Maven build doesn't ru...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3651#issuecomment-66389927 [Test build #24269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24269/consoleFull) for PR 3651 at commit

[GitHub] spark pull request: SPARK-4447. Remove layers of abstraction in YA...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3652#issuecomment-66390767 [Test build #24273 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24273/consoleFull) for PR 3652 at commit

[GitHub] spark pull request: SPARK-4447. Remove layers of abstraction in YA...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3652#issuecomment-66390771 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-66391029 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-66391021 [Test build #24274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24274/consoleFull) for PR 3570 at commit

[GitHub] spark pull request: [SPARK-4573] [SQL] Add SettableStructObjectIns...

2014-12-09 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/3429#issuecomment-66391400 @marmbrus I've updated the scala doc a little bit, I know that's quite complicated now, but we need to make thing right (to integrated with Hive UDFs seamlessly),

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21579057 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -81,6 +79,38 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: Add hadoop-2.5 profile with upgraded jets3t

2014-12-09 Thread ZhangBanger
GitHub user ZhangBanger opened a pull request: https://github.com/apache/spark/pull/3654 Add hadoop-2.5 profile with upgraded jets3t This contribution is my original work and I license the work to the project under the project's open source license. Adding support for

[GitHub] spark pull request: Add hadoop-2.5 profile with upgraded jets3t

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3654#issuecomment-66392060 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21579370 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -51,10 +52,7 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-09 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/3625#issuecomment-66392255 I'm merging this one in master branch-1.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21579395 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -26,6 +26,7 @@ import org.apache.spark.ui.{WebUIPage, UIUtils}

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21579401 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -81,6 +79,38 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: [SPARK-4740] Create multiple concurrent connec...

2014-12-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3625 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-4704][STREAMING] Reliable Kafka Receive...

2014-12-09 Thread harishreedharan
GitHub user harishreedharan opened a pull request: https://github.com/apache/spark/pull/3655 [SPARK-4704][STREAMING] Reliable Kafka Receiver can lose data if the blo... ...ck generator fails to store data. The Reliable Kafka Receiver commits offsets only when events are

[GitHub] spark pull request: [SPARK-4808] Remove Spillable minimum threshol...

2014-12-09 Thread lawlerd
GitHub user lawlerd opened a pull request: https://github.com/apache/spark/pull/3656 [SPARK-4808] Remove Spillable minimum threshold and sampling You can merge this pull request into a Git repository by running: $ git pull https://github.com/lawlerd/spark branch-1.2

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21579476 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -51,10 +52,7 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3194#issuecomment-66392556 Hey just a few minor comments but the approach looks good. Thanks for working on this. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-4006] Block Manager - Double Register C...

2014-12-09 Thread shaneknapp
Github user shaneknapp commented on the pull request: https://github.com/apache/spark/pull/2854#issuecomment-66392666 all of our worker nodes have numpy-1.4.1-9.el6.x86_64 installed on them, and have had this for months. i'm home for the evening, but we can do git archaeology

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/3657 Config updates for the new shuffle transport. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark conf-update Alternatively you can review

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/3194#issuecomment-66392747 @andrewor14 Thanks for all of your comments! I'll fix soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-4161]Spark shell class path is not corr...

2014-12-09 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/3050#issuecomment-66392860 OK, I'll try. But

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3657#issuecomment-66392926 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-4808] Remove Spillable minimum threshol...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3656#issuecomment-66392891 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3657#issuecomment-66393158 [Test build #24281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24281/consoleFull) for PR 3657 at commit

[GitHub] spark pull request: [SPARK-4704][STREAMING] Reliable Kafka Receive...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-66393175 [Test build #24282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24282/consoleFull) for PR 3655 at commit

[GitHub] spark pull request: [SPARK-4759] Fix driver hanging from coalescin...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3633#issuecomment-66393315 [Test build #24283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24283/consoleFull) for PR 3633 at commit

[GitHub] spark pull request: [SPARK-4707][STREAMING] Reliable Kafka Receive...

2014-12-09 Thread harishreedharan
Github user harishreedharan commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-66393421 I messed up the jira number in the commit. Please fix it when merging. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4809] Rework Guava library shading.

2014-12-09 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/3658 [SPARK-4809] Rework Guava library shading. The current way of shading Guava is a little problematic. Code that depends on spark-core does not see the transitive dependency, yet classes in

[GitHub] spark pull request: [SPARK-4809] Rework Guava library shading.

2014-12-09 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/3658#issuecomment-66393496 I ran the maven build + unit tests, and also audited the jar files in the build using the tool I wrote: https://gist.github.com/vanzin/bd9057fadf4a296220b7

[GitHub] spark pull request: [SPARK-4759] Fix driver hanging from coalescin...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3633#issuecomment-66393517 [Test build #24283 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24283/consoleFull) for PR 3633 at commit

[GitHub] spark pull request: [SPARK-4759] Fix driver hanging from coalescin...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3633#issuecomment-66393520 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4754] Refactor SparkContext into Execut...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3614#issuecomment-66393706 [Test build #24286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24286/consoleFull) for PR 3614 at commit

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-66393716 [Test build #24284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24284/consoleFull) for PR 3627 at commit

[GitHub] spark pull request: [SPARK-4730][YARN] Warn against deprecated YAR...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3590#issuecomment-66393724 [Test build #24287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24287/consoleFull) for PR 3590 at commit

[GitHub] spark pull request: [SPARK-4809] Rework Guava library shading.

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3658#issuecomment-66393963 [Test build #24285 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24285/consoleFull) for PR 3658 at commit

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-66394104 [Test build #24289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24289/consoleFull) for PR 3564 at commit

[GitHub] spark pull request: [SPARK-1953][YARN]yarn client mode Application...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3607#issuecomment-66394345 [Test build #24288 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24288/consoleFull) for PR 3607 at commit

[GitHub] spark pull request: [SPARK-4806] Streaming doc update for 1.2

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3653#issuecomment-66395160 [Test build #24276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24276/consoleFull) for PR 3653 at commit

[GitHub] spark pull request: [SPARK-4806] Streaming doc update for 1.2

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3653#issuecomment-66395163 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4453][SPARK-4213][SQL] Additional test ...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/#issuecomment-66395258 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4453][SPARK-4213][SQL] Additional test ...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/#issuecomment-66395254 [Test build #24277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24277/consoleFull) for PR at commit

[GitHub] spark pull request: [SPARK-4576][SQL] Add concatenation operator

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3433#issuecomment-66395358 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3194#issuecomment-66395463 [Test build #24290 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24290/consoleFull) for PR 3194 at commit

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3194#issuecomment-66395624 [Test build #24279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24279/consoleFull) for PR 3194 at commit

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3194#issuecomment-66395630 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-3431] [WIP] Parallelize test execution

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3564#issuecomment-66395651 [Test build #24289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24289/consoleFull) for PR 3564 at commit

[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-66395752 [Test build #24280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24280/consoleFull) for PR 2914 at commit

[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-66395757 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [WIP] SPARK-2450 Adds exeuctor log links to We...

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3486#issuecomment-66395938 It seems there are two separate issues that we are discussing here: (1) How to propagate the link from the AM to the driver (2) How to propagate the link

[GitHub] spark pull request: [SPARK-4006] In long running contexts, we enco...

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2914#issuecomment-66396333 Hey sorry @tsliwowicz for using your PRs as the battleground in fixing our builds against older branches. There aren't a lot of PRs opened against older branches so

[GitHub] spark pull request: [SPARK-4609] Blacklist hosts rather than execu...

2014-12-09 Thread suyanNone
Github user suyanNone commented on the pull request: https://github.com/apache/spark/pull/3541#issuecomment-66396760 @davies IIUC, current executor-backlist or host-backlist is all for one TaskSetManager. There is a chance that tow or more taskSetManager run on the same host or

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21581438 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -48,13 +52,40 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21581430 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -39,6 +40,9 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: [SPARK-4161]Spark shell class path is not corr...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3050#issuecomment-66396867 [Test build #24291 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24291/consoleFull) for PR 3050 at commit

[GitHub] spark pull request: [SPARK-4609] Blacklist hosts rather than execu...

2014-12-09 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/3541#issuecomment-66396977 @suyanNone Yes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3194#issuecomment-66397115 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21581544 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -48,13 +52,40 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: [SPARK-4329][WebUI] HistoryPage pagenation

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/3194#discussion_r21581561 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryPage.scala --- @@ -48,13 +52,40 @@ private[spark] class HistoryPage(parent:

[GitHub] spark pull request: SPARK-3779. yarn spark.yarn.applicationMaster....

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3471#issuecomment-66397588 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: SPARK-3779. yarn spark.yarn.applicationMaster....

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3471#issuecomment-66397719 [Test build #24293 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24293/consoleFull) for PR 3471 at commit

[GitHub] spark pull request: [SPARK-4759] Fix driver hanging from coalescin...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3633#issuecomment-66397946 [Test build #24292 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24292/consoleFull) for PR 3633 at commit

[GitHub] spark pull request: SPARK-3779. yarn spark.yarn.applicationMaster....

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3471#issuecomment-66397955 Hey @sryza unfortunately this will have to block until we figure out in #3490 what the appropriate naming scheme for AM configs to use collectively. Otherwise we

[GitHub] spark pull request: spark-submit with accept multiple properties-f...

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/3490#issuecomment-66398025 I agree. Would you mind closing this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3610#discussion_r21581983 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala --- @@ -353,6 +359,31 @@ object KMeans { } /** + *

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3610#discussion_r21581989 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/clustering/KMeansSuite.scala --- @@ -90,6 +90,27 @@ class KMeansSuite extends FunSuite with

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3610#discussion_r21581991 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/clustering/KMeansSuite.scala --- @@ -90,6 +90,27 @@ class KMeansSuite extends FunSuite with

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3610#discussion_r21581990 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/clustering/KMeansSuite.scala --- @@ -90,6 +90,27 @@ class KMeansSuite extends FunSuite with

[GitHub] spark pull request: [SPARK-4707][STREAMING] Reliable Kafka Receive...

2014-12-09 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-66398284 Thanks Hari, seems this is a simple solution. BTW should we make `count = 3` as a configurable parameter? For others LGTM. Original thoughts of introducing

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3610#discussion_r21581986 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala --- @@ -353,6 +359,31 @@ object KMeans { } /** + *

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/3610#discussion_r21581982 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeans.scala --- @@ -43,7 +43,8 @@ class KMeans private ( private var runs: Int,

[GitHub] spark pull request: Spark Core - [SPARK-3620] - Refactor of SparkS...

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2516#issuecomment-66398367 Hey @tigerquoll usually for large patches like this we require a design doc on the JIRA. Especially because the priority of this is not super important, I would

[GitHub] spark pull request: SPARK-4749: Allow initializing KMeans clusters...

2014-12-09 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/3610#issuecomment-66398376 @nxwhite-str Thanks for the PR! Could you please update the title to start with [SPARK-4749] [mllib] to help with automated tagging? --- If your project is set up

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-66398459 LGTM. Just in case you missed my earlier comment, are you still planning to update the PR description to reflect the actual changes vs. the ones you had planned?

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-09 Thread nkronenfeld
Github user nkronenfeld commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-66398560 I thought I'd done so, it looks like it lost my changes I'll fix that asap --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-4806] Streaming doc update for 1.2

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3653#issuecomment-66398673 [Test build #24294 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24294/consoleFull) for PR 3653 at commit

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-09 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/3627#discussion_r21582109 --- Diff: docs/spark-standalone.md --- @@ -272,6 +272,15 @@ should specify them through the `--jars` flag using comma as a delimiter (e.g. ` To control the

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-09 Thread tdas
Github user tdas commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-66398746 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request: [SPARK-3611] Show number of cores for each exe...

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2980#issuecomment-66398809 Hey @devldevelopment given that there is no simple way to support this across different cluster managers, I would recommend that we close this issue for now. We can

[GitHub] spark pull request: Update FsHistoryProvider.scala

2014-12-09 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/2546#issuecomment-66399032 @397090770 given that a lot of changes have gone in since this was opened, I would recommend that we close this issue for now until we describe the issue in a JIRA.

[GitHub] spark pull request: [SPARK-4707][STREAMING] Reliable Kafka Receive...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-66399105 [Test build #24282 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24282/consoleFull) for PR 3655 at commit

[GitHub] spark pull request: [SPARK-4707][STREAMING] Reliable Kafka Receive...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3655#issuecomment-66399109 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3657#issuecomment-66399244 [Test build #24281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24281/consoleFull) for PR 3657 at commit

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3657#issuecomment-66399245 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4730][YARN] Warn against deprecated YAR...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3590#issuecomment-66399346 [Test build #24287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24287/consoleFull) for PR 3590 at commit

[GitHub] spark pull request: [SPARK-4730][YARN] Warn against deprecated YAR...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3590#issuecomment-66399349 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread aarondav
Github user aarondav commented on the pull request: https://github.com/apache/spark/pull/3657#issuecomment-66399456 Merging this into master and branch-1.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-2261] Make event logger use a single fi...

2014-12-09 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/1222#discussion_r21582392 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala --- @@ -149,41 +162,45 @@ private[history] class

[GitHub] spark pull request: [SPARK-4161]Spark shell class path is not corr...

2014-12-09 Thread witgo
Github user witgo commented on the pull request: https://github.com/apache/spark/pull/3050#issuecomment-66399472 In my local test, it works. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-09 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-66399537 [Test build #24284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24284/consoleFull) for PR 3627 at commit

[GitHub] spark pull request: [SPARK-4771][Docs] Document standalone cluster...

2014-12-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3627#issuecomment-66399541 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-4772] Clear local copies of accumulator...

2014-12-09 Thread nkronenfeld
Github user nkronenfeld commented on the pull request: https://github.com/apache/spark/pull/3570#issuecomment-66399588 sorry, must have accidentally hit cancel instead of comment the first time. Should be set now. --- If your project is set up for it, you can reply to this email

[GitHub] spark pull request: [Minor] Use sup tag for help icon in web UI ...

2014-12-09 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/3659 [Minor] Use sup tag for help icon in web UI page header This small commit makes the `(?)` web UI help link into a superscript, which should address feedback that the current design makes it look

[GitHub] spark pull request: Config updates for the new shuffle transport.

2014-12-09 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3657 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [Minor] Use sup tag for help icon in web UI ...

2014-12-09 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/3659#issuecomment-66399624 /cc @aarondav, who suggested the `sup` tag. I think this should go into `branch-1.2`, since that's where this feature was introduced. --- If your project is set up

<    1   2   3   4   5   >