[jira] [Assigned] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk for FS scheduler

2015-06-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reassigned YARN-3790: --- Assignee: zhihai xu > TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk for FS > sched

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk for FS scheduler

2015-06-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580209#comment-14580209 ] zhihai xu commented on YARN-3790: - Hi [~rohithsharma], thanks for reporting this issue. I t

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2194: -- Attachment: YARN-2194-4.patch Uploaded a patch by replacing comma with '%'. > Cgroups cease to work in RHEL7 > -

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails in trunk for FS scheduler

2015-06-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580228#comment-14580228 ] Rohith commented on YARN-3790: -- bq. I think this test fails intermittently. Yes, it is failing

[jira] [Updated] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3790: - Summary: TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler (was: T

[jira] [Updated] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-06-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3044: Attachment: YARN-3044-YARN-2928.011.patch > [Event producers] Implement RM writing app lifecy

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-06-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580253#comment-14580253 ] Naganarasimha G R commented on YARN-3044: - Hi [~zjshen], Have taken care of

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-10 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580255#comment-14580255 ] Rohith commented on YARN-3790: -- Thanks for looking into this issue, bq. If UpdateThread call u

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580275#comment-14580275 ] Hadoop QA commented on YARN-2194: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580378#comment-14580378 ] Hadoop QA commented on YARN-3044: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (YARN-3791) FSDownload

2015-06-10 Thread HuanWang (JIRA)
HuanWang created YARN-3791: -- Summary: FSDownload Key: YARN-3791 URL: https://issues.apache.org/jira/browse/YARN-3791 Project: Hadoop YARN Issue Type: Bug Components: nodemanager Affect

[jira] [Updated] (YARN-3791) FSDownload

2015-06-10 Thread HuanWang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HuanWang updated YARN-3791: --- Description: Inadvertently,we set two source ftp path: {code} { { ftp://10.27.178.207:21/home/cbt/1213/jxf.sql

[jira] [Updated] (YARN-3791) FSDownload

2015-06-10 Thread HuanWang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HuanWang updated YARN-3791: --- Description: Inadvertently,we set two source ftp path: {code} { { ftp://10.27.178.207:21/home/cbt/1213/jxf.sql

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-06-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580508#comment-14580508 ] Naganarasimha G R commented on YARN-3044: - [~zjshen], Seems like many of the test c

[jira] [Created] (YARN-3792) Test case failures in TestDistributedShell after changes for subjira's of YARN-2928

2015-06-10 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-3792: --- Summary: Test case failures in TestDistributedShell after changes for subjira's of YARN-2928 Key: YARN-3792 URL: https://issues.apache.org/jira/browse/YARN-3792

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580821#comment-14580821 ] Bibin A Chundatt commented on YARN-3789: With this patch there is no increase in nu

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580858#comment-14580858 ] Varun Saxena commented on YARN-3051: [~zjshen], thanks for your inputs. I will brief yo

[jira] [Updated] (YARN-2578) NM does not failover timely if RM node network connection fails

2015-06-10 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2578: --- Attachment: YARN-2578.002.patch I attached 002 which makes rpcTimeout configurable by "ipc.clie

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3051: --- Attachment: YARN-3051-YARN-2928.04.patch > [Storage abstraction] Create backing storage read interface

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580910#comment-14580910 ] Varun Saxena commented on YARN-3051: As of now, there are very similar APIs' for getEn

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580961#comment-14580961 ] Hadoop QA commented on YARN-3051: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14580965#comment-14580965 ] zhihai xu commented on YARN-3790: - [~rohithsharma], thanks for updating the title. The cont

[jira] [Updated] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3790: Attachment: YARN-3790.000.patch > TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581026#comment-14581026 ] zhihai xu commented on YARN-3790: - I uploaded a patch YARN-3790.000.patch which will move

[jira] [Updated] (YARN-3793) Several NPEs when deleting local files on NM recovery

2015-06-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3793: --- Priority: Major (was: Critical) > Several NPEs when deleting local files on NM recovery >

[jira] [Created] (YARN-3793) Several NPEs when deleting local files on NM recovery

2015-06-10 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-3793: -- Summary: Several NPEs when deleting local files on NM recovery Key: YARN-3793 URL: https://issues.apache.org/jira/browse/YARN-3793 Project: Hadoop YARN I

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581151#comment-14581151 ] Hadoop QA commented on YARN-3790: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2768) optimize FSAppAttempt.updateDemand by avoid clone of Resource which takes 85% of computing time of update thread

2015-06-10 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581349#comment-14581349 ] Hong Zhiguo commented on YARN-2768: --- [~kasha], the excution time displayed in the profili

[jira] [Updated] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2015-06-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-1042: -- Attachment: (was: YARN-1042-001.patch) > add ability to specify affinity/anti-affinity in container r

[jira] [Updated] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2015-06-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-1042: -- Attachment: YARN-1042.001.patch > add ability to specify affinity/anti-affinity in container requests > -

[jira] [Commented] (YARN-3793) Several NPEs when deleting local files on NM recovery

2015-06-10 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581358#comment-14581358 ] Brahma Reddy Battula commented on YARN-3793: [~kasha] thanks for reporting this

[jira] [Commented] (YARN-3791) FSDownload

2015-06-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581395#comment-14581395 ] Varun Saxena commented on YARN-3791: I see the class name being {{com.suning.cybertron.

[jira] [Commented] (YARN-3785) Support for Resource as an argument during submitApp call in MockRM test class

2015-06-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581422#comment-14581422 ] Xuan Gong commented on YARN-3785: - +1 lgtm. Will commit > Support for Resource as an argum

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

2015-06-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581430#comment-14581430 ] Xuan Gong commented on YARN-3779: - [~varun_saxena] Thanks for the logs. Could you apply the

[jira] [Commented] (YARN-3785) Support for Resource as an argument during submitApp call in MockRM test class

2015-06-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581434#comment-14581434 ] Hudson commented on YARN-3785: -- FAILURE: Integrated in Hadoop-trunk-Commit #8004 (See [https:

[jira] [Commented] (YARN-3785) Support for Resource as an argument during submitApp call in MockRM test class

2015-06-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581452#comment-14581452 ] Xuan Gong commented on YARN-3785: - Committed into trunk/branch-2. Thanks, [~sunilg] > Supp

[jira] [Created] (YARN-3794) TestRMEmbeddedElector fails because of ambiguous LOG reference

2015-06-10 Thread Chengbing Liu (JIRA)
Chengbing Liu created YARN-3794: --- Summary: TestRMEmbeddedElector fails because of ambiguous LOG reference Key: YARN-3794 URL: https://issues.apache.org/jira/browse/YARN-3794 Project: Hadoop YARN

[jira] [Updated] (YARN-3794) TestRMEmbeddedElector fails because of ambiguous LOG reference

2015-06-10 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated YARN-3794: Attachment: YARN-3794.01.patch > TestRMEmbeddedElector fails because of ambiguous LOG reference > ---

[jira] [Created] (YARN-3795) ZKRMStateStore crashes due to IOException: Broken pipe

2015-06-10 Thread lachisis (JIRA)
lachisis created YARN-3795: -- Summary: ZKRMStateStore crashes due to IOException: Broken pipe Key: YARN-3795 URL: https://issues.apache.org/jira/browse/YARN-3795 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3795) ZKRMStateStore crashes due to IOException: Broken pipe

2015-06-10 Thread lachisis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581517#comment-14581517 ] lachisis commented on YARN-3795: This exception appears two days ago in a yarn platform. th

[jira] [Commented] (YARN-3795) ZKRMStateStore crashes due to IOException: Broken pipe

2015-06-10 Thread lachisis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581531#comment-14581531 ] lachisis commented on YARN-3795: I have found ZOOKEEPER-706, this means if zookeeper server

[jira] [Commented] (YARN-3795) ZKRMStateStore crashes due to IOException: Broken pipe

2015-06-10 Thread lachisis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581534#comment-14581534 ] lachisis commented on YARN-3795: It is better if zookeeper fix the ZOOKEEPER-706. > ZKRMS

[jira] [Commented] (YARN-3795) ZKRMStateStore crashes due to IOException: Broken pipe

2015-06-10 Thread lachisis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581537#comment-14581537 ] lachisis commented on YARN-3795: But I think most of these Watchers in ZKRMStateStore seem

[jira] [Commented] (YARN-3795) ZKRMStateStore crashes due to IOException: Broken pipe

2015-06-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14581553#comment-14581553 ] zhihai xu commented on YARN-3795: - Hi [~lachisis], thanks for reporting this issue. Most li