[jira] [Created] (YARN-1888) Not add NodeManager to inactiveRMNodes when reboot NodeManager which have different port

2014-03-28 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created YARN-1888: -- Summary: Not add NodeManager to inactiveRMNodes when reboot NodeManager which have different port Key: YARN-1888 URL: https://issues.apache.org/jira/browse/YARN-1888 Proj

[jira] [Updated] (YARN-1888) Not add NodeManager to inactiveRMNodes when reboot NodeManager which have different port

2014-03-28 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated YARN-1888: --- Attachment: YARN-1888.patch When RMNodeImpl do DeactivateNodeTransition, check whether there is alread

[jira] [Commented] (YARN-1888) Not add NodeManager to inactiveRMNodes when reboot NodeManager which have different port

2014-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950521#comment-13950521 ] Hadoop QA commented on YARN-1888: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Hong Zhiguo (JIRA)
Hong Zhiguo created YARN-1889: - Summary: avoid creating new objects on each fair scheduler call to AppSchedulable comparator Key: YARN-1889 URL: https://issues.apache.org/jira/browse/YARN-1889 Project: Ha

[jira] [Updated] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-1889: -- Attachment: YARN-1889.patch > avoid creating new objects on each fair scheduler call to AppSchedulable

[jira] [Updated] (YARN-1703) Too many connections are opened for proxy server when applicationMaster UI is accessed.

2014-03-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-1703: - Summary: Too many connections are opened for proxy server when applicationMaster UI is accessed. (was: There many

[jira] [Updated] (YARN-1703) Too many connections are opened for proxy server when applicationMaster UI is accessed.

2014-03-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-1703: - Priority: Critical (was: Major) > Too many connections are opened for proxy server when applicationMaster UI is

[jira] [Commented] (YARN-1703) Too many connections are opened for proxy server when applicationMaster UI is accessed.

2014-03-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950552#comment-13950552 ] Rohith commented on YARN-1703: -- I am attaching connection established for accesing 1 applicati

[jira] [Updated] (YARN-1703) Too many connections are opened for proxy server when applicationMaster UI is accessed.

2014-03-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-1703: - Attachment: YARN-1703.2.patch Updated patch rebasing to latest code. I verified after this change, it is wroking.

[jira] [Created] (YARN-1890) Too many unnecessary logs are logged while accessing applicationMaster web UI.

2014-03-28 Thread Rohith (JIRA)
Rohith created YARN-1890: Summary: Too many unnecessary logs are logged while accessing applicationMaster web UI. Key: YARN-1890 URL: https://issues.apache.org/jira/browse/YARN-1890 Project: Hadoop YARN

[jira] [Commented] (YARN-1890) Too many unnecessary logs are logged while accessing applicationMaster web UI.

2014-03-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950564#comment-13950564 ] Rohith commented on YARN-1890: -- Below logs are logging at one shot on refresh. {noformat} 201

[jira] [Commented] (YARN-1890) Too many unnecessary logs are logged while accessing applicationMaster web UI.

2014-03-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950566#comment-13950566 ] Rohith commented on YARN-1890: -- Should log priority change to DEBUG ? I do not understand why

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950576#comment-13950576 ] Hadoop QA commented on YARN-1889: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-1891) Document NodeManager health-monitoring

2014-03-28 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-1891: --- Summary: Document NodeManager health-monitoring Key: YARN-1891 URL: https://issues.apache.org/jira/browse/YARN-1891 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-1891) Document NodeManager health-monitoring

2014-03-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1891: Attachment: apache-yarn-1891.0.patch Patch to create NodeManager documentation and document health m

[jira] [Commented] (YARN-1703) Too many connections are opened for proxy server when applicationMaster UI is accessed.

2014-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950590#comment-13950590 ] Hadoop QA commented on YARN-1703: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1891) Document NodeManager health-monitoring

2014-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950624#comment-13950624 ] Hadoop QA commented on YARN-1891: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

2014-03-28 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Attachment: YARN-1853.patch Updated patch. RMAppManager should check existence of user before

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2014-03-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951040#comment-13951040 ] Sandy Ryza commented on YARN-596: - Cloning the full queue/app tree makes preemption O(apps)

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951002#comment-13951002 ] Sandy Ryza commented on YARN-1889: -- Another nit: Priority.newInstance should be used inste

[jira] [Commented] (YARN-1885) yarn logs command does not provide the application logs for some applications

2014-03-28 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950976#comment-13950976 ] Arpit Gupta commented on YARN-1885: --- yarn logs -applicationId returned nothing. And the a

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950999#comment-13950999 ] Sandy Ryza commented on YARN-1889: -- When you say "gc pressure", which is going down? The

[jira] [Updated] (YARN-1853) Allow containers to be ran under real user even in insecure mode

2014-03-28 Thread Andrey Stepachev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Stepachev updated YARN-1853: --- Component/s: resourcemanager > Allow containers to be ran under real user even in insecure mod

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2014-03-28 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951126#comment-13951126 ] Wei Yan commented on YARN-596: -- Thought that approach before. But I forget why give up. I'll up

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13950749#comment-13950749 ] Fengdong Yu commented on YARN-1889: --- Good catch, Zhiguo. can you add some test cases in

[jira] [Commented] (YARN-1883) TestRMAdminService fails due to inconsistent entries in UserGroups

2014-03-28 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951270#comment-13951270 ] Jonathan Eagles commented on YARN-1883: --- +1. Thanks for cleaning this test up. The do

[jira] [Commented] (YARN-1883) TestRMAdminService fails due to inconsistent entries in UserGroups

2014-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951290#comment-13951290 ] Hudson commented on YARN-1883: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5424 (See [https:

[jira] [Updated] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2014-03-28 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-596: - Attachment: YARN-596.patch Update a new patch without cloneQueueApps(). Instead, add preemptedResources in the FSS

[jira] [Commented] (YARN-1017) Document RM Restart feature

2014-03-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951427#comment-13951427 ] Vinod Kumar Vavilapalli commented on YARN-1017: --- +1, except for a couple of p

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2014-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951456#comment-13951456 ] Hadoop QA commented on YARN-596: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-1891) Document NodeManager health-monitoring

2014-03-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951459#comment-13951459 ] Vinod Kumar Vavilapalli commented on YARN-1891: --- Great, this looks good, +1.

[jira] [Commented] (YARN-1864) Fair Scheduler Dynamic Hierarchical User Queues

2014-03-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951458#comment-13951458 ] Sandy Ryza commented on YARN-1864: -- With your proposal, would it be possible to choose dif

[jira] [Updated] (YARN-1017) Document RM Restart feature

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1017: -- Attachment: rm-restart-doc-3.patch Thanks Vinod for the review, updated the doc > Document RM Restart feature >

[jira] [Commented] (YARN-1891) Document NodeManager health-monitoring

2014-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951485#comment-13951485 ] Hudson commented on YARN-1891: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5427 (See [https:

[jira] [Commented] (YARN-1017) Document RM Restart feature

2014-03-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951540#comment-13951540 ] Hadoop QA commented on YARN-1017: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-1892) Excessive logging in RM

2014-03-28 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-1892: Summary: Excessive logging in RM Key: YARN-1892 URL: https://issues.apache.org/jira/browse/YARN-1892 Project: Hadoop YARN Issue Type: Bug Reporte

[jira] [Commented] (YARN-1885) yarn logs command does not provide the application logs for some applications

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951556#comment-13951556 ] Jian He commented on YARN-1885: --- Talked with Vinod offline, one thing we observed is that aft

[jira] [Commented] (YARN-1885) yarn logs command does not provide the application logs for some applications

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951573#comment-13951573 ] Jian He commented on YARN-1885: --- If this is the last AM retry, no new AM will be created, and

[jira] [Commented] (YARN-1888) Not add NodeManager to inactiveRMNodes when reboot NodeManager which have different port

2014-03-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951591#comment-13951591 ] Karthik Kambatla commented on YARN-1888: Don't think this is a bug. People should b

[jira] [Commented] (YARN-1885) yarn logs command does not provide the application logs for some applications

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951644#comment-13951644 ] Jian He commented on YARN-1885: --- One possible fix is that on NM-resync, today we are ignoring

[jira] [Commented] (YARN-1017) Document RM Restart feature

2014-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951647#comment-13951647 ] Hudson commented on YARN-1017: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5429 (See [https:

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1879: -- Priority: Blocker (was: Major) Target Version/s: 2.4.0 (was: 2.5.0)

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951693#comment-13951693 ] Vinod Kumar Vavilapalli commented on YARN-1879: --- BTW, +1 for marking all of t

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951696#comment-13951696 ] Jian He commented on YARN-1879: --- allocate() is similar to nodeHeartBeat which returns previou

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951700#comment-13951700 ] Vinod Kumar Vavilapalli commented on YARN-1879: --- That's true. I mentioned ret

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951704#comment-13951704 ] Vinod Kumar Vavilapalli commented on YARN-1879: --- *Sigh* I meant "For now, spl

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951773#comment-13951773 ] Hong Zhiguo commented on YARN-1889: --- HI, Fengdong, I'll update the patch according to you

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951774#comment-13951774 ] Hong Zhiguo commented on YARN-1889: --- Hi, Sandy, During processing NodeUpdate events, the

[jira] [Commented] (YARN-1889) avoid creating new objects on each fair scheduler call to AppSchedulable comparator

2014-03-28 Thread Fengdong Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951778#comment-13951778 ] Fengdong Yu commented on YARN-1889: --- Hi, Zhiguo, what my comments you addressed in your n

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951779#comment-13951779 ] Xuan Gong commented on YARN-1879: - ApplicationMasterService#registerApplicationMaster does

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1879: Attachment: YARN-1879.1.patch > Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol > --

[jira] [Assigned] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1879: --- Assignee: Xuan Gong (was: Tsuyoshi OZAWA) > Mark Idempotent/AtMostOnce annotations to ApplicationMast

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951780#comment-13951780 ] Xuan Gong commented on YARN-1879: - [~ozawa] Mind if i take over this ticket. I will make so

[jira] [Commented] (YARN-1890) Too many unnecessary logs are logged while accessing applicationMaster web UI.

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951783#comment-13951783 ] Jian He commented on YARN-1890: --- +1 for cleaning it up > Too many unnecessary logs are logge

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-03-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951785#comment-13951785 ] Jian He commented on YARN-1879: --- Both register and unregister are checking whether the applic