[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: YARN-5483-branch-2.7.patch.02
YARN-5483-branch-2.6.patch.02

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Affects Versions: 2.6.0
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483-branch-2.6.patch, 
> YARN-5483-branch-2.6.patch.02, YARN-5483-branch-2.7.patch, 
> YARN-5483-branch-2.7.patch.02, YARN-5483.01.patch, YARN-5483.02.patch, 
> YARN-5483.03.patch, YARN-5483.04.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: YARN-5483-branch-2.6.patch
YARN-5483-branch-2.7.patch

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Affects Versions: 2.6.0
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483-branch-2.6.patch, YARN-5483-branch-2.7.patch, 
> YARN-5483.01.patch, YARN-5483.02.patch, YARN-5483.03.patch, 
> YARN-5483.04.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: YARN-5483.04.patch

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Affects Versions: 2.6.0
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483.01.patch, YARN-5483.02.patch, 
> YARN-5483.03.patch, YARN-5483.04.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread Jason Lowe (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Lowe updated YARN-5483:
-
Affects Version/s: 2.6.0
 Target Version/s: 2.6.5, 2.7.4

bq. I don't think YARN-5262 breaks this jira.

Yeah, it looks like YARN-1372 is the source, and that went into 2.6.  As such 
it'd be nice to have this go into 2.7.4 and 2.6.5 since it seems like an 
important performance fix.

Thanks for updating the patch!  Latest one looks good to me as well.  Could you 
provide patches for 2.7/2.6 as well?  Note that 2.6 does not support JDK7, so 
we can't use the diamond operator there.

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Affects Versions: 2.6.0
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483.01.patch, YARN-5483.02.patch, 
> YARN-5483.03.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: YARN-5483.03.patch

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483.01.patch, YARN-5483.02.patch, 
> YARN-5483.03.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-08 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: YARN-5483.02.patch

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483.01.patch, YARN-5483.02.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-08 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: YARN-5483.01.patch

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: sandflee
>Assignee: sandflee
> Attachments: YARN-5483.01.patch, jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-08 Thread sandflee (JIRA)

 [ 
https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

sandflee updated YARN-5483:
---
Attachment: jprofiler-cpu.png

> Optimize RMAppAttempt#pullJustFinishedContainers
> 
>
> Key: YARN-5483
> URL: https://issues.apache.org/jira/browse/YARN-5483
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: sandflee
>Assignee: sandflee
> Attachments: jprofiler-cpu.png
>
>
> about 1000 app running on cluster, jprofiler found pullJustFinishedContainers 
> cost too much cpu.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org