[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439274#comment-15439274 ] Jason Lowe commented on YARN-5551: -- bq. Memory pressure could cause either of them to spil

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439246#comment-15439246 ] Jason Lowe commented on YARN-5551: -- bq. Yes, deleted files is a red-herring OK, cool. Th

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438057#comment-15438057 ] Rajesh Balamohan commented on YARN-5551: This patch worked for the scenario we ran

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437858#comment-15437858 ] Gopal V commented on YARN-5551: --- bq. The more I think about this, the more I feel ignoring de

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437655#comment-15437655 ] Jason Lowe commented on YARN-5551: -- The more I think about this, the more I feel ignoring

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437602#comment-15437602 ] Jason Lowe commented on YARN-5551: -- Sorry I'm confused, so apologies if this is obvious to

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437518#comment-15437518 ] Gopal V commented on YARN-5551: --- [~jlowe],[~nroberts],[~rajesh.balamohan]: I have edited up t

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437506#comment-15437506 ] Gopal V commented on YARN-5551: --- bq. purposes of accounting for how much memory the process i

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437497#comment-15437497 ] Gopal V commented on YARN-5551: --- bq. the second has the entire dirty region marked as anonym

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437415#comment-15437415 ] Nathan Roberts commented on YARN-5551: -- I think the two examples you provided in the d

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437397#comment-15437397 ] Jason Lowe commented on YARN-5551: -- bq. Actually, that's just a safety rail to cut down IO

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437379#comment-15437379 ] Gopal V commented on YARN-5551: --- bq. I guess where I'm getting hung up is on the deleted par

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437316#comment-15437316 ] Jason Lowe commented on YARN-5551: -- Special casing buffer cache pages is one thing, but I

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437256#comment-15437256 ] Chris Nauroth commented on YARN-5551: - OK, I get it now. Thanks, [~gopalv]. I'd be fi

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437166#comment-15437166 ] Gopal V commented on YARN-5551: --- bq. The storage behind that mapping will not be freed even t

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437095#comment-15437095 ] Chris Nauroth commented on YARN-5551: - My understanding agrees with Jason's last commen

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437067#comment-15437067 ] Jason Lowe commented on YARN-5551: -- The "deleted" here refers to the fact that the file pa

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-24 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435726#comment-15435726 ] Nathan Roberts commented on YARN-5551: -- bq. Nathan Roberts, Jason Lowe - do you mind r

[jira] [Commented] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-08-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433215#comment-15433215 ] Varun Vasudev commented on YARN-5551: - [~nroberts], [~jlowe] - do you mind reviewing th