[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-12-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.004.patch Thanks for the review [~sidharta-s]. bq. Could you clarify why the

[jira] [Commented] (YARN-4309) Add debug information to application logs when a container fails

2015-12-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037418#comment-15037418 ] Varun Vasudev commented on YARN-4309: - bq. do we need to worry about -L following links outside of the

[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-12-04 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.006.patch Uploaded a new patch to address [~sidharta-s]'s comments.

[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-12-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.007.patch Uploaded a new patch with clarifications on following symlinks in

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044361#comment-15044361 ] Varun Vasudev commented on YARN-3542: - All the existing configurations will continue to work as is. The

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-12-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049050#comment-15049050 ] Varun Vasudev commented on YARN-3998: - I'm thinking of re-opening this issue because we've seen a use

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-12-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Attachment: YARN-1856.002.patch bq. Could you move these constants to CGroupsHandler ? There are

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Attachment: YARN-1856.004.patch {quote} Should add all the configs to yarn-default.xml, saying

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.005.patch Uploaded a patch to fix a failing test. > Re-factor support for CPU

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058403#comment-15058403 ] Varun Vasudev commented on YARN-3542: - The javac warning increase is due to the deprecation of

[jira] [Commented] (YARN-4441) Kill application request from the webservice(ui) is showing success even for the finished applications

2015-12-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055747#comment-15055747 ] Varun Vasudev commented on YARN-4441: - That's a performance optimization for the RPC client - it avoids

[jira] [Commented] (YARN-4451) Some improvements required in Dump scheduler logs

2015-12-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055676#comment-15055676 ] Varun Vasudev commented on YARN-4451: - Agree with points (1) and (2) and (5). Disagree with point (3).

[jira] [Commented] (YARN-4451) Some improvements required in Dump scheduler logs

2015-12-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055722#comment-15055722 ] Varun Vasudev commented on YARN-4451: - bq .Well i guessed that would be the reason but the problem is

[jira] [Comment Edited] (YARN-4451) Some improvements required in Dump scheduler logs

2015-12-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055722#comment-15055722 ] Varun Vasudev edited comment on YARN-4451 at 12/14/15 9:58 AM: --- bq. Well i

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050495#comment-15050495 ] Varun Vasudev commented on YARN-2934: - [~Naganarasimha] - one minor comment - can we make the tail size

[jira] [Commented] (YARN-4442) create new application operation from the Rest API should be logged in the audit log

2015-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051136#comment-15051136 ] Varun Vasudev commented on YARN-4442: - Any reason why it should be logged in the REST API but not for

[jira] [Reopened] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reopened YARN-3998: - Re-opening - I think this is a useful feature for YARN to support. > Add retry-times to let NM

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-12-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051024#comment-15051024 ] Varun Vasudev commented on YARN-3998: - [~hex108] - do you wish to work on this? Do you have a patch

[jira] [Commented] (YARN-4441) Kill application request from the webservice(ui) is showing success even for the finished applications

2015-12-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055686#comment-15055686 ] Varun Vasudev commented on YARN-4441: - Why? The reason the webservice implementation calls the RPC

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.006.patch bq. Adding a @Deprecated to TestCgroupsLCEResourcesHandler would

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.004.patch Uploaded a new patch to address [~sidharta-s]'s comments. bq.

[jira] [Updated] (YARN-4007) Add support for different network setups when launching the docker container

2016-01-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4007: Assignee: Sidharta Seethana (was: Varun Vasudev) > Add support for different network setups when

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-01-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087392#comment-15087392 ] Varun Vasudev commented on YARN-3998: - Thanks for the patch [~hex108]! In your implementation, the

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-12-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067584#comment-15067584 ] Varun Vasudev commented on YARN-1856: - [~kasha] - we haven't provided a flag for using oom_control, but

[jira] [Commented] (YARN-4172) Extend DominantResourceCalculator to account for all resources

2015-12-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067867#comment-15067867 ] Varun Vasudev commented on YARN-4172: - Looks like we need to rebase the YARN-3926 branch.

[jira] [Updated] (YARN-4172) Extend DominantResourceCalculator to account for all resources

2015-12-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4172: Attachment: YARN-4172-YARN-3926.002.patch bq. 1) Who will update DRC.resourceNames, I found

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.007.patch Uploaded a new patch that'll apply on trunk. Just a note on the

[jira] [Commented] (YARN-4232) TopCLI console shows exceptions for help command

2015-12-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074891#comment-15074891 ] Varun Vasudev commented on YARN-4232: - Adding support for HA is probably the right thing to do. Good

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061915#comment-15061915 ] Varun Vasudev commented on YARN-2934: - I'm not too fussed either way. Globs are probably easier for an

[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-11-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.002.patch bq .Linux or Unix? Sorry, not Linux - this patch is for Unix only.

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-11-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Attachment: YARN-1856.001.patch Uploaded a patch that adds support for cgroups based memory

[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-11-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.003.patch Uploaded a new patch that adds a section on broken symlinks to the

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-11-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Target Version/s: (was: 2.7.3) > cgroups based memory monitoring for containers >

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-11-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Target Version/s: 2.7.3 (was: 2.6.3, 2.7.3) > cgroups based memory monitoring for containers >

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-11-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031351#comment-15031351 ] Varun Vasudev commented on YARN-1856: - Moved it out of 2.6.3 and 2.7.3. > cgroups based memory

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-11-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.001.patch Attached an initial version of the patch. > Re-factor support for

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-11-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.002.patch Uploaded a new patch to address test failures and checkstyle issues.

[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-11-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.001.patch Uploaded an initial version of the patch. It's a little difficult to

[jira] [Commented] (YARN-4361) Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model

2015-11-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029676#comment-15029676 ] Varun Vasudev commented on YARN-4361: - [~wjlei] - is this a duplicate of YARN-4344? > Total resource

[jira] [Updated] (YARN-4344) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

2015-11-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4344: Attachment: YARN-4344-branch-2.6.001.patch Uploaded a version for branch-2.6 > NMs reconnecting

[jira] [Comment Edited] (YARN-4459) container-executor might kill process wrongly

2016-01-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091628#comment-15091628 ] Varun Vasudev edited comment on YARN-4459 at 1/11/16 9:04 AM: -- [~hex108] -

[jira] [Commented] (YARN-4459) container-executor might kill process wrongly

2016-01-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091628#comment-15091628 ] Varun Vasudev commented on YARN-4459: - [~hex108] - assume that the process with the recycled pid does a

[jira] [Commented] (YARN-4307) Blacklisted nodes for AM container is not getting displayed in the Web UI

2016-01-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093414#comment-15093414 ] Varun Vasudev commented on YARN-4307: - Thanks for the patch [~Naganarasimha Garla]. Some comments - 1)

[jira] [Commented] (YARN-4553) Add cgroups support for docker containers

2016-01-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094213#comment-15094213 ] Varun Vasudev commented on YARN-4553: - +1 - I'll commit this tomorrow if no one objects. > Add cgroups

[jira] [Commented] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-06-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318669#comment-15318669 ] Varun Vasudev commented on YARN-4844: - +1 for the 2.8 patch. [~leftnoteasy] - will you commit to

[jira] [Commented] (YARN-5122) "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete

2016-06-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15324482#comment-15324482 ] Varun Vasudev commented on YARN-5122: - Thanks for the patch [~jianhe]. Any reason for {code} -

[jira] [Commented] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313774#comment-15313774 ] Varun Vasudev commented on YARN-5191: - +1 for the latest patch. I'll commit this tomorrow if no one

[jira] [Commented] (YARN-5089) Improve "yarn log" command-line "logFiles" option to support regex

2016-05-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1526#comment-1526 ] Varun Vasudev commented on YARN-5089: - Thanks for the patch [~xgong]. The latest patch looks mostly

[jira] [Updated] (YARN-5242) Update DominantResourceCalculator to consider all resource types in calculations

2016-06-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5242: Attachment: YARN-5242-YARN-3926.001.patch Uploaded patch with fix. > Update

[jira] [Created] (YARN-5242) Update DominantResourceCalculator to consider all resource types in calculations

2016-06-13 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5242: --- Summary: Update DominantResourceCalculator to consider all resource types in calculations Key: YARN-5242 URL: https://issues.apache.org/jira/browse/YARN-5242 Project:

[jira] [Commented] (YARN-5223) Container line in yarn logs output for a live application does not include the hostname

2016-06-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328990#comment-15328990 ] Varun Vasudev commented on YARN-5223: - +1. I'll commit this tomorrow if no one objects. > Container

[jira] [Created] (YARN-5246) NMWebAppFilter web redirects drop query parameters

2016-06-14 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5246: --- Summary: NMWebAppFilter web redirects drop query parameters Key: YARN-5246 URL: https://issues.apache.org/jira/browse/YARN-5246 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5246) NMWebAppFilter web redirects drop query parameters

2016-06-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5246: Attachment: YARN-5246.001.patch Uploaded patch file with fix. > NMWebAppFilter web redirects drop

[jira] [Commented] (YARN-5254) capacity scheduler could only allocate a container with 1 vcore if using DefautResourceCalculator

2016-06-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331465#comment-15331465 ] Varun Vasudev commented on YARN-5254: - [~sandflee] - the behaviour to ignore vcores in

[jira] [Updated] (YARN-5223) Container line in yarn logs output for a live application should include the hostname for the container

2016-06-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5223: Summary: Container line in yarn logs output for a live application should include the hostname for

[jira] [Commented] (YARN-5254) capacity scheduler could only allocate a container with 1 vcore if using DefautResourceCalculator

2016-06-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331550#comment-15331550 ] Varun Vasudev commented on YARN-5254: - I'm not too familiar with FairScheduler but this doesn't seem

[jira] [Commented] (YARN-5122) "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete

2016-06-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327711#comment-15327711 ] Varun Vasudev commented on YARN-5122: - +1 for the latest patch. I'll commit this tomorrow if no one

[jira] [Commented] (YARN-5015) Unify restart policies across AM and container restarts

2016-05-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307257#comment-15307257 ] Varun Vasudev commented on YARN-5015: - Thanks for the patch [~hex108]! I think you probably need to

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-05-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Attachment: YARN-4830-YARN-3926.003.patch Uploaded a new patch to address [~asuresh]'s comments.

[jira] [Commented] (YARN-5141) Get Container logs for the Running application from Yarn Logs CommandLine

2016-05-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303913#comment-15303913 ] Varun Vasudev commented on YARN-5141: - [~xgong] - patch looks good. Please fix the checkstyle issue. >

[jira] [Updated] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-05-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4757: Attachment: YARN-4757-YARN-4757.001.patch Uploaded the same patch as [~jmaron] with the right naming

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2016-05-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301472#comment-15301472 ] Varun Vasudev commented on YARN-2233: - [~raviprak] - the initial design of delegation tokens required

[jira] [Commented] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312423#comment-15312423 ] Varun Vasudev commented on YARN-5191: - Thanks for the patch Xuan. Couple of things - # We should

[jira] [Commented] (YARN-5089) Improve "yarn log" command-line "logFiles" option to support regex

2016-05-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301693#comment-15301693 ] Varun Vasudev commented on YARN-5089: - +1 for the latest patch. I'll commit this tomorrow if no one

[jira] [Commented] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-05-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301739#comment-15301739 ] Varun Vasudev commented on YARN-5088: - Thanks for the patch Xuan. Few high level comments - # {code}+

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301868#comment-15301868 ] Varun Vasudev commented on YARN-4844: - [~sunilg] - I don't think we need to change pendingPreemptionRam

[jira] [Commented] (YARN-4007) Add support for different network setups when launching the docker container

2016-05-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302086#comment-15302086 ] Varun Vasudev commented on YARN-4007: - Thanks for the patch [~sidharta-s]. Comments on the patch - #

[jira] [Commented] (YARN-4007) Add support for different network setups when launching the docker container

2016-05-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303647#comment-15303647 ] Varun Vasudev commented on YARN-4007: - [~sidharta-s] clarified that the tests have no ordering

[jira] [Commented] (YARN-4830) Add support for resource types in the nodemanager

2016-06-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310645#comment-15310645 ] Varun Vasudev commented on YARN-4830: - [~asuresh] - can you take a look at the latest patch? Thanks! >

[jira] [Commented] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-06-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310725#comment-15310725 ] Varun Vasudev commented on YARN-5088: - +1 for the latest patch pending jenkins. > Improve "yarn log"

[jira] [Commented] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-06-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309347#comment-15309347 ] Varun Vasudev commented on YARN-4844: - The addendum patch looks good to me [~leftnoteasy]. Will you

[jira] [Commented] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-06-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310111#comment-15310111 ] Varun Vasudev commented on YARN-5088: - Thanks for the update Xuan. It looks like you've added the extra

[jira] [Commented] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-05-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307581#comment-15307581 ] Varun Vasudev commented on YARN-5088: - Thanks for the patch [~xgong]. # Can you please address the

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-05-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Attachment: YARN-4830-YARN-3926.004.patch {noformat} ResourceUtils::addResourcesFileToConf :

[jira] [Updated] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-05-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4844: Summary: Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource (was: Add

[jira] [Commented] (YARN-5141) Get Container logs for the Running application from Yarn Logs CommandLine

2016-05-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305976#comment-15305976 ] Varun Vasudev commented on YARN-5141: - +1. Committing this. > Get Container logs for the Running

[jira] [Commented] (YARN-5200) Improve yarn logs to get Container List

2016-06-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15336131#comment-15336131 ] Varun Vasudev commented on YARN-5200: - Thanks for the patch [~xgong]. Some comments - # Please fix the

[jira] [Commented] (YARN-5200) Improve yarn logs to get Container List

2016-06-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342177#comment-15342177 ] Varun Vasudev commented on YARN-5200: - [~xgong] - I think we need to add an option called

[jira] [Commented] (YARN-5274) Use smartctl to determine health of disks

2016-06-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345298#comment-15345298 ] Varun Vasudev commented on YARN-5274: - The node health script is meant for the health of the node. It

[jira] [Created] (YARN-5274) Use smartctl to determine health of disks

2016-06-20 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5274: --- Summary: Use smartctl to determine health of disks Key: YARN-5274 URL: https://issues.apache.org/jira/browse/YARN-5274 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-06-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340787#comment-15340787 ] Varun Vasudev commented on YARN-5224: - The API rename makes sense. > Logs for a completed container

[jira] [Commented] (YARN-5200) Improve yarn logs to get Container List

2016-06-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340785#comment-15340785 ] Varun Vasudev commented on YARN-5200: - [~xgong] - can you please take a look at the unit tests? In

[jira] [Updated] (YARN-5242) Update DominantResourceCalculator to consider all resource types in calculations

2016-06-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5242: Attachment: YARN-5242-YARN-3926.002.patch Uploaded a patch to fix DominantResourceCalculator as well

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2016-01-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098214#comment-15098214 ] Varun Vasudev commented on YARN-3542: - {quote} This effectively means the old code is not used

[jira] [Created] (YARN-5299) Log Docker run command when container fails

2016-06-27 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5299: --- Summary: Log Docker run command when container fails Key: YARN-5299 URL: https://issues.apache.org/jira/browse/YARN-5299 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5298) Mount usercache and NM filecache directories into Docker container

2016-06-27 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5298: --- Summary: Mount usercache and NM filecache directories into Docker container Key: YARN-5298 URL: https://issues.apache.org/jira/browse/YARN-5298 Project: Hadoop YARN

[jira] [Assigned] (YARN-5299) Log Docker run command when container fails

2016-06-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-5299: --- Assignee: Varun Vasudev > Log Docker run command when container fails >

[jira] [Updated] (YARN-5246) NMWebAppFilter web redirects drop query parameters

2016-06-17 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5246: Attachment: YARN-5246.002.patch Thanks for the review [~djp]. Uploaded a new patch with the

[jira] [Commented] (YARN-4655) Log uncaught exceptions/errors in various thread pools in the nodemanger

2016-02-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140991#comment-15140991 ] Varun Vasudev commented on YARN-4655: - +1. I'll commit this tomorrow if no one objects. > Log uncaught

[jira] [Commented] (YARN-4232) TopCLI console support for HA mode

2016-02-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136707#comment-15136707 ] Varun Vasudev commented on YARN-4232: - [~bibinchundatt] - what version of hadoop are you running? I

[jira] [Commented] (YARN-4628) TopCli to support Application priority

2016-02-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15136703#comment-15136703 ] Varun Vasudev commented on YARN-4628: - Thanks for the patch [~bibinchundatt]. Some minor fixes required

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-02-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134366#comment-15134366 ] Varun Vasudev commented on YARN-3998: - Thanks for your comments Vinod. Overall, I mostly agree with

[jira] [Comment Edited] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-02-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134366#comment-15134366 ] Varun Vasudev edited comment on YARN-3998 at 2/5/16 3:59 PM: - Thanks for your

[jira] [Commented] (YARN-4635) Add global blacklist tracking for AM container failure.

2016-02-04 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132004#comment-15132004 ] Varun Vasudev commented on YARN-4635: - [~sunilg] - does that mean this won't get committed till

[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

2016-02-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142398#comment-15142398 ] Varun Vasudev commented on YARN-4684: - Thanks for the patch [~bibinchundatt]. One minor fix - instead

[jira] [Comment Edited] (YARN-4628) Display application priority in yarn top

2016-02-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142308#comment-15142308 ] Varun Vasudev edited comment on YARN-4628 at 2/11/16 6:32 AM: -- +1. Committed

[jira] [Updated] (YARN-4628) Display application priority in yarn top

2016-02-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4628: Summary: Display application priority in yarn top (was: TopCli to support Application priority ) >

[jira] [Updated] (YARN-4655) Log uncaught exceptions/errors in various thread pools in YARN

2016-02-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4655: Issue Type: Improvement (was: Bug) > Log uncaught exceptions/errors in various thread pools in YARN

[jira] [Commented] (YARN-4628) TopCli to support Application priority

2016-02-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140285#comment-15140285 ] Varun Vasudev commented on YARN-4628: - Thanks for the patch [~bibinchundatt]. Couple of things - 1)

[jira] [Commented] (YARN-4628) TopCli to support Application priority

2016-02-09 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140425#comment-15140425 ] Varun Vasudev commented on YARN-4628: - Good point [~sunilg]. Bibin, can you please change the

<    2   3   4   5   6   7   8   9   10   11   >