[jira] [Commented] (YARN-4684) TestYarnCLI#testGetContainers failing in trunk

2016-02-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15142731#comment-15142731 ] Varun Vasudev commented on YARN-4684: - +1. I'll commit this tomorrow if no one objects. >

[jira] [Updated] (YARN-4684) TestYarnCLI#testGetContainers failing in CN locale

2016-02-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4684: Summary: TestYarnCLI#testGetContainers failing in CN locale (was: TestYarnCLI#testGetContainers

[jira] [Commented] (YARN-4649) Add additional logging to some NM state store operations

2016-01-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123332#comment-15123332 ] Varun Vasudev commented on YARN-4649: - Thanks for the patch [~sidharta-s]. Some feedack - 1) Instead

[jira] [Updated] (YARN-4172) Extend DominantResourceCalculator to account for all resources

2016-01-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4172: Attachment: YARN-4172-YARN-3926.003.patch Uploaded a new patch which fixes javadoc error. > Extend

[jira] [Commented] (YARN-4307) Blacklisted nodes for AM container is not getting displayed in the Web UI

2016-02-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130247#comment-15130247 ] Varun Vasudev commented on YARN-4307: - +1 for the latest patch. I'll commit this tomorrow if no one

[jira] [Updated] (YARN-4307) Display blacklisted nodes for AM container in the RM web UI

2016-02-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4307: Summary: Display blacklisted nodes for AM container in the RM web UI (was: Blacklisted nodes for AM

[jira] [Commented] (YARN-4635) Add global blacklist tracking for AM container failure.

2016-02-04 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131938#comment-15131938 ] Varun Vasudev commented on YARN-4635: - I agree with [~jianhe] - 1) KILLED_EXCEEDED_PMEM and

[jira] [Commented] (YARN-4649) Add additional logging to some NM state store operations

2016-01-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125256#comment-15125256 ] Varun Vasudev commented on YARN-4649: - The single log line thing was to make grep and log parsing

[jira] [Commented] (YARN-4307) Blacklisted nodes for AM container is not getting displayed in the Web UI

2016-02-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127857#comment-15127857 ] Varun Vasudev commented on YARN-4307: - Thanks for the update Naga. Patch is almost there - couple of

[jira] [Commented] (YARN-4625) Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent

2016-02-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128350#comment-15128350 ] Varun Vasudev commented on YARN-4625: - +1 for the latest patch. I'll commit this tomorrow if no one

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-02-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127734#comment-15127734 ] Varun Vasudev commented on YARN-3998: - A couple of additional thoughts - I would like to restart

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-02-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127732#comment-15127732 ] Varun Vasudev commented on YARN-3998: - My apologies for the slow response [~hex108]. Thank you for your

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-02-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127937#comment-15127937 ] Varun Vasudev commented on YARN-3998: - {quote} getLocalPathForWrite is used for allocating a new

[jira] [Commented] (YARN-4665) Asynch submit can lose application submissions

2016-02-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130701#comment-15130701 ] Varun Vasudev commented on YARN-4665: - Jason's understanding on the REST API is correct - the user

[jira] [Commented] (YARN-4665) Asynch submit can lose application submissions

2016-02-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130847#comment-15130847 ] Varun Vasudev commented on YARN-4665: - {quote} IIUC here the concern is, as the app submission is

[jira] [Created] (YARN-4715) Add support to read resource types from a config file

2016-02-22 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4715: --- Summary: Add support to read resource types from a config file Key: YARN-4715 URL: https://issues.apache.org/jira/browse/YARN-4715 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: YARN-4715-YARN-3926.001.patch > Add support to read resource types from a config file >

[jira] [Reopened] (YARN-4709) NMWebServices produces incorrect JSON for containers

2016-02-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reopened YARN-4709: - Re-opening to fix resolution. > NMWebServices produces incorrect JSON for containers >

[jira] [Resolved] (YARN-4709) NMWebServices produces incorrect JSON for containers

2016-02-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev resolved YARN-4709. - Resolution: Fixed > NMWebServices produces incorrect JSON for containers >

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: YARN-4715-YARN-3926.002.patch Uploaded a new patch with fixes for checkstyle, findbugs

[jira] [Commented] (YARN-4731) container-executor should not follow symlinks in recursive_unlink_children

2016-02-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171084#comment-15171084 ] Varun Vasudev commented on YARN-4731: - Thanks for pointing out the TOCTOU vulnerability in my patch

[jira] [Updated] (YARN-4731) container-executor should not follow symlinks in recursive_unlink_children

2016-02-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4731: Assignee: Colin Patrick McCabe (was: Varun Vasudev) > container-executor should not follow symlinks

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: YARN-4715-YARN-3926.003.patch Thanks for the review [~leftnoteasy]. I've uploaded a new

[jira] [Assigned] (YARN-4731) Linux container executor fails to delete nmlocal folders

2016-02-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-4731: --- Assignee: Varun Vasudev > Linux container executor fails to delete nmlocal folders >

[jira] [Updated] (YARN-4731) Linux container executor fails to delete nmlocal folders

2016-02-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4731: Attachment: YARN-4731.001.patch Root cause here is that we are using fstat on an open fd. The open

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: YARN-4715-YARN-3926.004.patch After some further thought, I think it's just easier to

[jira] [Commented] (YARN-4737) Use CSRF Filter in YARN

2016-02-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172067#comment-15172067 ] Varun Vasudev commented on YARN-4737: - [~jmaron] - to my knowledge the only web UI that uses the web

[jira] [Comment Edited] (YARN-4737) Use CSRF Filter in YARN

2016-02-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172067#comment-15172067 ] Varun Vasudev edited comment on YARN-4737 at 2/29/16 4:11 PM: -- [~jmaron] - to

[jira] [Commented] (YARN-4731) Linux container executor fails to delete nmlocal folders

2016-02-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168814#comment-15168814 ] Varun Vasudev commented on YARN-4731: - The signal container exception and the container initalization

[jira] [Updated] (YARN-4709) Exception when option to fetch all log files is specified while using yarn logs -am command and incorrect JSON produced for containerLogFiles

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4709: Priority: Critical (was: Major) > Exception when option to fetch all log files is specified while

[jira] [Commented] (YARN-4709) Exception when option to fetch all log files is specified while using yarn logs -am command and incorrect JSON produced for containerLogFiles

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157135#comment-15157135 ] Varun Vasudev commented on YARN-4709: - +1 for the fix. My apologies for missing this. I'll commit this

[jira] [Commented] (YARN-4715) Add support to read resource types from a config file

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158293#comment-15158293 ] Varun Vasudev commented on YARN-4715: - Test failures are unrelated to the patch. > Add support to read

[jira] [Updated] (YARN-4709) NMWebServices produces incorrect JSON for containers

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4709: Summary: NMWebServices produces incorrect JSON for containers (was: NMWebServices produce incorrect

[jira] [Updated] (YARN-4709) NMWebServices produce incorrect JSON for containers

2016-02-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4709: Summary: NMWebServices produce incorrect JSON for containers (was: Exception when option to fetch

[jira] [Commented] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110918#comment-15110918 ] Varun Vasudev commented on YARN-4578: - The patch doesn't apply cleanly on trunk, there's a conflict in

[jira] [Commented] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110976#comment-15110976 ] Varun Vasudev commented on YARN-4578: - Latest patch applies cleanly. +1 pending jenkins. > Directories

[jira] [Commented] (YARN-4578) Directories that are mounted in docker containers need to be more restrictive/container-specific

2016-01-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112123#comment-15112123 ] Varun Vasudev commented on YARN-4578: - The test failure is unrelated. Committing this to trunk and

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2016-01-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.008.patch Uploaded a new version of the patch which also deprecates the

[jira] [Commented] (YARN-4307) Blacklisted nodes for AM container is not getting displayed in the Web UI

2016-01-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115210#comment-15115210 ] Varun Vasudev commented on YARN-4307: - My apologies for the delay Naga. Patch looks mostly good to me.

[jira] [Commented] (YARN-4555) TestDefaultContainerExecutor#testContainerLaunchError fails on non-englihsh locale environment

2016-01-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114830#comment-15114830 ] Varun Vasudev commented on YARN-4555: - Patch should work with docker as well, no issue from that end.

[jira] [Commented] (YARN-4625) Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent

2016-01-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118948#comment-15118948 ] Varun Vasudev commented on YARN-4625: - Thanks for the patch [~xgong]. Some comments 1) Can you please

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2016-01-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112422#comment-15112422 ] Varun Vasudev commented on YARN-3542: - The increase in javac warnings is due to the deprecation of the

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: (was: YARN-4715-YARN-3926.004.patch) > Add support to read resource types from a

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: YARN-4715-YARN-3926.005.patch Uploaded the an earlier patch by mistake. Attaching the

[jira] [Updated] (YARN-4715) Add support to read resource types from a config file

2016-02-29 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4715: Attachment: YARN-4715-YARN-3926.004.patch Uploaded a new patch with checkstyle fixes. > Add support

[jira] [Comment Edited] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189474#comment-15189474 ] Varun Vasudev edited comment on YARN-4785 at 3/10/16 4:05 PM: -- [~jhsenjaliya]

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189474#comment-15189474 ] Varun Vasudev commented on YARN-4785: - [~jhsenjaliya] - is this reproducable on your end? I'm unable to

[jira] [Comment Edited] (YARN-4829) Add support for binary units

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197449#comment-15197449 ] Varun Vasudev edited comment on YARN-4829 at 3/16/16 3:12 PM: -- Attached a file

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199524#comment-15199524 ] Varun Vasudev commented on YARN-4820: - bq. I was just looking at the redirect logic and noting it was

[jira] [Updated] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4785: Attachment: YARN-4785.branch-2.6.001.patch YARN-4785.branch-2.7.001.patch Thanks for

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193476#comment-15193476 ] Varun Vasudev commented on YARN-4785: - [~jhsenjaliya] - Sorry to annoy you about this - can you give me

[jira] [Created] (YARN-4811) Generate histograms for actual container resource usage

2016-03-14 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4811: --- Summary: Generate histograms for actual container resource usage Key: YARN-4811 URL: https://issues.apache.org/jira/browse/YARN-4811 Project: Hadoop YARN

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197763#comment-15197763 ] Varun Vasudev commented on YARN-3926: - bq. That should work... But I feel, maybe allow mismatch should

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Description: The RM has support for multiple resource types. The same should be added for the NMs.

[jira] [Created] (YARN-4829) Add support for binary units

2016-03-18 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4829: --- Summary: Add support for binary units Key: YARN-4829 URL: https://issues.apache.org/jira/browse/YARN-4829 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

2016-03-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192753#comment-15192753 ] Varun Vasudev commented on YARN-4807: - I'd prefer to start with Karthik's approach. Let's make the

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194926#comment-15194926 ] Varun Vasudev commented on YARN-4805: - [~kasha] - quick clarification - if we don't end up running

[jira] [Created] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4820: --- Summary: ResourceManager web redirects in HA mode drops query parameters Key: YARN-4820 URL: https://issues.apache.org/jira/browse/YARN-4820 Project: Hadoop YARN

[jira] [Updated] (YARN-4811) Generate histograms for actual container resource usage

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4811: Attachment: YARN-4811.001.patch Attached a patch adding support for histograms. > Generate

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195383#comment-15195383 ] Varun Vasudev commented on YARN-4785: - Thanks for the help [~jhsenjaliya]. I can reproduce it now. I'll

[jira] [Assigned] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-4785: --- Assignee: Varun Vasudev > inconsistent value type of the "type" field for LeafQueueInfo in

[jira] [Updated] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4785: Attachment: YARN-4785.001.patch Uploaded a patch with the fix. > inconsistent value type of the

[jira] [Commented] (YARN-4811) Generate histograms for actual container resource usage

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195753#comment-15195753 ] Varun Vasudev commented on YARN-4811: - [~jianhe], [~kasha] - can you guys review the patch? Thanks! >

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202664#comment-15202664 ] Varun Vasudev commented on YARN-4576: - bq. No. DISKS_FAILED mark on bad disks are transient status for

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.003.patch Good catch. Updated both of them. > Add support for

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196881#comment-15196881 ] Varun Vasudev commented on YARN-4785: - Thanks for the review [~djp]. I think there's definitely some

[jira] [Updated] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4820: Attachment: YARN-4820.001.patch Uploaded a patch with the fix. > ResourceManager web redirects in

[jira] [Commented] (YARN-4796) ContainerMetrics drops records

2016-03-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192215#comment-15192215 ] Varun Vasudev commented on YARN-4796: - [~templedf] - I think this got filed twice by mistake. YARN-4795

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218391#comment-15218391 ] Varun Vasudev commented on YARN-4882: - I vote for re-routing all recovery logs to a new file and only

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

2016-03-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218679#comment-15218679 ] Varun Vasudev commented on YARN-4882: - My view is that we should only log progress in the RM log. I

[jira] [Updated] (YARN-4884) Fix missing documentation about rmadmin command regarding node labels

2016-03-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4884: Summary: Fix missing documentation about rmadmin command regarding node labels (was: Missing

[jira] [Updated] (YARN-4884) Fix missing documentation about rmadmin command regarding node labels

2016-03-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4884: Fix Version/s: 2.9.0 > Fix missing documentation about rmadmin command regarding node labels >

[jira] [Updated] (YARN-4857) Add missing default configuration regarding preemption of CapacityScheduler

2016-03-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4857: Summary: Add missing default configuration regarding preemption of CapacityScheduler (was: Missing

[jira] [Commented] (YARN-4905) Improve Yarn log Command line option to show log metadata

2016-04-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15226389#comment-15226389 ] Varun Vasudev commented on YARN-4905: - Thanks for the patch [~xgong]. A few things - # If I don't have

[jira] [Comment Edited] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230349#comment-15230349 ] Varun Vasudev edited comment on YARN-4876 at 4/7/16 2:52 PM: - Thanks for the

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230349#comment-15230349 ] Varun Vasudev commented on YARN-4876: - Thanks for the document [~asuresh]! Here are my initial

[jira] [Updated] (YARN-4562) YARN WebApp ignores the configuration passed to it for keystore settings

2016-04-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4562: Assignee: Sergey Shelukhin > YARN WebApp ignores the configuration passed to it for keystore

[jira] [Commented] (YARN-4562) YARN WebApp ignores the configuration passed to it for keystore settings

2016-04-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15226905#comment-15226905 ] Varun Vasudev commented on YARN-4562: - [~sershe] - just to clarify - we add ssl-server.xml to the

[jira] [Commented] (YARN-4769) Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI

2016-04-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15227904#comment-15227904 ] Varun Vasudev commented on YARN-4769: - [~jianhe] - can you please review? Thanks! > Add support for

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-04-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15234983#comment-15234983 ] Varun Vasudev commented on YARN-3998: - Thanks for the patch [~hex108]. It looks good. Few things that

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-04-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235312#comment-15235312 ] Varun Vasudev commented on YARN-4876: - bq. I tend to agree with you, but my intention was to introduce

[jira] [Created] (YARN-4943) Add support to collect actual resource usage from cgroups

2016-04-11 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4943: --- Summary: Add support to collect actual resource usage from cgroups Key: YARN-4943 URL: https://issues.apache.org/jira/browse/YARN-4943 Project: Hadoop YARN

[jira] [Created] (YARN-4941) Dump container metrics to a log file when log-container-debug-info is enabled

2016-04-11 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4941: --- Summary: Dump container metrics to a log file when log-container-debug-info is enabled Key: YARN-4941 URL: https://issues.apache.org/jira/browse/YARN-4941 Project:

[jira] [Commented] (YARN-4909) Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter

2016-04-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237083#comment-15237083 ] Varun Vasudev commented on YARN-4909: - Couple of points about the patch - # Don't undo the JerseyTest

[jira] [Commented] (YARN-4909) Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter

2016-04-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237038#comment-15237038 ] Varun Vasudev commented on YARN-4909: - TestRMWebServices has been in the code for a long time. What's

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2016-04-12 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237156#comment-15237156 ] Varun Vasudev commented on YARN-4006: - [~gss2002] - have you gotten a chance to look at HADOOP-9054 and

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

2016-04-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15234683#comment-15234683 ] Varun Vasudev commented on YARN-4757: - I've created branch YARN-4757. > [Umbrella] Simplified

[jira] [Updated] (YARN-4941) Dump container metrics to a log file at the end of the container's lifecycle when log-container-debug-info is enabled

2016-04-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4941: Summary: Dump container metrics to a log file at the end of the container's lifecycle when

[jira] [Commented] (YARN-4941) Dump container metrics to a log file at the end of the container's lifecycle when log-container-debug-info is enabled

2016-04-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235476#comment-15235476 ] Varun Vasudev commented on YARN-4941: - I'd like to be able to see the container metrics as part of the

[jira] [Created] (YARN-4942) Dump timeline of container state transitions when log-container-debug-info is enabled

2016-04-11 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4942: --- Summary: Dump timeline of container state transitions when log-container-debug-info is enabled Key: YARN-4942 URL: https://issues.apache.org/jira/browse/YARN-4942

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197440#comment-15197440 ] Varun Vasudev commented on YARN-3926: - [~asuresh] - I was speaking with [~leftnoteasy] offline. I

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.002.patch Thanks for the review [~asuresh]! Uploaded a new patch

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.004.patch Uploaded a new patch fixing the test failure. > Add

[jira] [Updated] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4820: Attachment: YARN-4820.002.patch Uploaded a new patch to address the findbugs warnings. >

[jira] [Created] (YARN-4830) Add support for resource types in the nodemanager

2016-03-19 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4830: --- Summary: Add support for resource types in the nodemanager Key: YARN-4830 URL: https://issues.apache.org/jira/browse/YARN-4830 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197235#comment-15197235 ] Varun Vasudev commented on YARN-4820: - [~steve_l] - sorry I didn't understand the case you mentioned.

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Component/s: (was: resourcemanager) > Add support for resource types in the nodemanager >

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200878#comment-15200878 ] Varun Vasudev commented on YARN-4829: - [~asuresh] - can you take a look at the latest patch and commit

[jira] [Updated] (YARN-4829) Add support for binary units

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4829: Attachment: YARN-4829-YARN-3926.001.patch Attached a file with the fix. > Add support for binary

[jira] [Comment Edited] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197763#comment-15197763 ] Varun Vasudev edited comment on YARN-3926 at 3/16/16 5:41 PM: -- bq. That should

<    3   4   5   6   7   8   9   10   11   12   >