[jira] [Updated] (YARN-4687) Document Reservation ACLs

2016-03-07 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4687: -- Attachment: YARN-4687.v3.patch Addressing mvn site issue by escaping > and < characters. > Document Reservation

[jira] [Commented] (YARN-4715) Add support to read resource types from a config file

2016-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184497#comment-15184497 ] Wangda Tan commented on YARN-4715: -- Patch looks good, +1, thanks [~vvasudev]. > Add support to read

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184479#comment-15184479 ] Jian He commented on YARN-4764: --- Makes sense to me, thank you for the summarization ! > Application

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184445#comment-15184445 ] Bibin A Chundatt commented on YARN-4764: [~sunilg]/[~jianhe] Thank you for discussing with

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184440#comment-15184440 ] Sunil G commented on YARN-4764: --- Thanks [~bibinchundatt] for the analysis and suggestions.. I will try

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184420#comment-15184420 ] Hadoop QA commented on YARN-4117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184400#comment-15184400 ] Naganarasimha G R commented on YARN-4712: - Thanks [~sjlee0] for the clarification with example and

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184269#comment-15184269 ] Sangjin Lee commented on YARN-4062: --- Sorry [~vrushalic] it took a while to get to this. It looks good for

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184254#comment-15184254 ] Bibin A Chundatt commented on YARN-4764: # Also only for capacity scheduler we will be doing

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184239#comment-15184239 ] Bibin A Chundatt commented on YARN-4764: [~jianhe] # The behaviour will be not be same as previous

[jira] [Commented] (YARN-4770) Auto-restart of containers should work across NM restarts.

2016-03-07 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184195#comment-15184195 ] Jun Gong commented on YARN-4770: Thanks [~vinodkv] for reporting the issue. The patch in YARN-3998 should

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-03-07 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184167#comment-15184167 ] Jun Gong commented on YARN-3998: Thanks [~vvasudev] and [~vinodkv] for the comments and suggestions. I will

[jira] [Commented] (YARN-4687) Document Reservation ACLs

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184153#comment-15184153 ] Hadoop QA commented on YARN-4687: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: YARN-4117.v2.patch > End to end unit test with mini YARN cluster

[jira] [Commented] (YARN-4687) Document Reservation ACLs

2016-03-07 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184047#comment-15184047 ] Sean Po commented on YARN-4687: --- Thanks for the review and comments [~asuresh], I've updated the patch with

[jira] [Updated] (YARN-4687) Document Reservation ACLs

2016-03-07 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4687: -- Attachment: YARN-4687.v2.patch > Document Reservation ACLs > - > > Key:

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183990#comment-15183990 ] Li Lu commented on YARN-4696: - Reformatting the previous comment: FileSystemTimelineWriter.java -

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183986#comment-15183986 ] Li Lu commented on YARN-4696: - Thanks [~ste...@apache.org] for the work! Mostly LGTM, only a few nits:

[jira] [Updated] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-1547: --- Attachment: YARN-1547.pdf > Prevent DoS of ApplicationMasterProtocol by

[jira] [Commented] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2016-03-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183684#comment-15183684 ] Vinod Kumar Vavilapalli commented on YARN-4721: --- bq. rather than the more fundamental "your

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-03-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183634#comment-15183634 ] Vinod Kumar Vavilapalli commented on YARN-3998: --- Okay, seems like we are in general

[jira] [Created] (YARN-4770) Auto-restart of containers should work across NM restarts.

2016-03-07 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-4770: - Summary: Auto-restart of containers should work across NM restarts. Key: YARN-4770 URL: https://issues.apache.org/jira/browse/YARN-4770 Project:

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183611#comment-15183611 ] Sangjin Lee commented on YARN-4712: --- My main concern with using {{cpuUsageTotalCoresPercentage}} is about

[jira] [Commented] (YARN-4762) NMs failing on DelegatingLinuxContainerRuntime init with LCE on

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183596#comment-15183596 ] Hudson commented on YARN-4762: -- FAILURE: Integrated in Hadoop-trunk-Commit #9437 (See

[jira] [Commented] (YARN-4762) NMs failing on DelegatingLinuxContainerRuntime init with LCE on

2016-03-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183592#comment-15183592 ] Sidharta Seethana commented on YARN-4762: - Thanks, [~vinodkv] ! > NMs failing on

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183545#comment-15183545 ] Jian He commented on YARN-4764: --- bq. Is it better if we throw exception for CS in

[jira] [Commented] (YARN-4761) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler

2016-03-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183466#comment-15183466 ] Sangjin Lee commented on YARN-4761: --- Thanks [~zxu]! > NMs reconnecting with changed capabilities can

[jira] [Commented] (YARN-4762) NMs failing on DelegatingLinuxContainerRuntime init with LCE on

2016-03-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183459#comment-15183459 ] Vinod Kumar Vavilapalli commented on YARN-4762: --- The latest patch looks good to me, +1.

[jira] [Commented] (YARN-4687) Document Reservation ACLs

2016-03-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183432#comment-15183432 ] Arun Suresh commented on YARN-4687: --- Thanks for the patch [~seanpo03]. Couple of nits : * In the

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183401#comment-15183401 ] Steve Loughran commented on YARN-4696: -- ignore the comment about numbers for now, something

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183380#comment-15183380 ] Hadoop QA commented on YARN-4764: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183343#comment-15183343 ] Varun Saxena commented on YARN-4712: Thanks [~Naganarasimha] for the patch. bq. IMO

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183328#comment-15183328 ] Karthik Kambatla commented on YARN-4719: Oh, and when the NodeFilter is null or an "IdentityFilter"

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183324#comment-15183324 ] Karthik Kambatla commented on YARN-4719: bq. I may not understand about this, could you elaborate?

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183256#comment-15183256 ] Sunil G commented on YARN-4764: --- [~bibinchundatt] and [~jianhe] Is it better if we throw exception for CS in

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183235#comment-15183235 ] Steve Loughran commented on YARN-4696: -- I should add that now I've started with some scale tests, my

[jira] [Commented] (YARN-4760) proxy redirect to history server uses wrong URL

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183186#comment-15183186 ] Hudson commented on YARN-4760: -- FAILURE: Integrated in Hadoop-trunk-Commit #9435 (See

[jira] [Commented] (YARN-4760) proxy redirect to history server uses wrong URL

2016-03-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183169#comment-15183169 ] Jason Lowe commented on YARN-4760: -- +1 lgtm. Committing this. > proxy redirect to history server uses

[jira] [Updated] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4764: --- Attachment: 0002-YARN-4764.patch Attaching patch with testcase. Skipping acl check when

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-012.patch Patch 012. This is what I've been successfully using in tests

[jira] [Commented] (YARN-4245) Clean up container-executor invocation interface

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182884#comment-15182884 ] Hudson commented on YARN-4245: -- FAILURE: Integrated in Hadoop-trunk-Commit #9432 (See

[jira] [Commented] (YARN-4737) Add CSRF filter support in YARN

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182827#comment-15182827 ] Hudson commented on YARN-4737: -- FAILURE: Integrated in Hadoop-trunk-Commit #9431 (See

[jira] [Created] (YARN-4769) Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI

2016-03-07 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4769: --- Summary: Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI Key: YARN-4769 URL: https://issues.apache.org/jira/browse/YARN-4769

[jira] [Updated] (YARN-4737) Add CSRF filter support in YARN

2016-03-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4737: Summary: Add CSRF filter support in YARN (was: Use CSRF Filter in YARN) > Add CSRF filter support

[jira] [Commented] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2016-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182810#comment-15182810 ] Steve Loughran commented on YARN-4721: -- this patch, initially, sets up kerberos diagnostics without