[jira] [Commented] (YARN-4687) Document Reservation ACLs

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184651#comment-15184651 ] Hadoop QA commented on YARN-4687: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-4763) RMApps Page crashes with NPE

2016-03-08 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184713#comment-15184713 ] sandflee commented on YARN-4763: yes, thanks for pointing this > RMApps Page crashes with

[jira] [Commented] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184752#comment-15184752 ] Steve Loughran commented on YARN-4721: -- I'm trying to say, the test is "if this cluste

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-03-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184809#comment-15184809 ] Junping Du commented on YARN-3998: -- Thanks [~hex108] for the patch. In addition, I think w

[jira] [Commented] (YARN-4725) [Umbrella] Auto-­restart of containers

2016-03-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184821#comment-15184821 ] Junping Du commented on YARN-4725: -- For the same requirement, can we implement this in ano

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-03-08 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184952#comment-15184952 ] Jun Gong commented on YARN-3998: We could specify retry policy to RETRY_ON_SPECIFIC_ERROR_C

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-03-08 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184951#comment-15184951 ] Jun Gong commented on YARN-3998: We could specify retry policy to RETRY_ON_SPECIFIC_ERROR_C

[jira] [Created] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2016-03-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4771: Summary: Some containers can be skipped during log aggregation after NM restart Key: YARN-4771 URL: https://issues.apache.org/jira/browse/YARN-4771 Project: Hadoop YARN

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-03-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184968#comment-15184968 ] Junping Du commented on YARN-3998: -- bq. We could specify retry policy to RETRY_ON_SPECIFIC

[jira] [Created] (YARN-4772) Overloaded leveljb can crash the ATS "pthread lock: Invalid argument"

2016-03-08 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4772: Summary: Overloaded leveljb can crash the ATS "pthread lock: Invalid argument" Key: YARN-4772 URL: https://issues.apache.org/jira/browse/YARN-4772 Project: Hadoop YAR

[jira] [Commented] (YARN-4772) Overloaded leveljb can crash the ATS "pthread lock: Invalid argument"

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184976#comment-15184976 ] Steve Loughran commented on YARN-4772: -- Linking to the ATS1-5 work, as this was in the

[jira] [Commented] (YARN-4772) Overloaded leveljb can crash the ATS "pthread lock: Invalid argument"

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184981#comment-15184981 ] Steve Loughran commented on YARN-4772: -- tail of the logs. Looking at the slf4j messag

[jira] [Updated] (YARN-4772) Overloaded leveljb can crash the ATS "pthread lock: Invalid argument"

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4772: - Priority: Minor (was: Major) > Overloaded leveljb can crash the ATS "pthread lock: Invalid argumen

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2016-03-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184991#comment-15184991 ] Jason Lowe commented on YARN-4771: -- The problem occurs because removeVeryOldStoppedContain

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2016-03-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184992#comment-15184992 ] Naganarasimha G R commented on YARN-3122: - Hi [~adhoot] & [~kasha], I had one query

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2016-03-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4771: - Attachment: YARN-4771.001.patch Simple patch which preserves the container as long as the application is st

[jira] [Created] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

2016-03-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4773: Summary: Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled Key: YARN-4773 URL: https://issues.apache.org/jira/browse/YARN-4773

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch Patch that uses NodeFilter to keep non-node-tracking logic out of

[jira] [Updated] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

2016-03-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4773: - Affects Version/s: (was: 2.7.2) 2.6.0 Target Version/s: (was: 2.7.3) > Lo

[jira] [Created] (YARN-4774) ATS can block in shutdown under heavy load

2016-03-08 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4774: Summary: ATS can block in shutdown under heavy load Key: YARN-4774 URL: https://issues.apache.org/jira/browse/YARN-4774 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185015#comment-15185015 ] Naganarasimha G R commented on YARN-4712: - On second thoughts if no one is testing

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185037#comment-15185037 ] Hadoop QA commented on YARN-4719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-4.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch > Add a helper library to maintain node state and allows common q

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185059#comment-15185059 ] Hadoop QA commented on YARN-4719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: (was: yarn-4719-4.patch) > Add a helper library to maintain node state and allo

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-4.patch > Add a helper library to maintain node state and allows common q

[jira] [Created] (YARN-4775) Nodemanager checks for old aggregated logs as the NM user instead of the app user

2016-03-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4775: Summary: Nodemanager checks for old aggregated logs as the NM user instead of the app user Key: YARN-4775 URL: https://issues.apache.org/jira/browse/YARN-4775 Project: Hadoop

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2016-03-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4771: - Attachment: YARN-4771.002.patch Updated patch to fix the unit test in case it's useful. > Some containers

[jira] [Updated] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-03-08 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-4768: - Attachment: YARN-4768.patch Patch for trunk. Also changed getPhysicalMemorySize() to exclude: - Ha

[jira] [Commented] (YARN-4772) Overloaded leveljb can crash the ATS "pthread lock: Invalid argument"

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185138#comment-15185138 ] Steve Loughran commented on YARN-4772: -- Assuming this is teardown, the root cause is t

[jira] [Created] (YARN-4776) Report container metrics back to the RM

2016-03-08 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4776: --- Summary: Report container metrics back to the RM Key: YARN-4776 URL: https://issues.apache.org/jira/browse/YARN-4776 Project: Hadoop YARN Issue Type: Improveme

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-08 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185215#comment-15185215 ] Giovanni Matteo Fumarola commented on YARN-4117: I just ran all the tests t

[jira] [Created] (YARN-4777) Retrospect Non-Existent Queue check and its error handling while submitting a new application

2016-03-08 Thread Sunil G (JIRA)
Sunil G created YARN-4777: - Summary: Retrospect Non-Existent Queue check and its error handling while submitting a new application Key: YARN-4777 URL: https://issues.apache.org/jira/browse/YARN-4777 Project:

[jira] [Updated] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4746: --- Attachment: 0002-YARN-4746.patch Attaching patch for review after updation. # BadRequestExcepti

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185229#comment-15185229 ] Hadoop QA commented on YARN-4768: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4777) Retrospect Non-Existent Queue check and its error handling while submitting a new application

2016-03-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185242#comment-15185242 ] Bibin A Chundatt commented on YARN-4777: Jira title can we update ? > Retrospect N

[jira] [Commented] (YARN-4777) Retrospect Non-Existent Queue check and its error handling while submitting a new application

2016-03-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185251#comment-15185251 ] Sunil G commented on YARN-4777: --- Yes [~bibinchundatt] It will be for all common queue related

[jira] [Commented] (YARN-4777) Retrospect Non-Existent Queue check and its error handling while submitting a new application

2016-03-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185237#comment-15185237 ] Bibin A Chundatt commented on YARN-4777: [~sunilg] IIUC this jira is not only for n

[jira] [Commented] (YARN-4777) Retrospect Non-Existent Queue check and its error handling while submitting a new application

2016-03-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185253#comment-15185253 ] Sunil G commented on YARN-4777: --- Yes.I will update the same. > Retrospect Non-Existent Queue

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185261#comment-15185261 ] Steve Loughran commented on YARN-4696: -- BTW, I managed to create an exception in scale

[jira] [Updated] (YARN-4777) Retrospect Queue related validation and its error handling while submitting a new application

2016-03-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4777: -- Summary: Retrospect Queue related validation and its error handling while submitting a new application (was: Ret

[jira] [Updated] (YARN-4777) Retrospect Queue related validation and its error handling while submitting a new application

2016-03-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4777: -- Description: After YARN-4764, non-existent-queue scenarios while submission of new application will be same for

[jira] [Commented] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

2016-03-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185401#comment-15185401 ] Ming Ma commented on YARN-4773: --- [~jlowe], can you please confirm if it has been fixed by YAR

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185411#comment-15185411 ] Hadoop QA commented on YARN-4719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3863) Support complex filters in TimelineReader

2016-03-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185424#comment-15185424 ] Varun Saxena commented on YARN-3863: [~sjlee0], bq. But I think the behavior hasn't ch

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185588#comment-15185588 ] Varun Saxena commented on YARN-4712: >From the example, it seems it does make more sens

[jira] [Updated] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

2016-03-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-868: - Attachment: YARN-868.0003.patch [~varun_saxena] Sorry - this completely dropped off my radar. Looking at the

[jira] [Commented] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

2016-03-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185618#comment-15185618 ] Hitesh Shah commented on YARN-868: -- [~varun_saxena] to add to your previous comment, yes an

[jira] [Commented] (YARN-4233) YARN Timeline Service plugin: ATS v1.5

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185620#comment-15185620 ] Steve Loughran commented on YARN-4233: -- HADOOP-12906 shows that AuthenticatedURL isn't

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-013.patch Patch -013, "special scale edition" # the various log enum & check

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185680#comment-15185680 ] Steve Loughran commented on YARN-4696: -- hi, I'll reply to these later; the current pat

[jira] [Updated] (YARN-4767) Network issues can cause persistent RM UI outage

2016-03-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4767: --- Attachment: YARN-4767.001.patch Here's a patch that resolves the issue. The general idea is co

[jira] [Commented] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

2016-03-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185685#comment-15185685 ] Hitesh Shah commented on YARN-868: -- Sorry - mixed contents on the previous comments. There

[jira] [Commented] (YARN-4773) Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled

2016-03-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185757#comment-15185757 ] Jason Lowe commented on YARN-4773: -- It is not fixed by YARN-4720 since this is a listStatu

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

2016-03-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185803#comment-15185803 ] Arun Suresh commented on YARN-2883: --- [~kkaranasos], Kindly rebase the patch against updat

[jira] [Updated] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4764: -- Target Version/s: 2.9.0 > Application submission fails when submitted queue is not available in > scheduler xml

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: YARN-4108.5.patch Attached ver.5 patch, sync to latest trunk, fixed test failures and findbug

[jira] [Updated] (YARN-2883) Queuing of container requests in the NM

2016-03-08 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2883: - Attachment: YARN-2883-yarn-2877.004.patch Rebasing patch against current yarn-2877

[jira] [Commented] (YARN-4634) Scheduler UI/Metrics need to consider cases like non-queue label mappings

2016-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185986#comment-15185986 ] Wangda Tan commented on YARN-4634: -- [~sunilg], It seems: {code} if (null == nod

[jira] [Commented] (YARN-4764) Application submission fails when submitted queue is not available in scheduler xml

2016-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185995#comment-15185995 ] Hudson commented on YARN-4764: -- FAILURE: Integrated in Hadoop-trunk-Commit #9444 (See [https:

[jira] [Commented] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2016-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185997#comment-15185997 ] Hudson commented on YARN-4465: -- FAILURE: Integrated in Hadoop-trunk-Commit #9444 (See [https:

[jira] [Moved] (YARN-4778) Support specifying resources for task containers in SLS

2016-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan moved HADOOP-12907 to YARN-4778: --- Key: YARN-4778 (was: HADOOP-12907) Project: Hadoop YARN (was: Hadoop

[jira] [Created] (YARN-4779) Fix AM container allocation logic in SLS

2016-03-08 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4779: Summary: Fix AM container allocation logic in SLS Key: YARN-4779 URL: https://issues.apache.org/jira/browse/YARN-4779 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-4780) TestDistributedShell breaks in trunk

2016-03-08 Thread Li Lu (JIRA)
Li Lu created YARN-4780: --- Summary: TestDistributedShell breaks in trunk Key: YARN-4780 URL: https://issues.apache.org/jira/browse/YARN-4780 Project: Hadoop YARN Issue Type: Bug Components: ap

[jira] [Updated] (YARN-4778) Support specifying resources for task containers in SLS

2016-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4778: - Issue Type: Improvement (was: New Feature) > Support specifying resources for task containers in SLS > ---

[jira] [Updated] (YARN-4778) Support specifying resources for task containers in SLS

2016-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4778: - Attachment: YARN-4778.1.patch Attached ver.1 patch for review. > Support specifying resources for task con

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

2016-03-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186042#comment-15186042 ] Arun Suresh commented on YARN-2883: --- The latest patch looks fine to me (pending whitespac

[jira] [Updated] (YARN-4779) Fix AM container allocation logic in SLS

2016-03-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4779: - Attachment: YARN-4779.1.patch Attached initial patch for review. > Fix AM container allocation logic in SL

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186090#comment-15186090 ] Hadoop QA commented on YARN-4696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Resolved] (YARN-4780) TestDistributedShell breaks in trunk

2016-03-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-4780. - Resolution: Cannot Reproduce Oops, I can no longer reproduce this after a machine restart... Seems like a false al

[jira] [Resolved] (YARN-1772) Fair Scheduler documentation should indicate that admin ACLs also give submit permissions

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1772. Resolution: Not A Problem > Fair Scheduler documentation should indicate that admin ACLs also

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-03-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186126#comment-15186126 ] Wilfred Spiegelenburg commented on YARN-4767: - In the current proxy code we hav

[jira] [Updated] (YARN-4713) Warning by unchecked conversion in TestTimelineWebServices

2016-03-08 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-4713: --- Attachment: YARN-4713.1.patch > Warning by unchecked conversion in TestTimelineWebServices > -

[jira] [Assigned] (YARN-4698) Negative value in RM UI counters due to double container release

2016-03-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-4698: --- Assignee: Wilfred Spiegelenburg > Negative value in RM UI counters due to doub

[jira] [Resolved] (YARN-4698) Negative value in RM UI counters due to double container release

2016-03-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-4698. - Resolution: Duplicate This is the same as described in YARN-3933. It handles the ca

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-5.patch v5 patch addresses javac and checkstyle warnings. > Add a helpe

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within a leaf queue

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4333: --- Summary: Fair scheduler should support preemption within a leaf queue (was: Fair scheduler sho

[jira] [Created] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2016-03-08 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4781: Summary: Support intra-queue preemption for fairness ordering policy. Key: YARN-4781 URL: https://issues.apache.org/jira/browse/YARN-4781 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4732) *ProcessTree classes have too many whitespace issues

2016-03-08 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-4732: --- Attachment: YARN-4732.1.patch > *ProcessTree classes have too many whitespace issues >

[jira] [Updated] (YARN-4732) *ProcessTree classes have too many whitespace issues

2016-03-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4732: - Assignee: Gabor Liptak (was: Haibo Chen) > *ProcessTree classes have too many whitespace issues >

[jira] [Commented] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186273#comment-15186273 ] Karthik Kambatla commented on YARN-1961: Configuring minResources and minshare pree

[jira] [Updated] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1961: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > Fair scheduler preempti

[jira] [Created] (YARN-4782) Change signal container invocation to use a command/config file mechanism

2016-03-08 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-4782: --- Summary: Change signal container invocation to use a command/config file mechanism Key: YARN-4782 URL: https://issues.apache.org/jira/browse/YARN-4782 Project:

[jira] [Resolved] (YARN-3414) FairScheduler's preemption may cause livelock

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-3414. Resolution: Duplicate > FairScheduler's preemption may cause livelock > -

[jira] [Updated] (YARN-3414) FairScheduler's preemption may cause livelock

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3414: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > FairScheduler's preempt

[jira] [Updated] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4134: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4752) > FairScheduler preemptio

[jira] [Commented] (YARN-3863) Support complex filters in TimelineReader

2016-03-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186298#comment-15186298 ] Sangjin Lee commented on YARN-3863: --- {quote} Maybe we support both and let user specify i

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186306#comment-15186306 ] Sangjin Lee commented on YARN-4736: --- bq. BufferedMutatorImpl#flush() appeared in stack tr

[jira] [Updated] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-03-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4545: Attachment: YARN-4545-trunk.006.patch Patch 006 to address review comments. Specifically, I've added a customized an

[jira] [Created] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2016-03-08 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created YARN-4783: Summary: Log aggregation failure for application when Nodemanager is restarted Key: YARN-4783 URL: https://issues.apache.org/jira/browse/YARN-4783 Pr

[jira] [Commented] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2016-03-08 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186322#comment-15186322 ] Surendra Singh Lilhore commented on YARN-4783: -- {noformat} ecretManager$Invali

[jira] [Commented] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

2016-03-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186366#comment-15186366 ] Hitesh Shah commented on YARN-868: -- Removed patch 3 for now - discovered basic errors/wrong

[jira] [Updated] (YARN-868) YarnClient should set the service address in tokens returned by getRMDelegationToken()

2016-03-08 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-868: - Attachment: (was: YARN-868.0003.patch) > YarnClient should set the service address in tokens returned by

[jira] [Updated] (YARN-4738) Notify the RM about the status of OPPORTUNISTIC containers

2016-03-08 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-4738: - Attachment: YARN-4738-yarn-2877.001.patch Adding first version of the patch for thi

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186463#comment-15186463 ] Karthik Kambatla commented on YARN-3054: [~peng.zhang] - the problem reported is no

[jira] [Commented] (YARN-4779) Fix AM container allocation logic in SLS

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186468#comment-15186468 ] Hadoop QA commented on YARN-4779: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-08 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186492#comment-15186492 ] Peng Zhang commented on YARN-3054: -- Preemption happened on low priority container, and for

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186504#comment-15186504 ] Hadoop QA commented on YARN-2883: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4732) *ProcessTree classes have too many whitespace issues

2016-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15186516#comment-15186516 ] Hadoop QA commented on YARN-4732: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

  1   2   >