[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829761#comment-13829761 ] Sandy Ryza commented on YARN-1434: -- This seems possible. To further spell this out: Imagi

[jira] [Updated] (YARN-1404) Enable external systems/frameworks to share resources with Hadoop leveraging Yarn resource scheduling

[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1404: - Description: Currently Hadoop Yarn expects to manage the lifecycle of the processes its a

[jira] [Commented] (YARN-1404) Enable external systems/frameworks to share resources with Hadoop leveraging Yarn resource scheduling

[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829640#comment-13829640 ] Alejandro Abdelnur commented on YARN-1404: -- The proposal to address this JIRA is:

[jira] [Resolved] (YARN-951) Add hard minimum resource capabilities for container launching

[ https://issues.apache.org/jira/browse/YARN-951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved YARN-951. - Resolution: Won't Fix > Add hard minimum resource capabilities for container launching > --

[jira] [Commented] (YARN-954) [YARN-321] History Service should create the webUI and wire it to HistoryStorage

[ https://issues.apache.org/jira/browse/YARN-954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829632#comment-13829632 ] Vinod Kumar Vavilapalli commented on YARN-954: -- Looked at the patch, mostly loo

[jira] [Updated] (YARN-946) Adding HDFS implementation for History Reader Interface

[ https://issues.apache.org/jira/browse/YARN-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-946: - Summary: Adding HDFS implementation for History Reader Interface (was: Adding HDFS

[jira] [Updated] (YARN-1436) ZKRMStateStore should have separate configuration for retry period.

[ https://issues.apache.org/jira/browse/YARN-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1436: Affects Version/s: 2.2.1 > ZKRMStateStore should have separate configuration for retry perio

[jira] [Updated] (YARN-1436) ZKRMStateStore should have separate configuration for retry period.

[ https://issues.apache.org/jira/browse/YARN-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1436: Component/s: resourcemanager > ZKRMStateStore should have separate configuration for retry p

[jira] [Created] (YARN-1436) ZKRMStateStore should have separate configuration for retry period.

Omkar Vinit Joshi created YARN-1436: --- Summary: ZKRMStateStore should have separate configuration for retry period. Key: YARN-1436 URL: https://issues.apache.org/jira/browse/YARN-1436 Project: Hadoop

[jira] [Updated] (YARN-1266) Implement PB service and client wrappers for ApplicationHistoryProtocol

[ https://issues.apache.org/jira/browse/YARN-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1266: -- Summary: Implement PB service and client wrappers for ApplicationHistoryProtocol

[jira] [Commented] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829551#comment-13829551 ] Xuan Gong commented on YARN-1314: - Did test on single node cluster: Using --shell_command e

[jira] [Commented] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829542#comment-13829542 ] Hadoop QA commented on YARN-1314: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829531#comment-13829531 ] Xuan Gong commented on YARN-1314: - Increasing the --num_container numbers to let test case

[jira] [Updated] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1314: Attachment: YARN-1314.5.patch > Cannot pass more than 1 argument to shell command >

[jira] [Updated] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1314: Attachment: YARN-1314.4.1.patch > Cannot pass more than 1 argument to shell command > --

[jira] [Updated] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1314: Attachment: YARN-1314.4.patch fix test case failure > Cannot pass more than 1 argument to shell command > -

[jira] [Commented] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829518#comment-13829518 ] Hadoop QA commented on YARN-1314: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1435) Distributed Shell should not run other commands except "sh", and run the custom script at the same time.

[ https://issues.apache.org/jira/browse/YARN-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829511#comment-13829511 ] Xuan Gong commented on YARN-1435: - We could let DS either execute shell_commands option or

[jira] [Updated] (YARN-1435) Distributed Shell should not run other commands except "sh", and run the custom script at the same time.

[ https://issues.apache.org/jira/browse/YARN-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1435: Description: Currently, if we want to run custom script at DS. We can do it like this : --shell_command sh -

[jira] [Updated] (YARN-1435) Distributed Shell should not run other commands except "sh", and run the custom script at the same time.

[ https://issues.apache.org/jira/browse/YARN-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1435: Summary: Distributed Shell should not run other commands except "sh", and run the custom script at the same

[jira] [Commented] (YARN-1435) Custom script cannot be run because it lacks of executable bit at container level

[ https://issues.apache.org/jira/browse/YARN-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829506#comment-13829506 ] Xuan Gong commented on YARN-1435: - Currently, if we want to run custom script at DS. We can

[jira] [Assigned] (YARN-1435) Custom script cannot be run because it lacks of executable bit at container level

[ https://issues.apache.org/jira/browse/YARN-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1435: --- Assignee: Xuan Gong > Custom script cannot be run because it lacks of executable bit at container > l

[jira] [Updated] (YARN-1314) Cannot pass more than 1 argument to shell command

[ https://issues.apache.org/jira/browse/YARN-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1314: Attachment: YARN-1314.3.patch 1.Using the same approach as YARN-1303. Basically, create a file that will s

[jira] [Commented] (YARN-1266) inheriting Application client and History Protocol from base protocol and implement PB service and clients.

[ https://issues.apache.org/jira/browse/YARN-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829495#comment-13829495 ] Hadoop QA commented on YARN-1266: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1266) inheriting Application client and History Protocol from base protocol and implement PB service and clients.

[ https://issues.apache.org/jira/browse/YARN-1266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-1266: Attachment: YARN-1266-6.patch Thanks [~vinodkv] for review. I agree with you. I am updating the pa

[jira] [Commented] (YARN-955) [YARN-321] Implementation of ApplicationHistoryProtocol

[ https://issues.apache.org/jira/browse/YARN-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829490#comment-13829490 ] Zhijie Shen commented on YARN-955: -- bq. As discussed , We will do the changes as part of YA

[jira] [Commented] (YARN-955) [YARN-321] Implementation of ApplicationHistoryProtocol

[ https://issues.apache.org/jira/browse/YARN-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829488#comment-13829488 ] Mayank Bansal commented on YARN-955: As discussed , We will do the changes as part of YA

[jira] [Commented] (YARN-1320) Custom log4j properties in Distributed shell does not work properly.

[ https://issues.apache.org/jira/browse/YARN-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829467#comment-13829467 ] Hudson commented on YARN-1320: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4784 (See [https:

[jira] [Created] (YARN-1435) Custom script cannot be run because it lacks of executable bit at container level

Tassapol Athiapinya created YARN-1435: - Summary: Custom script cannot be run because it lacks of executable bit at container level Key: YARN-1435 URL: https://issues.apache.org/jira/browse/YARN-1435

[jira] [Commented] (YARN-1430) InvalidStateTransition exceptions are ignored in state machines

[ https://issues.apache.org/jira/browse/YARN-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829018#comment-13829018 ] Jason Lowe commented on YARN-1430: -- Before flipping the switch to change this, we need to

[jira] [Commented] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829407#comment-13829407 ] Hadoop QA commented on YARN-1416: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1430) InvalidStateTransition exceptions are ignored in state machines

[ https://issues.apache.org/jira/browse/YARN-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829400#comment-13829400 ] Omkar Vinit Joshi commented on YARN-1430: - I think for now we should add assert sta

[jira] [Commented] (YARN-1426) YARN Components need to unregister their beans upon shutdown

[ https://issues.apache.org/jira/browse/YARN-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829381#comment-13829381 ] Jonathan Eagles commented on YARN-1426: --- Test failures: - TestJobCleanup is from MA

[jira] [Updated] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1416: -- Attachment: YARN-1416.2.patch > InvalidStateTransitions getting reported in multiple test cases even though > t

[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829377#comment-13829377 ] Carlo Curino commented on YARN-1434: This has been observed while modifying the mapredu

[jira] [Created] (YARN-1434) Single Job can affect fairshare of others

Carlo Curino created YARN-1434: -- Summary: Single Job can affect fairshare of others Key: YARN-1434 URL: https://issues.apache.org/jira/browse/YARN-1434 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1430) InvalidStateTransition exceptions are ignored in state machines

[ https://issues.apache.org/jira/browse/YARN-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829087#comment-13829087 ] Zhijie Shen commented on YARN-1430: --- Personally, I think ignoring InvalidStateTransition

[jira] [Updated] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1416: -- Attachment: YARN-1416.2.patch > InvalidStateTransitions getting reported in multiple test cases even though > t

[jira] [Commented] (YARN-1425) TestRMRestart fails because MockRM.waitForState(AttemptId) uses current attempt instead of the attempt passed as argument

[ https://issues.apache.org/jira/browse/YARN-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828916#comment-13828916 ] Hudson commented on YARN-1425: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1589 (See [https://

[jira] [Commented] (YARN-149) ResourceManager (RM) High-Availability (HA)

[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828948#comment-13828948 ] Steve Loughran commented on YARN-149: - I want to warn that HADOOP-9905 is going to drop

[jira] [Commented] (YARN-1053) Diagnostic message from ContainerExitEvent is ignored in ContainerImpl

[ https://issues.apache.org/jira/browse/YARN-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828930#comment-13828930 ] Hudson commented on YARN-1053: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1615 (See [htt

[jira] [Commented] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829306#comment-13829306 ] Hadoop QA commented on YARN-1416: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-1432) Reduce phase is failing with shuffle error in kerberos enabled cluster

Ramgopal N created YARN-1432: Summary: Reduce phase is failing with shuffle error in kerberos enabled cluster Key: YARN-1432 URL: https://issues.apache.org/jira/browse/YARN-1432 Project: Hadoop YARN

[jira] [Commented] (YARN-1412) Allocating Containers on a particular Node in Yarn

[ https://issues.apache.org/jira/browse/YARN-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829264#comment-13829264 ] gaurav gupta commented on YARN-1412: Yes All the nodes are on the same Rack. Here is t

[jira] [Commented] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829257#comment-13829257 ] Hadoop QA commented on YARN-1416: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829251#comment-13829251 ] Jian He commented on YARN-1416: --- The reason for this invalid event transition is that inside

[jira] [Updated] (YARN-1416) InvalidStateTransitions getting reported in multiple test cases even though they pass

[ https://issues.apache.org/jira/browse/YARN-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1416: -- Attachment: YARN-1416.2.patch > InvalidStateTransitions getting reported in multiple test cases even though > t

[jira] [Created] (YARN-1433) ContainerManagementProtocolProxy doesn't have the retry policy

Zhijie Shen created YARN-1433: - Summary: ContainerManagementProtocolProxy doesn't have the retry policy Key: YARN-1433 URL: https://issues.apache.org/jira/browse/YARN-1433 Project: Hadoop YARN I

[jira] [Commented] (YARN-955) [YARN-321] Implementation of ApplicationHistoryProtocol

[ https://issues.apache.org/jira/browse/YARN-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829246#comment-13829246 ] Zhijie Shen commented on YARN-955: -- This patch may need to be changed according to the comm

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829243#comment-13829243 ] Zhijie Shen commented on YARN-967: -- bq. I think we should use same to maintian consistency

[jira] [Commented] (YARN-1320) Custom log4j properties in Distributed shell does not work properly.

[ https://issues.apache.org/jira/browse/YARN-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829239#comment-13829239 ] Xuan Gong commented on YARN-1320: - Did the test on single node cluster. Original: We hav

[jira] [Commented] (YARN-1430) InvalidStateTransition exceptions are ignored in state machines

[ https://issues.apache.org/jira/browse/YARN-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829229#comment-13829229 ] Vinod Kumar Vavilapalli commented on YARN-1430: --- There are pros and cons to b

[jira] [Commented] (YARN-1303) Allow multiple commands separating with ";" in distributed-shell

[ https://issues.apache.org/jira/browse/YARN-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828923#comment-13828923 ] Hudson commented on YARN-1303: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1589 (See [https://

[jira] [Commented] (YARN-1053) Diagnostic message from ContainerExitEvent is ignored in ContainerImpl

[ https://issues.apache.org/jira/browse/YARN-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828918#comment-13828918 ] Hudson commented on YARN-1053: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1589 (See [https://

[jira] [Commented] (YARN-1425) TestRMRestart fails because MockRM.waitForState(AttemptId) uses current attempt instead of the attempt passed as argument

[ https://issues.apache.org/jira/browse/YARN-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828928#comment-13828928 ] Hudson commented on YARN-1425: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1615 (See [htt

[jira] [Commented] (YARN-1303) Allow multiple commands separating with ";" in distributed-shell

[ https://issues.apache.org/jira/browse/YARN-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828935#comment-13828935 ] Hudson commented on YARN-1303: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1615 (See [htt

[jira] [Commented] (YARN-149) ResourceManager (RM) High-Availability (HA)

[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13829125#comment-13829125 ] Bikas Saha commented on YARN-149: - Please open a sub-task. A patch would be great or else so

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828839#comment-13828839 ] Hadoop QA commented on YARN-967: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-1053) Diagnostic message from ContainerExitEvent is ignored in ContainerImpl

[ https://issues.apache.org/jira/browse/YARN-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828827#comment-13828827 ] Hudson commented on YARN-1053: -- FAILURE: Integrated in Hadoop-Yarn-trunk #398 (See [https://b

[jira] [Commented] (YARN-1303) Allow multiple commands separating with ";" in distributed-shell

[ https://issues.apache.org/jira/browse/YARN-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828832#comment-13828832 ] Hudson commented on YARN-1303: -- FAILURE: Integrated in Hadoop-Yarn-trunk #398 (See [https://b

[jira] [Commented] (YARN-1425) TestRMRestart fails because MockRM.waitForState(AttemptId) uses current attempt instead of the attempt passed as argument

[ https://issues.apache.org/jira/browse/YARN-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828825#comment-13828825 ] Hudson commented on YARN-1425: -- FAILURE: Integrated in Hadoop-Yarn-trunk #398 (See [https://b

[jira] [Updated] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-967: --- Attachment: YARN-967-4.patch Attaching latest patch Thanks, Mayank > [YARN-321] Command Line Interfac

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828809#comment-13828809 ] Mayank Bansal commented on YARN-967: Thanks [~zjshen] for review bq. 1. Change yarn.cmd

[jira] [Commented] (YARN-1426) YARN Components need to unregister their beans upon shutdown

[ https://issues.apache.org/jira/browse/YARN-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13828584#comment-13828584 ] Hadoop QA commented on YARN-1426: - {color:red}-1 overall{color}. Here are the results of t