[46/50] [abbrv] hadoop git commit: YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter)

2017-08-31 Thread stevel 
YARN-7094. Document the current known issue with server-side NM graceful decom 
(rkanter)


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ce79f7be
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ce79f7be
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ce79f7be

Branch: refs/heads/HADOOP-13345
Commit: ce79f7be29dfbad444614cb340c59e4ff8137e89
Parents: cc23514
Author: Robert Kanter 
Authored: Wed Aug 30 18:04:55 2017 -0700
Committer: Robert Kanter 
Committed: Wed Aug 30 18:04:55 2017 -0700

--
 .../main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java  | 3 ++-
 .../hadoop-yarn-site/src/site/markdown/YarnCommands.md   | 4 ++--
 2 files changed, 4 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hadoop/blob/ce79f7be/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
--
diff --git 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
index ac5f559..24c1da0 100644
--- 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
+++ 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
@@ -113,7 +113,8 @@ public class RMAdminCLI extends HAAdmin {
   + " be handled by the client or the ResourceManager. The client"
   + "-side tracking is blocking, while the server-side tracking"
   + " is not. Omitting the timeout, or a timeout of -1, indicates"
-  + " an infinite timeout."))
+  + " an infinite timeout. Known Issue: the server-side tracking"
+  + " will immediately decommission if an RM HA failover occurs."))
   .put("-refreshNodesResources", new UsageInfo("",
   "Refresh resources of NodeManagers at the ResourceManager."))
   .put("-refreshSuperUserGroupsConfiguration", new UsageInfo("",

http://git-wip-us.apache.org/repos/asf/hadoop/blob/ce79f7be/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
--
diff --git 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
index 478377fa..5f430ec 100644
--- 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
+++ 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
@@ -189,7 +189,7 @@ Usage:
 ```
   Usage: yarn rmadmin
  -refreshQueues
- -refreshNodes [-g [timeout in seconds]]
+ -refreshNodes [-g|graceful [timeout in seconds] -client|server]
  -refreshNodesResources
  -refreshSuperUserGroupsConfiguration
  -refreshUserToGroupsMappings
@@ -214,7 +214,7 @@ Usage:
 | COMMAND\_OPTIONS | Description |
 |: |: |
 | -refreshQueues | Reload the queues' acls, states and scheduler specific 
properties. ResourceManager will reload the mapred-queues configuration file. |
-| -refreshNodes [-g|graceful [timeout in seconds] -client|server] | Refresh 
the hosts information at the ResourceManager. -g option indicates graceful 
decommission of excluded hosts, in which case, the optional timeout indicates 
maximal time in seconds ResourceManager should wait before forcefully mark the 
node as decommissioned. |
+| -refreshNodes [-g|graceful [timeout in seconds] -client|server] | 
Refresh the hosts information at the ResourceManager. Here [-g|graceful 
[timeout in seconds] -client|server] is optional, if we specify the 
timeout then ResourceManager will wait for timeout before marking the 
NodeManager as decommissioned. The -client|server indicates if the timeout 
tracking should be handled by the client or the ResourceManager. The 
client-side tracking is blocking, while the server-side tracking is not. 
Omitting the timeout, or a timeout of -1, indicates an infinite timeout. Known 
Issue: the server-side tracking will immediately decommission if an RM HA 
failover occurs. |
 | -refreshNodesResources | Refresh resources of NodeManagers at the 
ResourceManager. |
 | -refreshSuperUserGroupsConfiguration | Refresh superuser proxy groups 
mappings. |
 | -refreshUserToGroupsMappings | Refresh user-to-groups mappings. |


-
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-co

hadoop git commit: YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter)

2017-08-30 Thread rkanter 
Repository: hadoop
Updated Branches:
  refs/heads/branch-2 9a0aac417 -> 8523319e1


YARN-7094. Document the current known issue with server-side NM graceful decom 
(rkanter)

(cherry picked from commit ce79f7be29dfbad444614cb340c59e4ff8137e89)


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/8523319e
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/8523319e
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/8523319e

Branch: refs/heads/branch-2
Commit: 8523319e15ce74c140fab4f827b110b2d32f8e37
Parents: 9a0aac4
Author: Robert Kanter 
Authored: Wed Aug 30 18:04:55 2017 -0700
Committer: Robert Kanter 
Committed: Wed Aug 30 18:06:03 2017 -0700

--
 .../main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java  | 3 ++-
 .../hadoop-yarn-site/src/site/markdown/YarnCommands.md   | 4 ++--
 2 files changed, 4 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hadoop/blob/8523319e/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
--
diff --git 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
index ac5f559..24c1da0 100644
--- 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
+++ 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
@@ -113,7 +113,8 @@ public class RMAdminCLI extends HAAdmin {
   + " be handled by the client or the ResourceManager. The client"
   + "-side tracking is blocking, while the server-side tracking"
   + " is not. Omitting the timeout, or a timeout of -1, indicates"
-  + " an infinite timeout."))
+  + " an infinite timeout. Known Issue: the server-side tracking"
+  + " will immediately decommission if an RM HA failover occurs."))
   .put("-refreshNodesResources", new UsageInfo("",
   "Refresh resources of NodeManagers at the ResourceManager."))
   .put("-refreshSuperUserGroupsConfiguration", new UsageInfo("",

http://git-wip-us.apache.org/repos/asf/hadoop/blob/8523319e/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
--
diff --git 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
index 103d05c..1b36619 100644
--- 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
+++ 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
@@ -190,7 +190,7 @@ Usage:
 ```
   Usage: yarn rmadmin
  -refreshQueues
- -refreshNodes [-g [timeout in seconds]]
+ -refreshNodes [-g|graceful [timeout in seconds] -client|server]
  -refreshNodesResources
  -refreshSuperUserGroupsConfiguration
  -refreshUserToGroupsMappings
@@ -215,7 +215,7 @@ Usage:
 | COMMAND\_OPTIONS | Description |
 |: |: |
 | -refreshQueues | Reload the queues' acls, states and scheduler specific 
properties. ResourceManager will reload the mapred-queues configuration file. |
-| -refreshNodes [-g|graceful [timeout in seconds] -client|server] | Refresh 
the hosts information at the ResourceManager. -g option indicates graceful 
decommission of excluded hosts, in which case, the optional timeout indicates 
maximal time in seconds ResourceManager should wait before forcefully mark the 
node as decommissioned. |
+| -refreshNodes [-g|graceful [timeout in seconds] -client|server] | 
Refresh the hosts information at the ResourceManager. Here [-g|graceful 
[timeout in seconds] -client|server] is optional, if we specify the 
timeout then ResourceManager will wait for timeout before marking the 
NodeManager as decommissioned. The -client|server indicates if the timeout 
tracking should be handled by the client or the ResourceManager. The 
client-side tracking is blocking, while the server-side tracking is not. 
Omitting the timeout, or a timeout of -1, indicates an infinite timeout. Known 
Issue: the server-side tracking will immediately decommission if an RM HA 
failover occurs. |
 | -refreshNodesResources | Refresh resources of NodeManagers at the 
ResourceManager. |
 | -refreshSuperUserGroupsConfiguration | Refresh superuser proxy groups 
mappings. |
 | -refreshUserToGroupsMappings | Refresh user-to-groups mappings. |

hadoop git commit: YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter)

2017-08-30 Thread rkanter 
Repository: hadoop
Updated Branches:
  refs/heads/trunk cc23514ab -> ce79f7be2


YARN-7094. Document the current known issue with server-side NM graceful decom 
(rkanter)


Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/ce79f7be
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/ce79f7be
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/ce79f7be

Branch: refs/heads/trunk
Commit: ce79f7be29dfbad444614cb340c59e4ff8137e89
Parents: cc23514
Author: Robert Kanter 
Authored: Wed Aug 30 18:04:55 2017 -0700
Committer: Robert Kanter 
Committed: Wed Aug 30 18:04:55 2017 -0700

--
 .../main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java  | 3 ++-
 .../hadoop-yarn-site/src/site/markdown/YarnCommands.md   | 4 ++--
 2 files changed, 4 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/hadoop/blob/ce79f7be/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
--
diff --git 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
index ac5f559..24c1da0 100644
--- 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
+++ 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/RMAdminCLI.java
@@ -113,7 +113,8 @@ public class RMAdminCLI extends HAAdmin {
   + " be handled by the client or the ResourceManager. The client"
   + "-side tracking is blocking, while the server-side tracking"
   + " is not. Omitting the timeout, or a timeout of -1, indicates"
-  + " an infinite timeout."))
+  + " an infinite timeout. Known Issue: the server-side tracking"
+  + " will immediately decommission if an RM HA failover occurs."))
   .put("-refreshNodesResources", new UsageInfo("",
   "Refresh resources of NodeManagers at the ResourceManager."))
   .put("-refreshSuperUserGroupsConfiguration", new UsageInfo("",

http://git-wip-us.apache.org/repos/asf/hadoop/blob/ce79f7be/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
--
diff --git 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
index 478377fa..5f430ec 100644
--- 
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
+++ 
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/markdown/YarnCommands.md
@@ -189,7 +189,7 @@ Usage:
 ```
   Usage: yarn rmadmin
  -refreshQueues
- -refreshNodes [-g [timeout in seconds]]
+ -refreshNodes [-g|graceful [timeout in seconds] -client|server]
  -refreshNodesResources
  -refreshSuperUserGroupsConfiguration
  -refreshUserToGroupsMappings
@@ -214,7 +214,7 @@ Usage:
 | COMMAND\_OPTIONS | Description |
 |: |: |
 | -refreshQueues | Reload the queues' acls, states and scheduler specific 
properties. ResourceManager will reload the mapred-queues configuration file. |
-| -refreshNodes [-g|graceful [timeout in seconds] -client|server] | Refresh 
the hosts information at the ResourceManager. -g option indicates graceful 
decommission of excluded hosts, in which case, the optional timeout indicates 
maximal time in seconds ResourceManager should wait before forcefully mark the 
node as decommissioned. |
+| -refreshNodes [-g|graceful [timeout in seconds] -client|server] | 
Refresh the hosts information at the ResourceManager. Here [-g|graceful 
[timeout in seconds] -client|server] is optional, if we specify the 
timeout then ResourceManager will wait for timeout before marking the 
NodeManager as decommissioned. The -client|server indicates if the timeout 
tracking should be handled by the client or the ResourceManager. The 
client-side tracking is blocking, while the server-side tracking is not. 
Omitting the timeout, or a timeout of -1, indicates an infinite timeout. Known 
Issue: the server-side tracking will immediately decommission if an RM HA 
failover occurs. |
 | -refreshNodesResources | Refresh resources of NodeManagers at the 
ResourceManager. |
 | -refreshSuperUserGroupsConfiguration | Refresh superuser proxy groups 
mappings. |
 | -refreshUserToGroupsMappings | Refresh user-to-groups mappings. |


-
To unsubscribe, e-mail: common-commit