[
https://issues.apache.org/jira/browse/SLIDER-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15102104#comment-15102104
]
MENG DING commented on SLIDER-938:
----------------------------------
Update the design as follows:
h3. User Interface
h5. Updated CLI
{{slider resize-containers <application> --containers <containers> --components
<components> --memory <memory> --vcores <vcores>}}
Both containers and components can be specified on the command line, and slider
will get rid of duplicated containers. Slider will verify each container
resource change and only send valid change requests, and ignore invalid ones.
h5. Updated Protocol Changes between Slider client and Slider AppMaster
{code:title=SliderClusterMessages.proto}
...
message ResizeContainersRequestProto {
optional ResourceProto targetResource = 1;
repeated string container = 2;
repeated string component = 3;
}
...
{code}
h5. Show the current allocated container resource through CLI:
The {{slider status}} command is enhanced to display current allocated
container resource:
{code}
"status" : {
"live" : {
"MEMCACHED" : {
"container_e01_1452815447482_0003_01_000002" : {
"name" : "container_e01_1452815447482_0003_01_000002",
"role" : "MEMCACHED",
"roleId" : 1,
"createTime" : 1452876664664,
"startTime" : 1452876664725,
"released" : false,
"host" : "mdinglin02",
"hostUrl" : "http://mdinglin02:8042";,
"state" : 3,
"exitCode" : 0,
"command" : "python ./infra/agent/slider-agent/agent/main.py --label
container_e01_1452815447482_0003_01_000002___MEMCACHED --zk-quorum
mdinglin02:2181 --zk-reg-path
/registry/users/root/services/org-apache-slider/memcached >
<LOG_DIR>/slider-agent.out 2>&1 ; ",
"environment" : [ "LANGUAGE=\"en_US.UTF-8\"",
"AGENT_WORK_ROOT=\"$PWD\"", "HADOOP_USER_NAME=\"root\"",
"AGENT_LOG_ROOT=\"<LOG_DIR>\"", "PYTHONPATH=\"./infra/agent/slider-agent/\"",
"LC_ALL=\"en_US.UTF-8\"",
"SLIDER_PASSPHRASE=\"2ENqlR1hip35Lijzl3MMLVSxsLGWeDZ6CqLhsqvIfH5xxb0lqg\"",
"LANG=\"en_US.UTF-8\"" ],
"memory" : 1024,
"vCores" : 1
}
},
{code}
h3. Implementations and Considerations
# The processing of {{\-\-containers}} and {{\-\-components}} arguments are the
same between {{upgrade}} and {{resize-containers}} commands, so they are
extracted out into a helper function.
# We are now tracking all allocated/updated containers using
{{RoleInstance.container}}, so we need to synchronize all actions on the object.
> Add ability to resize containers (Hadoop 2.8+)
> ----------------------------------------------
>
> Key: SLIDER-938
> URL: https://issues.apache.org/jira/browse/SLIDER-938
> Project: Slider
> Issue Type: New Feature
> Components: appmaster
> Reporter: Steve Loughran
> Assignee: MENG DING
> Labels: hadoop-2.8
>
> Hadoop 2.8 will add container resize in YARN-1197: support that for dynamic
> container resize
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
