[
https://issues.apache.org/jira/browse/AMBARI-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970034#comment-14970034
]
Jayush Luniya commented on AMBARI-12702:
----------------------------------------
Attached is patch for parallelizing execution where we can with minimal changes
for 2.1.3. Although there is scope for more parallelism this should address
most time consuming steps in the upgrade.
*Improvements with this patch*
# The change parallelizes upgrade steps for multiple instances of a component.
# All instances of a slave component will stop/restart in parallel (All
datanodes will stop/restart in parallel, All nodemanagers will stop/restart in
parallel, however datanodes and nodemanagers will be in different stages and
hence will execute sequentially).
# All instances of a master component will stop/restart in parallel except for
Namenode which has specific logic that I have left as is. (All Zookeeper
Servers will stop/restart in parallel).
# All instances of a client component will be installed in parallel (All Tez
Clients will be installed in parallel, all Pig Clients will install in
parallel, Tez Clients and Pig Clients will be in different stages and hence
will execute sequentially)
*Future Improvements*
# Create a single stage for stopping all services and components in "Stop
High-level Services" and "Stop Level-Level Services"
# Create a single stage for installing all clients (i.e. all instances of Tez
Client and Pig Clients will install together).
# These improvements will require additional changes beause we will have to
create a single stage for multiple services and components and would be better
to do them in 2.2 timeframe given the timelines for 2.1.3.
# For Rolling Upgrade, we can optimize client installs to happen in parallel.
# Currently service checks are run sequentially, we can run service checks for
different services in parallel for both rolling and express upgrades.
> Stop-and-Start Upgrade: Parallelize restarts
> --------------------------------------------
>
> Key: AMBARI-12702
> URL: https://issues.apache.org/jira/browse/AMBARI-12702
> Project: Ambari
> Issue Type: Story
> Components: ambari-server
> Affects Versions: 2.2.0
> Reporter: Alejandro Fernandez
> Assignee: Alejandro Fernandez
> Labels: branch:branch-dev-stop-all-upgrade
> Fix For: 2.2.0
>
> Attachments: AMBARI-12702.patch
>
>
> Parallelize the start of certain components like Core Slaves, like DataNode,
> NodeManager, and RegionServer.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)