[ 
https://issues.apache.org/jira/browse/AMBARI-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14970034#comment-14970034
 ] 

Jayush Luniya commented on AMBARI-12702:
----------------------------------------

Attached is patch for parallelizing execution where we can with minimal changes 
for 2.1.3. Although there is scope for more parallelism this should address 
most time consuming steps in the upgrade.

*Improvements with this patch*

# The change parallelizes upgrade steps for multiple instances of a component. 
# All instances of a slave component will stop/restart in parallel (All 
datanodes will stop/restart in parallel, All nodemanagers will stop/restart in 
parallel, however datanodes and nodemanagers will be in different stages and 
hence will execute sequentially).
# All instances of a master component will stop/restart in parallel except for 
Namenode which has specific logic that I have left as is. (All Zookeeper 
Servers will stop/restart in parallel).
# All instances of a client component will be installed in parallel (All Tez 
Clients will be installed in parallel, all Pig Clients will install in 
parallel, Tez Clients and Pig Clients will be in different stages and hence 
will execute sequentially)


*Future Improvements*
# Create a single stage for stopping all services and components in "Stop 
High-level Services" and "Stop Level-Level Services"
# Create a single stage for installing all clients (i.e. all instances of Tez 
Client and Pig Clients will install together). 
# These improvements will require additional changes beause we will have to 
create a single stage for multiple services and components and would be better 
to do them in 2.2 timeframe given the timelines for 2.1.3.
# For Rolling Upgrade, we can optimize client installs to happen in parallel. 
# Currently service checks are run sequentially, we can run service checks for 
different services in parallel for both rolling and express upgrades.


> Stop-and-Start Upgrade: Parallelize restarts
> --------------------------------------------
>
>                 Key: AMBARI-12702
>                 URL: https://issues.apache.org/jira/browse/AMBARI-12702
>             Project: Ambari
>          Issue Type: Story
>          Components: ambari-server
>    Affects Versions: 2.2.0
>            Reporter: Alejandro Fernandez
>            Assignee: Alejandro Fernandez
>              Labels: branch:branch-dev-stop-all-upgrade
>             Fix For: 2.2.0
>
>         Attachments: AMBARI-12702.patch
>
>
> Parallelize the start of certain components like Core Slaves, like DataNode, 
> NodeManager, and RegionServer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to