[ https://issues.apache.org/jira/browse/LIVY-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16985791#comment-16985791 ]
Yiheng Wang commented on LIVY-719: ---------------------------------- Hi We have proposed a JIRA for Livy HA. https://issues.apache.org/jira/browse/LIVY-718 > Livy is not high available in aws EMR cluster > --------------------------------------------- > > Key: LIVY-719 > URL: https://issues.apache.org/jira/browse/LIVY-719 > Project: Livy > Issue Type: Bug > Reporter: chiranjeevi patel > Priority: Major > > Hi, > We have been using the Livy in our EMR cluster to submit the batch jobs, now > after upgrading to EMR 5.0.24 with multi master capability, livy is not able > to handle the sessions on master failover. > Livy is installed on all three master nodes and running as independent > application, so a master node failure is bringing down the livy session, > where EMR was abel to switch the active master to standby one, but out jobs > were failing, since we lost the session with previous active master, and we > need to explicitly connect to the new active master with a different IP. > > Do you have any plans to support multi master (HA) clusters ? > I have asked the AWS support team, and they responded as livy is due with > many open source issues, and they can work on it only when these issues are > sorted. > Let me know if you need any further details > -- This message was sent by Atlassian Jira (v8.3.4#803005)