Re: Is it able to make AM to restart from previous state?

2014-11-06 Thread Steve Loughran
On 5 November 2014 21:44, hsy...@gmail.com hsy...@gmail.com wrote: Thanks Steve, Is No 1 a new feature in YARN (Not released yet)? Came out in Hadoop 2.4; only got working in Hadoop 2.5. We were the first users. And you mentioned slider saves the location in history files. What are the

Re: Is it able to make AM to restart from previous state?

2014-11-06 Thread Steve Loughran
On 6 November 2014 00:31, hsy...@gmail.com hsy...@gmail.com wrote: Steve, I found out from the code that everything is kept in history folder in hdfs. You mentioned that if I add new component, the history layout would be discarded. What if I add more component instances in configuration?

Is it able to make AM to restart from previous state?

2014-11-05 Thread hsy...@gmail.com
Hi guys, I noticed in the code when a container fails it will try to relaunch from the same node. My question is if I restart whole application(Ex. AM got killed, or manually restart the app). Does slider try to launch all containers from the nodes where it was running? Thanks! Best, Siyuan

Re: Is it able to make AM to restart from previous state?

2014-11-05 Thread Steve Loughran
On 5 November 2014 20:21, hsy...@gmail.com hsy...@gmail.com wrote: Hi guys, I noticed in the code when a container fails it will try to relaunch from the same node. My question is if I restart whole application(Ex. AM got killed, or manually restart the app). Does slider try to launch all

Re: Is it able to make AM to restart from previous state?

2014-11-05 Thread hsy...@gmail.com
Thanks Steve, Is No 1 a new feature in YARN (Not released yet)? And you mentioned slider saves the location in history files. What are the history files and where is it stored? Is it in HDFS? If the one of the previous machines is gone, will it try to get resource from new labeled machine?

Re: Is it able to make AM to restart from previous state?

2014-11-05 Thread hsy...@gmail.com
Steve, I found out from the code that everything is kept in history folder in hdfs. You mentioned that if I add new component, the history layout would be discarded. What if I add more component instances in configuration? Do you try to launch instance from previous node and add new instance