Re: YARN re-locate container

2016-03-31 Thread Vinod Kumar Vavilapalli
So, IIUC, there are two parts to what you need (1) How do I schedule containers in the first place asking for locality? (2) How do I keep my scheduling requirements the same even if some of my dependent service move / migrate. For (1), YARN supports data-locality - you can give preferences for

How to move a namenode to a new host properly

2016-03-31 Thread Max Schmidt
Hi there, what are the correct steps to move a primary Hadoop DFS namenode from one host to another? I use the version 2.7.1 of hadoop on Ubuntu 14.04.3 LTS (without YARN). Steps done: * Copy the whole hadoop directory to the new host * set the new master in $hadoop_home/etc/hadoop/master

Re: YARN re-locate container

2016-03-31 Thread Zoltán Zvara
The intent to move a container is to improve service-to-service locality, co-locate services to reduce bottlenecks introduced by network. The idea that a certain parallel process should be moved comes from an external service. Speculation might not be effective here as I see, since the intent to