So, IIUC, there are two parts to what you need
(1) How do I schedule containers in the first place asking for locality?
(2) How do I keep my scheduling requirements the same even if some of my
dependent service move / migrate.
For (1), YARN supports data-locality - you can give preferences for
Hi there,
what are the correct steps to move a primary Hadoop DFS namenode from
one host to another?
I use the version 2.7.1 of hadoop on Ubuntu 14.04.3 LTS (without YARN).
Steps done:
* Copy the whole hadoop directory to the new host
* set the new master in $hadoop_home/etc/hadoop/master
The intent to move a container is to improve service-to-service locality,
co-locate services to reduce bottlenecks introduced by network. The idea
that a certain parallel process should be moved comes from an external
service.
Speculation might not be effective here as I see, since the intent to