Hi Team,
The template of regionserver of HBase application uses following scripts to
configure configuraiton file of regionserver of HBase. I did not find where
the rs_hosts is defined in any file in Slider HBase package. How a template
is designed is mentioned a little at the end of
http://slider
bq. host list of all the instances of a component
Are you using node labels feature of YARN ?
If not, the list would comprise of all the nodes in your YARN cluster.
Cheers
On Tue, Dec 30, 2014 at 4:43 PM, Yong Feng wrote:
> Hi Team,
>
> The template of regionserver of HBase application uses fo
ah, rs_hosts means all the nodes managed by YARN.
I know a little about labels feature of YARN which adds a tag to host and
allow yarn API client to filter hosts according to the tag. I don't think
it helps my case.
Taking a typical master/slave cluster as an example. To support
active-passive fa
What's the timeframe for this migration ?
If time permits, you should consider rewriting master failover logic in
your application.
Using zookeeper is a common technique. HBase, e.g., registers active master
under a well known zookeeper znode.
This is much more flexible than the way you described
Thanks Ted.
>> knowing the host list of master role in Slider script or template is not
supported by either Slider or YARN.
[Yong] If there is only one instance of master role, at least I could know
its host name by COMPONENT_HOST in slave hosts, right? If so, I could work
it around to just config
I’m confused - if certain hosts were labeled as MASTER, wouldn’t you know a
priori the list of master hosts?
On Dec 31, 2014, at 12:31 PM, Yong Feng wrote:
> Thanks Ted.
>
>>> knowing the host list of master role in Slider script or template is not
> supported by either Slider or YARN.
> [Yon
Hi John
I do expect the hosts allocated to master role of my slider application are
labeled as appname_rolename, but the question is who will add such label
and how? and how to get the hosts with the label?
Thanks,
Yong
On Wed, Dec 31, 2014 at 3:57 PM, Jon Maron wrote:
> I’m confused - if cer
Jon, Ted
Happy new year.
After read more, I understand knowing the host list or single host of
master role in Slider script or template is not supported by either Slider
or YARN.
So what I can do is
a) pre-define a group of hosts with label of master
b) specify label of master for master role i
Yong:
Let me discuss with slider / YARN developers and get back to you.
Happy new year.
On Thu, Jan 1, 2015 at 7:13 PM, Yong Feng wrote:
> Jon, Ted
>
> Happy new year.
>
> After read more, I understand knowing the host list or single host of
> master role in Slider script or template is not sup
Thanks Ted.
Basically what we are doing is to ask HPC workload and BigData workload
share the same infrastructure by Slider. The current way to fit Hadoop into
HPC community is either on demand provisioning Hadoop cluster by HPC
scheduler (for example HOD or myHadoop) or enhancing Hadoop as HPC wo
Thanks for the background information.
Adding Wangda who worked on node labels feature.
On Fri, Jan 2, 2015 at 9:04 AM, Yong Feng wrote:
> Thanks Ted.
>
> Basically what we are doing is to ask HPC workload and BigData workload
> share the same infrastructure by Slider. The current way to fit Ha
YARN-3003 was logged.
But it is not known when it will be implemented.
Yong:
Please consider using zookeeper for recoding master nodes. This makes your
solution workable on Slider 0.60
Cheers
On Fri, Jan 2, 2015 at 10:33 AM, Wangda Tan wrote:
> Currently, YARN doesn't have direct method to do
Thanks Ted.
I will check if I could get some resources to contribute.
Yong
On Sat, Jan 3, 2015 at 2:13 PM, Ted Yu wrote:
> YARN-3003 was logged.
> But it is not known when it will be implemented.
>
> Yong:
> Please consider using zookeeper for recoding master nodes. This makes your
> solution
13 matches
Mail list logo
