configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Pythonner
Hello, this is a follow-up of discussion started on twitter with http://twitter.com/phunt. I installed HBase 0.20.0 RC2 on Ubuntu server boxes. If I'm using machines IP in config files (see below), I get the following error message: 'Could not find my address: xyz in list of ZooKeeper quorum ser

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Jean-Daniel Cryans
David, hbase.master is deprecated in HBase 0.20, instead you have to specify hbase.zookeeper.quorum if you want to use HBase in a distributed mode with a ZK quorum. Please see the Getting Started documentation shipped with HBase. J-D On Mon, Aug 24, 2009 at 3:39 PM, Pythonner wrote: > Hello, > t

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Pythonner
I forgot to post that line: hbase.zookeeper.quorum 192.168.1.xx ok, I'll check the guide shipped with HBase. On Mon, Aug 24, 2009 at 3:43 PM, Jean-Daniel Cryans wrote: > David, > > hbase.master is deprecated in HBase 0.20, instead you have to specify > hbase.zookeeper.quorum if yo

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Patrick Hunt
Hey Pythonner, thanks for the followup! if I understand correctly, this error message is generated by hbase and not zk? Can you tell at all? (seems likely to me as the configuration you re referring to is hbase specific... but would like to verify). Can anyone confirm, is this an issue with h

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Jean-Daniel Cryans
Oh ok well HBase relies on the DNS class shipped with Hadoop to determine your address. It will try to use a hostname if possible but what comes out of there really depends on your OS configuration. In your case, that means that it resolved a hostname instead of an IP (which is rare) so you should

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Patrick Hunt
Hi Jean-Daniel, not sure I get your response fully. Are you saying that the configured ip addr was resolved to a hostname, but that hostname didn't match the list of ip addresses used when defining the zk quorum machines? Is there a workaround you could suggest for ppl who don't have DNS availa

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Jean-Daniel Cryans
Well the situation is that HBase now generates the myid files and to find the id we look in the hbase.zookeeper.quorum configuration that itself generates a temporary zoo.cfg file. To do that we have to somehow match the machine's own knowledge of its address with what's in that list. To find our a

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Patrick Hunt
I see, so an inconsistency then wrt name lookup. Thanks! Patrick Jean-Daniel Cryans wrote: Well the situation is that HBase now generates the myid files and to find the id we look in the hbase.zookeeper.quorum configuration that itself generates a temporary zoo.cfg file. To do that we have to

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Jean-Daniel Cryans
Patrick, Basically, yes. Sorry for the lengthy answer ;) J-D On Mon, Aug 24, 2009 at 5:09 PM, Patrick Hunt wrote: > I see, so an inconsistency then wrt name lookup. > > Thanks! > > Patrick > > Jean-Daniel Cryans wrote: >> >> Well the situation is that HBase now generates the myid files and to >>

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Patrick Hunt
No worries. The details are actually interesting/useful, you might consider adding to your docs in case another user runs into this. Patrick Jean-Daniel Cryans wrote: Patrick, Basically, yes. Sorry for the lengthy answer ;) J-D On Mon, Aug 24, 2009 at 5:09 PM, Patrick Hunt wrote: I see, s

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Jean-Daniel Cryans
Added here http://wiki.apache.org/hadoop/Hbase/Troubleshooting#12 J-D On Mon, Aug 24, 2009 at 5:20 PM, Patrick Hunt wrote: > No worries. The details are actually interesting/useful, you might consider > adding to your docs in case another user runs into this. > > Patrick > > > Jean-Daniel Cryans

Re: configuring Zookeeper in HBase with IP addresses only

2009-08-24 Thread Patrick Hunt
Nice! Jean-Daniel Cryans wrote: Added here http://wiki.apache.org/hadoop/Hbase/Troubleshooting#12 J-D On Mon, Aug 24, 2009 at 5:20 PM, Patrick Hunt wrote: No worries. The details are actually interesting/useful, you might consider adding to your docs in case another user runs into this. Patr