Guys,
I think I got a bit further, I think what happened is:
1. my Hbase client (remote machine) is looking for zookeeper first. It
reads local hbase-site.xml, and finds the zookeeper on the cloudera vm, it
then locates Hbase master no problem.
2. it gets to Hbase master, next step it tries to locate the regions for
the specific HBase table I am asking for, in my case, it's 's1'. It finds
-ROOT- first,
locateRegionInMeta parentTable=-ROOT-,
metaLocation={region=-ROOT-,,0.70236052, hostname=localhost.localdomain,
port=60020} table,
So the problem I guess is that, in hbase, the metadata is pointing to
localhost.localdomain which is correct according to the hbase-site.xml on
my cloudera vm. But My HBase client remotely, of coz, has no idea what is
localhost.localdomain.
I think I need to change the hbase-site.xml in my cloudera vm to point to
the IP address instead of localhost.localdomain. But the question now is,
how do I update the metadata in -ROOT- from localhost to ${IP}? Tried flush
'-ROOT-', didn't work.
hbase(main):002:0> scan '-ROOT-'
ROW COLUMN+CELL
.META.,,1 column=info:regioninfo,
timestamp=1376375498677, value={NAME => '.META.,,1', STARTKEY
=> '', ENDKEY => '', ENCODED =>
1028785192,}
.META.,,1 column=info:server, timestamp=1377482563657,
value=localhost.localdomain:60020
.META.,,1 column=info:serverstartcode,
timestamp=1377482563657, value=1377482552354
.META.,,1 column=info:v, timestamp=1376375498677,
value=\x00\x00
1 row(s) in 0.1450 seconds
Shengjie
On 26 August 2013 01:23, Shengjie Min <shengjie....@gmail.com> wrote:
> Hi Kevin,
>
> Can you be a bit more specific? I need to change my /etc/hosts on my
> Cloudera vm? It is just like this now:
>
> 127.0.0.1 localhost.localdomain localhost
>
> What you suggest me to do here?
>
> Thanks,
> Shengjie
>
>
> On 26 August 2013 00:59, Kevin O'dell <kevin.od...@cloudera.com> wrote:
>
>> Shengjie,
>>
>> Looks like you are binding to localhost on your services. Please make
>> sure you correct it so you bind on the interface for zk.
>> On Aug 25, 2013 10:32 AM, "Shengjie Min" <shengjie....@gmail.com> wrote:
>>
>> > Sure, Kevin,
>> >
>> > http://imgur.com/SQ3Zao9
>> >
>> > Shengjie
>> >
>> >
>> > On 25 August 2013 22:22, Kevin O'dell <kevin.od...@cloudera.com> wrote:
>> >
>> > > Shengjie,
>> > >
>> > > Good news on being able to connect to the ui from the client. Can
>> you
>> > > post a screen shot on imgur?
>> > > On Aug 25, 2013 10:12 AM, "Jean-Marc Spaggiari" <
>> jean-m...@spaggiari.org
>> > >
>> > > wrote:
>> > >
>> > > > Can you share your client code? Or at least the section where you do
>> > the
>> > > > connection?
>> > > >
>> > > > Also, have you tried to run the same code from inside the VM?
>> > > >
>> > > > JM
>> > > >
>> > > > 2013/8/25 Shengjie Min <shengjie....@gmail.com>
>> > > >
>> > > > > Hi Jean-Marc,
>> > > > >
>> > > > > Sorry about the screenshot, yes, my Hbase client is outside of my
>> VM.
>> > > > And I
>> > > > > can access WebUI from outside: http://cloudera:60010
>> > > > >
>> > > > > Shengjie
>> > > > >
>> > > > >
>> > > > > On 25 August 2013 21:43, Jean-Marc Spaggiari <
>> > jean-m...@spaggiari.org
>> > > > > >wrote:
>> > > > >
>> > > > > > I think you need to post the screenshot on an external website
>> and
>> > > send
>> > > > > the
>> > > > > > link here.
>> > > > > >
>> > > > > > So, you are trying to access your VM from outside of your VM? Or
>> > your
>> > > > > > client application is into the VM too?
>> > > > > >
>> > > > > > If you are outside of your VM, are you able to access the VM
>> from
>> > > > > outside?
>> > > > > >
>> > > > > > Like, are you able to access the WebUI from outside of the VM
>> with
>> > > > > > something like "http://cloudera:60010";?
>> > > > > >
>> > > > > > JM
>> > > > > >
>> > > > > > 2013/8/25 Shengjie Min <shengjie....@gmail.com>
>> > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > On 25 August 2013 21:08, Kevin O'dell <
>> kevin.od...@cloudera.com>
>> > > > > wrote:
>> > > > > > >
>> > > > > > >> Can you attach a screen shot of the HMaster UI? It appears
>> ZK is
>> > > > > > >> connecting
>> > > > > > >> fine, but can't find .META.
>> > > > > > >> On Aug 25, 2013 8:57 AM, "Shengjie Min" <
>> shengjie....@gmail.com
>> > >
>> > > > > wrote:
>> > > > > > >>
>> > > > > > >> > Hi Jean-Marc,
>> > > > > > >> >
>> > > > > > >> > You meant my cloudera vm or my client? Here is my
>> /etc/hosts
>> > > > > > >> >
>> > > > > > >> > cloudera vm:
>> > > > > > >> >
>> > > > > > >> > 127.0.0.1 localhost.localdomain localhost
>> > > > > > >> >
>> > > > > > >> > client:
>> > > > > > >> > 127.0.0.1 localhost
>> > > > > > >> > 255.255.255.255 broadcasthost
>> > > > > > >> > ::1 localhost
>> > > > > > >> > fe80::1%lo0 localhost
>> > > > > > >> >
>> > > > > > >> > 172.16.144.150 cloudera
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > Shengjie
>> > > > > > >> >
>> > > > > > >> >
>> > > > > > >> > On 25 August 2013 20:28, Jean-Marc Spaggiari <
>> > > > > jean-m...@spaggiari.org
>> > > > > > >> > >wrote:
>> > > > > > >> >
>> > > > > > >> > > Hi,
>> > > > > > >> > >
>> > > > > > >> > > Do you have your host+ip in your host file?
>> > > > > > >> > >
>> > > > > > >> > > JM
>> > > > > > >> > >
>> > > > > > >> > > 2013/8/25 Shengjie Min <shengjie....@gmail.com>
>> > > > > > >> > >
>> > > > > > >> > > > Hi guys,
>> > > > > > >> > > >
>> > > > > > >> > > > I am running cloudera quick start vm:
>> > > > > > >> > > >
>> > > > > > >> > > > Versions:
>> > > > > > >> > > >
>> > > > > > >> > > > Hadoop: 2.0.0-cdh4.3.1
>> > > > > > >> > > >
>> > > > > > >> > > > HBase: 0.94.6-cdh4.3.1
>> > > > > > >> > > >
>> > > > > > >> > > > Here is my little remote HBase Java
>> > > client(HbaseClient.java),
>> > > > > all
>> > > > > > it
>> > > > > > >> > does
>> > > > > > >> > > > is:
>> > > > > > >> > > >
>> > > > > > >> > > > public static void main(String[] args) throws
>> IOException
>> > {
>> > > > > > >> > > > Configuration config = HBaseConfiguration.create();
>> > > > > > >> > > > HTable table = new HTable(config, "s1");
>> > > > > > >> > > > System.out.println(table.getTableName());
>> > > > > > >> > > > }
>> > > > > > >> > > >
>> > > > > > >> > > > hbase-site.xml:
>> > > > > > >> > > >
>> > > > > > >> > > > <property>
>> > > > > > >> > > > <name>hbase.rootdir</name>
>> > > > > > >> > > > <value>hdfs://172.16.144.150:8020/hbase</value>
>> > > > > > >> > > > </property>
>> > > > > > >> > > > <property>
>> > > > > > >> > > > <name>zookeeper.znode.parent</name>
>> > > > > > >> > > > <value>/hbase</value>
>> > > > > > >> > > > </property>
>> > > > > > >> > > > .......
>> > > > > > >> > > > <property>
>> > > > > > >> > > > <name>zookeeper.znode.rootserver</name>
>> > > > > > >> > > > <value>root-region-server</value>
>> > > > > > >> > > > </property>
>> > > > > > >> > > > <property>
>> > > > > > >> > > > <name>hbase.zookeeper.quorum</name>
>> > > > > > >> > > > <value>172.16.144.150</value>
>> > > > > > >> > > > </property>
>> > > > > > >> > > >
>> > > > > > >> > > > When I run my java client, I get the error unknown
>> host:
>> > > > > > >> > > > localhost.localdomain:
>> > > > > > >> > > >
>> > > > > > >> > > > Initiating client connection, connectString=
>> > > > 172.16.144.150:2181
>> > > > > > >> > > > sessionTimeout=60000 watcher=hconnection
>> > > > > > >> > > > zookeeper.disableAutoWatchReset is false
>> > > > > > >> > > > The identifier of this process is
>> > > 41939@smin-MacBook-Pro.local
>> > > > > > >> > > > Opening socket connection to server cloudera/
>> > > > > 172.16.144.150:2181.
>> > > > > > >> Will
>> > > > > > >> > > > not attempt to authenticate using SASL (unknown error)
>> > > > > > >> > > > Socket connection established to cloudera/
>> > > 172.16.144.150:2181
>> > > > ,
>> > > > > > >> > > > initiating session
>> > > > > > >> > > > Session establishment request sent on cloudera/
>> > > > > > 172.16.144.150:2181
>> > > > > > >> > > > Session establishment complete on server cloudera/
>> > > > > > >> 172.16.144.150:2181,
>> > > > > > >> > > > sessionid = 0x14076b058850045, negotiated timeout =
>> 60000
>> > > > > > >> > > > hconnection Received ZooKeeper Event, type=None,
>> > > > > > >> state=SyncConnected,
>> > > > > > >> > > > path=null
>> > > > > > >> > > > hconnection-0x14076b058850045 connected
>> > > > > > >> > > >
>> > > > > > >> > > > locateRegionInMeta parentTable=-ROOT-,
>> > > > > > >> > > > metaLocation={region=-ROOT-,,0.70236052,
>> > > > > > >> > > > hostname=localhost.localdomain, port=60020},
>> > > > > > >> > > > attempt=0 of 10 failed; retrying after sleep of 1000
>> > > because:
>> > > > > > >> > > > unknown host: localhost.localdomain
>> > > > > > >> > > >
>> > > > > > >> > > > Reading reply sessionid:0x14076b058850045, packet::
>> > > > > > clientPath:null
>> > > > > > >> > > > serverPath:null finished:false header:: 17,3
>> > replyHeader::
>> > > > > > 17,460,0
>> > > > > > >> > > > request:: '/hbase,F response::
>> > > > > > >> > > > s{20,20,1376375496826,1376375496826,0,32,0,0,0,12,430}
>> > > > > > >> > > > Reading reply sessionid:0x14076b058850045, packet::
>> > > > > > clientPath:null
>> > > > > > >> > > > serverPath:null finished:false header:: 18,4
>> > replyHeader::
>> > > > > > 18,460,0
>> > > > > > >> > > > request:: '/hbase/root-region-server,T response::
>> > > > > > >> > > >
>> > > > > > >> > > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> #ffffffff0001b3635323630406c6f63616c686f73742e6c6f63616c646f6d61696e6c6f63616c686f73742e6c6f63616c646f6d61696e2c36303032302c31333737333538373930303037,s{430,430,1377358805621,1377358805621,0,0,0,0,73,0,430}
>> > > > > > >> > > > hconnection-0x14076b058850045 Retrieved 41 byte(s) of
>> data
>> > > > from
>> > > > > > >> znode
>> > > > > > >> > > > /hbase/root-region-server and set watcher;
>> > > > > > >> > > > localhost.localdomain,60020,1...
>> > > > > > >> > > > Looked up root region location,
>> > > > > > >> > > >
>> > > > > > >> > > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >>
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> connection=org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@68a7a3a7
>> > > > > > >> > > > ;
>> > > > > > >> > > > serverName=localhost.localdomain,60020,1377358790007
>> > > > > > >> > > >
>> > > > > > >> > > > locateRegionInMeta parentTable=.META.,
>> metaLocation=null,
>> > > > > > attempt=2
>> > > > > > >> of
>> > > > > > >> > > > 10 failed;
>> > > > > > >> > > > retrying after sle
>> > > > > > >> > > >
>> > > > > > >> > > > Any ideas?
>> > > > > > >> > > >
>> > > > > > >> > > > Thanks,
>> > > > > > >> > > >
>> > > > > > >> > > > SHengjie
>> > > > > > >> > > >
>> > > > > > >> > >
>> > > > > > >> >
>> > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
>
