Re: Hbase not taking inserts from Remote Machine
You are welcome! 2015-02-17 12:07 GMT+03:00 Vineet Mishra clearmido...@gmail.com: Thanks Serega! Don't know how could I miss that, Its working good now! On Tue, Feb 17, 2015 at 12:41 PM, Serega Sheypak serega.shey...@gmail.com wrote: You need to open region server ports. Client directly sends put to appropriate region server. вторник, 17 февраля 2015 г. пользователь Vineet Mishra написал: -- Forwarded message -- From: Vineet Mishra clearmido...@gmail.com javascript:; Date: Tue, Feb 17, 2015 at 12:32 PM Subject: Hbase not taking inserts from Remote Machine To: cdh-u...@cloudera.org javascript:; Hi All, I am trying to communicate and insert some data to my Hbase(0.98.6-cdh5.3.0) running on Hadoop 2.5 using Hbase Java API. Although if I run the code within the cluster it connects fine but If I am outside cluster, even though I have opened the port on external IPs for Zookeeper and HMaster, I am stuck without any error on the logs, so the code hangs up on Table.put() during insertion, Attached below is the Stack Trace for the Job, 15/02/17 12:05:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/02/17 12:05:08 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x77dacebf connecting to ZooKeeper ensemble= namenode.com:2181,cloud-manager.com:2181 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.3.0--1, built on 12/17/2014 02:45 GMT 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment: host.name =ip-20-0-0-75 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_75 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75.x86_64/jre 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.class.path=.:hbase-connect-1.0.0.jar 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.compiler=NA 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.name =Linux 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.version=3.14.23-22.44.amzn1.x86_64 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment: user.name =tom 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/tom 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/tom/jobs 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=namenode.com:2181,cloud-manager.com:2181 sessionTimeout=9 watcher=hconnection-0x77dacebf, quorum=namenode.com:2181, cloud-manager.com:2181, baseZNode=/hbase 15/02/17 12:05:08 INFO zookeeper.ClientCnxn: Opening socket connection to server namenode.com/54.172.21.54:2181. Will not attempt to authenticate using SASL (unknown error) 15/02/17 12:05:09 INFO zookeeper.ClientCnxn: Socket connection established to namenode.com/54.172.21.54:2181, initiating session 15/02/17 12:05:09 INFO zookeeper.ClientCnxn: Session establishment complete on server namenode.com/54.172.21.54:2181, sessionid = 0x24b7c7ba3532b32, negotiated timeout = 6 15/02/17 12:05:11 INFO client.HConnectionManager$HConnectionImplementation: Closing master protocol: MasterService 15/02/17 12:05:11 INFO client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x24b7c7ba3532b32 15/02/17 12:05:11 INFO zookeeper.ZooKeeper: Session: 0x24b7c7ba3532b32 closed 15/02/17 12:05:11 INFO zookeeper.ClientCnxn: EventThread shut down Hbase Running 15/02/17 12:05:11 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x1003cac6 connecting to ZooKeeper ensemble= namenode.com:2181,cloud-manager.com:2181 15/02/17 12:05:11 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=namenode.com:2181,cloud-manager.com:2181 sessionTimeout=9 watcher=hconnection-0x1003cac6, quorum=namenode.com:2181, cloud-manager.com:2181, baseZNode=/hbase 15/02/17 12:05:11 INFO zookeeper.ClientCnxn: Opening socket connection to server namenode.com/54.172.21.54:2181. Will not attempt to authenticate using SASL (unknown error) 15/02/17 12:05:12 INFO zookeeper.ClientCnxn: Socket connection established to namenode.com/54.172.21.54:2181, initiating session 15/02/17
Re: Hbase not taking inserts from Remote Machine
Thanks Serega! Don't know how could I miss that, Its working good now! On Tue, Feb 17, 2015 at 12:41 PM, Serega Sheypak serega.shey...@gmail.com wrote: You need to open region server ports. Client directly sends put to appropriate region server. вторник, 17 февраля 2015 г. пользователь Vineet Mishra написал: -- Forwarded message -- From: Vineet Mishra clearmido...@gmail.com javascript:; Date: Tue, Feb 17, 2015 at 12:32 PM Subject: Hbase not taking inserts from Remote Machine To: cdh-u...@cloudera.org javascript:; Hi All, I am trying to communicate and insert some data to my Hbase(0.98.6-cdh5.3.0) running on Hadoop 2.5 using Hbase Java API. Although if I run the code within the cluster it connects fine but If I am outside cluster, even though I have opened the port on external IPs for Zookeeper and HMaster, I am stuck without any error on the logs, so the code hangs up on Table.put() during insertion, Attached below is the Stack Trace for the Job, 15/02/17 12:05:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/02/17 12:05:08 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x77dacebf connecting to ZooKeeper ensemble= namenode.com:2181,cloud-manager.com:2181 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.3.0--1, built on 12/17/2014 02:45 GMT 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:host.name =ip-20-0-0-75 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_75 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75.x86_64/jre 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.class.path=.:hbase-connect-1.0.0.jar 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.compiler=NA 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.name =Linux 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.version=3.14.23-22.44.amzn1.x86_64 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.name =tom 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/tom 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/tom/jobs 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=namenode.com:2181,cloud-manager.com:2181 sessionTimeout=9 watcher=hconnection-0x77dacebf, quorum=namenode.com:2181, cloud-manager.com:2181, baseZNode=/hbase 15/02/17 12:05:08 INFO zookeeper.ClientCnxn: Opening socket connection to server namenode.com/54.172.21.54:2181. Will not attempt to authenticate using SASL (unknown error) 15/02/17 12:05:09 INFO zookeeper.ClientCnxn: Socket connection established to namenode.com/54.172.21.54:2181, initiating session 15/02/17 12:05:09 INFO zookeeper.ClientCnxn: Session establishment complete on server namenode.com/54.172.21.54:2181, sessionid = 0x24b7c7ba3532b32, negotiated timeout = 6 15/02/17 12:05:11 INFO client.HConnectionManager$HConnectionImplementation: Closing master protocol: MasterService 15/02/17 12:05:11 INFO client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x24b7c7ba3532b32 15/02/17 12:05:11 INFO zookeeper.ZooKeeper: Session: 0x24b7c7ba3532b32 closed 15/02/17 12:05:11 INFO zookeeper.ClientCnxn: EventThread shut down Hbase Running 15/02/17 12:05:11 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x1003cac6 connecting to ZooKeeper ensemble= namenode.com:2181,cloud-manager.com:2181 15/02/17 12:05:11 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=namenode.com:2181,cloud-manager.com:2181 sessionTimeout=9 watcher=hconnection-0x1003cac6, quorum=namenode.com:2181, cloud-manager.com:2181, baseZNode=/hbase 15/02/17 12:05:11 INFO zookeeper.ClientCnxn: Opening socket connection to server namenode.com/54.172.21.54:2181. Will not attempt to authenticate using SASL (unknown error) 15/02/17 12:05:12 INFO zookeeper.ClientCnxn: Socket connection established to namenode.com/54.172.21.54:2181, initiating session 15/02/17 12:05:12 INFO zookeeper.ClientCnxn: Session establishment complete on server namenode.com/54.172.21.54:2181, sessionid = 0x24b7c7ba3532b34, negotiated timeout = 6 Looking at the revert urgently!
Re: Hbase not taking inserts from Remote Machine
You need to open region server ports. Client directly sends put to appropriate region server. вторник, 17 февраля 2015 г. пользователь Vineet Mishra написал: -- Forwarded message -- From: Vineet Mishra clearmido...@gmail.com javascript:; Date: Tue, Feb 17, 2015 at 12:32 PM Subject: Hbase not taking inserts from Remote Machine To: cdh-u...@cloudera.org javascript:; Hi All, I am trying to communicate and insert some data to my Hbase(0.98.6-cdh5.3.0) running on Hadoop 2.5 using Hbase Java API. Although if I run the code within the cluster it connects fine but If I am outside cluster, even though I have opened the port on external IPs for Zookeeper and HMaster, I am stuck without any error on the logs, so the code hangs up on Table.put() during insertion, Attached below is the Stack Trace for the Job, 15/02/17 12:05:08 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 15/02/17 12:05:08 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x77dacebf connecting to ZooKeeper ensemble= namenode.com:2181,cloud-manager.com:2181 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.3.0--1, built on 12/17/2014 02:45 GMT 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:host.name =ip-20-0-0-75 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_75 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.75.x86_64/jre 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.class.path=.:hbase-connect-1.0.0.jar 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:java.compiler=NA 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.name =Linux 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:os.version=3.14.23-22.44.amzn1.x86_64 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.name =tom 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/tom 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/tom/jobs 15/02/17 12:05:08 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=namenode.com:2181,cloud-manager.com:2181 sessionTimeout=9 watcher=hconnection-0x77dacebf, quorum=namenode.com:2181, cloud-manager.com:2181, baseZNode=/hbase 15/02/17 12:05:08 INFO zookeeper.ClientCnxn: Opening socket connection to server namenode.com/54.172.21.54:2181. Will not attempt to authenticate using SASL (unknown error) 15/02/17 12:05:09 INFO zookeeper.ClientCnxn: Socket connection established to namenode.com/54.172.21.54:2181, initiating session 15/02/17 12:05:09 INFO zookeeper.ClientCnxn: Session establishment complete on server namenode.com/54.172.21.54:2181, sessionid = 0x24b7c7ba3532b32, negotiated timeout = 6 15/02/17 12:05:11 INFO client.HConnectionManager$HConnectionImplementation: Closing master protocol: MasterService 15/02/17 12:05:11 INFO client.HConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x24b7c7ba3532b32 15/02/17 12:05:11 INFO zookeeper.ZooKeeper: Session: 0x24b7c7ba3532b32 closed 15/02/17 12:05:11 INFO zookeeper.ClientCnxn: EventThread shut down Hbase Running 15/02/17 12:05:11 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x1003cac6 connecting to ZooKeeper ensemble= namenode.com:2181,cloud-manager.com:2181 15/02/17 12:05:11 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=namenode.com:2181,cloud-manager.com:2181 sessionTimeout=9 watcher=hconnection-0x1003cac6, quorum=namenode.com:2181, cloud-manager.com:2181, baseZNode=/hbase 15/02/17 12:05:11 INFO zookeeper.ClientCnxn: Opening socket connection to server namenode.com/54.172.21.54:2181. Will not attempt to authenticate using SASL (unknown error) 15/02/17 12:05:12 INFO zookeeper.ClientCnxn: Socket connection established to namenode.com/54.172.21.54:2181, initiating session 15/02/17 12:05:12 INFO zookeeper.ClientCnxn: Session establishment complete on server namenode.com/54.172.21.54:2181, sessionid = 0x24b7c7ba3532b34, negotiated timeout = 6 Looking at the revert urgently! Thanks!
