Sent from my iPhone
On Jul 25, 2012, at 8:58 PM, vijay shinde <vijaysanj...@gmail.com> wrote: > Hi Bejoy, > > I made some changes as per your suggetion. > > Here is the error from the > http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207251858_0004 Job: > > Error: java.lang.ClassNotFoundException: org.apache.zookeeper.KeeperException > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:307) > at sun.misc.Launcher$ > > I went ahead and updated the hadoop-env.sh file and set the class path for > hbase and zookeeper as follows: > # Extra Java CLASSPATH elements. Optional. > export > HADOOP_CLASSPATH="/usr/lib/hive/lib/hbase-0.92.jar:/usr/lib/hive/lib/zookeeper-3.4.3.jar:$HADOOP_CLASSPATH" > > Here is snippet of hive-site.xml file > > <name>hive.aux.jars.path</name> > <value>file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u4.jar,file:///usr/lib/hive/lib/hbase-0.92.jar,file:///usr/lib/hive/lib/zookeeper-3.4.3.jar,file:///usr/lib/hive/lib/hive-contrib-0.7.1-cdh3u4.jar</value> > </property> > <name>hbase.zookeeper.quorum</name> > <value>localhost</value> > </property> > > Error message while executing hive query > > [root@localhost hive]# ./bin/hive > Hive history file=/tmp/root/hive_job_log_root_201207252044_1993919630.txt > hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes where > foo=98; > Total MapReduce jobs = 1 > Launching Job 1 out of 1 > Number of reduce tasks is set to 0 since there's no reduce operator > Starting Job = job_201207251858_0004, Tracking URL = > http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207251858_0004 > Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job > -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201207251858_0004 > 2012-07-25 20:46:38,207 Stage-0 map = 0%, reduce = 0% > 2012-07-25 20:47:35,920 Stage-0 map = 100%, reduce = 100% > Ended Job = job_201207251858_0004 with errors > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask > hive> > > I am lost need help badly!!!!!!!!!!!!! > > Vijay > > > > On Wed, Jul 25, 2012 at 9:47 AM, Bejoy Ks <bejoy...@yahoo.com> wrote: > Hi Vijay > > You have provided the hbase master directly. (It is fine for single node > hbase installation). But still can you try providing the zookeeper quorum > instead. > > If that doesn't work as well , please post the error log from the mapreduce > tasks? > > Just go the jobtracker page and drill down on the corresponding job to get > the failed tasks. From each failed tasks you can get the error logs. > http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005 > > > Regards > Bejoy KS > > From: vijay shinde <vijaysanj...@gmail.com> > To: user@hive.apache.org; bejoy...@yahoo.com > Sent: Wednesday, July 25, 2012 6:58 PM > Subject: Re: HBASE and HIVE Integration > > Hi Bejoy, > > Thanks for quick reply. Here are some additional details > > Cloudera Version - CDH3U4 > > hive-site.xml > <property> > <name>hive.aux.jars.path</name> > <value>file:///usr/lib/hive/lib/hive-hbase-handler-0.7.1-cdh3u2.jar,file:///usr/lib/hive/lib/hbase-0.90.4-cdh3u2.jar,file:///usr/lib/hive/lib/zookeeper-3.3.1.jar,file:///usr/lib/hive/lib/hive-contrib-0.7.1-cdh3u2.jar</value> > </property> > > Execution Log > > 1. start zookeeper > [root@localhost zookeeper]# ./bin/zkServer.sh start > > 2. start hbase > > 3. start hive. I am setting hive jars in hive-site.xml > > ./bin/hive -hiveconf hbase.master=127.0.1.1:60010 > > 4. Create new HBase table which is to be managed by Hive > > CREATE TABLE hive_hbasetable_k(key int, value string) > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' > WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val") > TBLPROPERTIES ("hbase.table.name" = "hivehbasek"); > > 5. Create a logical table pokes in Hive > CREATE TABLE pokes (foo INT, bar STRING); > 6. HIve error while inserting the data from Hive Poke table to HBASE table > hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes WHERE > foo=98; > Total MapReduce jobs = 1 > Launching Job 1 out of 1 > Number of reduce tasks is set to 0 since there's no reduce operator > Starting Job = job_201207250246_0005, Tracking URL = > http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005 > Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job > -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201207250246_0005 > 2012-07-25 04:26:00,198 Stage-0 map = 0%, reduce = 0% > 2012-07-25 04:27:00,767 Stage-0 map = 0%, reduce = 0% > 2012-07-25 04:27:08,844 Stage-0 map = 100%, reduce = 100% > Ended Job = job_201207250246_0005 with errors > > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask > Let me know if you need any additonal information. > > Thanks, > Vijay > > On Wed, Jul 25, 2012 at 5:30 AM, Bejoy KS <bejoy...@yahoo.com> wrote: > Hi Vijay > > Can you share more details like > > The CDH Version/Hive version you are using > > Steps you followed for hive hbase integration with the values you set > > The DDL used for hive hbase integration > > The actual error from failed map reduce task > > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > From: vijay shinde <vijaysanj...@gmail.com> > Date: Wed, 25 Jul 2012 04:45:41 -0400 > To: <user@hive.apache.org> > ReplyTo: user@hive.apache.org > Subject: HBASE and HIVE Integration > > I am facing issue while executing HIVE queries on HBASE-HIVE integration. > I followed the wiki hbase-hive integration > https://cwiki.apache.org/Hive/hbaseintegration.html > > I have already passed all the required jars for auxpath in hive-site.xml file. > I am using Cloudera CDH demo VM.. Any help would be highly appreciated > > hive> INSERT OVERWRITE TABLE hive_hbasetable_k SELECT * FROM pokes WHERE > foo=98; > Total MapReduce jobs = 1 > Launching Job 1 out of 1 > Number of reduce tasks is set to 0 since there's no reduce operator > Starting Job = job_201207250246_0005, Tracking URL = > http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201207250246_0005 > Kill Command = /usr/lib/hadoop-0.20/bin/hadoop job > -Dmapred.job.tracker=0.0.0.0:8021 -kill job_201207250246_0005 > 2012-07-25 04:26:00,198 Stage-0 map = 0%, reduce = 0% > 2012-07-25 04:27:00,767 Stage-0 map = 0%, reduce = 0% > 2012-07-25 04:27:08,844 Stage-0 map = 100%, reduce = 100% > Ended Job = job_201207250246_0005 with errors > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.MapRedTask > hive> > > > > >
