RE: ERROR :regarding Hive WI, hwi service is not running
Hi Bertrand and Swarnim, Its done now :-) The issue was that the error message is not actually printing the path it is looking in. the path is relative to hive home. I tried /lib/hive-hwi-0.8.1.war instead of /opt/hive-0.8.1/lib/hive-hwi-0.5.0.war and its running now :-) Regards Yogesh Kumar Date: Thu, 20 Sep 2012 00:05:45 +0200 Subject: Re: ERROR :regarding Hive WI, hwi service is not running From: decho...@gmail.com To: user@hive.apache.org Check your configuration (and the default value) and change it.I know there was issues about the check and/or the error message for previous versions of hive.I had the same issue but can't remember the exact details (maybe it was due to relative path vs absolute). Try1) rename the war2) put the absolute path in your conf3) run it Regards Bertrand On Thu, Sep 20, 2012 at 12:02 AM, yogesh dhari wrote: Swarnim, "opt/hive-0.8.1/lib" already exists, its the path of hive dir & hive-hwi-0.8.1.war already exists there. /opt/hive-0.8.1/lib ls -l -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar -rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar Thats what its very surprising :-( Thanks & Regards Yogesh Kumar From: kulkarni.swar...@gmail.com Date: Wed, 19 Sep 2012 16:58:01 -0500 Subject: Re: ERROR :regarding Hive WI, hwi service is not running To: user@hive.apache.org No. I meant create "/opt/hive-0.8.1/lib/" in HDFS and place the "hive-hwi-0.8.1.war" there. On Wed, Sep 19, 2012 at 4:55 PM, yogesh dhari wrote: Hello Swarnim, Are you saying to put hive-hwi-0.8.1.war into hadoop/lib ? I have put it over there and still the same issue.. Thanks & Regards Yogesh Kumar From: kulkarni.swar...@gmail.com Date: Wed, 19 Sep 2012 16:48:37 -0500 Subject: Re: ERROR :regarding Hive WI, hwi service is not running To: user@hive.apache.org It's probably looking for that file on HDFS. Try placing it there under the given location and see if you get the same error. On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: Hi all, I am trying to run hive wi but its showing FATAL, I have used this command hive --service hwi but it shows.. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi 12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war although lies there. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd /opt/hive-0.8.1/lib ls -l -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar -rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar Please suggest regarding Thanks & regards Yogesh Kumar -- Swarnim -- Swarnim -- Bertrand Dechoux
Re: ERROR :regarding Hive WI, hwi service is not running
Check your configuration (and the default value) and change it. I know there was issues about the check and/or the error message for previous versions of hive. I had the same issue but can't remember the exact details (maybe it was due to relative path vs absolute). Try 1) rename the war 2) put the absolute path in your conf 3) run it Regards Bertrand On Thu, Sep 20, 2012 at 12:02 AM, yogesh dhari wrote: > Swarnim, > > "opt/hive-0.8.1/lib" already exists, its the path of hive dir & > *hive-hwi-0.8.1.war > *already exists there. > > > */opt/hive-0.8.1/lib* > > ls -l > > -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar > -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar > -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar > -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar > *-rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war* > -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar > -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar > > > Thats what its very surprising :-( > > > Thanks & Regards > Yogesh Kumar > > > > -- > From: kulkarni.swar...@gmail.com > Date: Wed, 19 Sep 2012 16:58:01 -0500 > > Subject: Re: ERROR :regarding Hive WI, hwi service is not running > To: user@hive.apache.org > > No. I meant create "*/opt/hive-0.8.1/lib/" *in HDFS and place the > "*hive-hwi-0.8.1.war" > *there. > > On Wed, Sep 19, 2012 at 4:55 PM, yogesh dhari wrote: > > Hello Swarnim, > > Are you saying to put *hive-hwi-0.8.1.war *into hadoop/lib ? > > I have put it over there and still the same issue.. > > Thanks & Regards > Yogesh Kumar > > -- > From: kulkarni.swar...@gmail.com > Date: Wed, 19 Sep 2012 16:48:37 -0500 > Subject: Re: ERROR :regarding Hive WI, hwi service is not running > To: user@hive.apache.org > > > It's probably looking for that file on HDFS. Try placing it there under > the given location and see if you get the same error. > > On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: > > Hi all, > > I am trying to run hive wi but its showing FATAL, > > I have used this command > * > hive --service hwi * > > but it shows.. > > yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi > > *12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up > 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at > /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war > * > although lies there. > > > yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd > > */opt/hive-0.8.1/lib* > > ls -l > > -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar > -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar > -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar > -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar > *-rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war* > -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar > -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar > -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar > -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar > -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar > -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar > -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar > -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar > > > Please suggest regarding > > Thanks & regards > Yogesh Kumar > > > > > > > > > > > > > -- > Swarnim > > > > > -- > Swarnim > -- Bertrand Dechoux
RE: ERROR :regarding Hive WI, hwi service is not running
Swarnim, "opt/hive-0.8.1/lib" already exists, its the path of hive dir & hive-hwi-0.8.1.war already exists there. /opt/hive-0.8.1/lib ls -l -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar -rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar Thats what its very surprising :-( Thanks & Regards Yogesh Kumar From: kulkarni.swar...@gmail.com Date: Wed, 19 Sep 2012 16:58:01 -0500 Subject: Re: ERROR :regarding Hive WI, hwi service is not running To: user@hive.apache.org No. I meant create "/opt/hive-0.8.1/lib/" in HDFS and place the "hive-hwi-0.8.1.war" there. On Wed, Sep 19, 2012 at 4:55 PM, yogesh dhari wrote: Hello Swarnim, Are you saying to put hive-hwi-0.8.1.war into hadoop/lib ? I have put it over there and still the same issue.. Thanks & Regards Yogesh Kumar From: kulkarni.swar...@gmail.com Date: Wed, 19 Sep 2012 16:48:37 -0500 Subject: Re: ERROR :regarding Hive WI, hwi service is not running To: user@hive.apache.org It's probably looking for that file on HDFS. Try placing it there under the given location and see if you get the same error. On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: Hi all, I am trying to run hive wi but its showing FATAL, I have used this command hive --service hwi but it shows.. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi 12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war although lies there. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd /opt/hive-0.8.1/lib ls -l -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar -rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar Please suggest regarding Thanks & regards Yogesh Kumar -- Swarnim -- Swarnim
Re: ERROR :regarding Hive WI, hwi service is not running
No. I meant create "*/opt/hive-0.8.1/lib/" *in HDFS and place the "*hive-hwi-0.8.1.war" *there. On Wed, Sep 19, 2012 at 4:55 PM, yogesh dhari wrote: > Hello Swarnim, > > Are you saying to put *hive-hwi-0.8.1.war *into hadoop/lib ? > > I have put it over there and still the same issue.. > > Thanks & Regards > Yogesh Kumar > > -- > From: kulkarni.swar...@gmail.com > Date: Wed, 19 Sep 2012 16:48:37 -0500 > Subject: Re: ERROR :regarding Hive WI, hwi service is not running > To: user@hive.apache.org > > > It's probably looking for that file on HDFS. Try placing it there under > the given location and see if you get the same error. > > On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: > > Hi all, > > I am trying to run hive wi but its showing FATAL, > > I have used this command > * > hive --service hwi * > > but it shows.. > > yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi > > *12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up > 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at > /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war > * > although lies there. > > > yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd > > */opt/hive-0.8.1/lib* > > ls -l > > -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar > -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar > -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar > -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar > *-rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war* > -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar > -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar > -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar > -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar > -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar > -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar > -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar > -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar > > > Please suggest regarding > > Thanks & regards > Yogesh Kumar > > > > > > > > > > > > > -- > Swarnim > -- Swarnim
RE: ERROR :regarding Hive WI, hwi service is not running
Hello Swarnim, Are you saying to put hive-hwi-0.8.1.war into hadoop/lib ? I have put it over there and still the same issue.. Thanks & Regards Yogesh Kumar From: kulkarni.swar...@gmail.com Date: Wed, 19 Sep 2012 16:48:37 -0500 Subject: Re: ERROR :regarding Hive WI, hwi service is not running To: user@hive.apache.org It's probably looking for that file on HDFS. Try placing it there under the given location and see if you get the same error. On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: Hi all, I am trying to run hive wi but its showing FATAL, I have used this command hive --service hwi but it shows.. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi 12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war although lies there. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd /opt/hive-0.8.1/lib ls -l -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar -rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar Please suggest regarding Thanks & regards Yogesh Kumar -- Swarnim
Re: ERROR :regarding Hive WI, hwi service is not running
It's probably looking for that file on HDFS. Try placing it there under the given location and see if you get the same error. On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: > Hi all, > > I am trying to run hive wi but its showing FATAL, > > I have used this command > * > hive --service hwi * > > but it shows.. > > yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi > > *12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up > 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at > /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war > * > although lies there. > > > yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd > > */opt/hive-0.8.1/lib* > > ls -l > > -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar > -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar > -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar > -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar > -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar > *-rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war* > -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar > -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar > -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar > -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar > -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar > -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar > -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar > -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar > > > Please suggest regarding > > Thanks & regards > Yogesh Kumar > > > > > > > > > > -- Swarnim
ERROR :regarding Hive WI, hwi service is not running
Hi all, I am trying to run hive wi but its showing FATAL, I have used this command hive --service hwi but it shows.. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi 12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR file not found at /opt/hive-0.8.1/lib/hive-hwi-0.8.1.war although lies there. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ pwd /opt/hive-0.8.1/lib ls -l -rw-rw-r-- 1 root root 55876 Jan 26 2012 hive-common-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive-contrib-0.8.1.jar -rw-rw-r-- 1 root root 112440 Jan 26 2012 hive_contrib.jar -rw-rw-r-- 1 root root 3461228 Jan 26 2012 hive-exec-0.8.1.jar -rw-rw-r-- 1 root root 48829 Jan 26 2012 hive-hbase-handler-0.8.1.jar -rw-rw-r-- 1 root root 23529 Jan 26 2012 hive-hwi-0.8.1.jar -rwxrwxrwx 1 root root 28413 Jan 26 2012 hive-hwi-0.8.1.war -rw-rw-r-- 1 root root 58914 Jan 26 2012 hive-jdbc-0.8.1.jar -rw-rw-r-- 1 root root 1765743 Jan 26 2012 hive-metastore-0.8.1.jar -rw-rw-r-- 1 root root 14081 Jan 26 2012 hive-pdk-0.8.1.jar -rw-rw-r-- 1 root root 509488 Jan 26 2012 hive-serde-0.8.1.jar -rw-rw-r-- 1 root root 174445 Jan 26 2012 hive-service-0.8.1.jar -rw-rw-r-- 1 root root 110154 Jan 26 2012 hive-shims-0.8.1.jar -rw-rw-r-- 1 root root 15260 Jan 24 2012 javaewah-0.3.jar -rw-rw-r-- 1 root root 198552 Dec 24 2009 jdo2-api-2.3-ec.jar Please suggest regarding Thanks & regards Yogesh Kumar
Re: Latest Pig vs Hive comparisons
Although the two first links are interesting reads, I would recommend you the last one provided by Russel. The key thing is not to think "I will choose the most efficient wrt to performance" but "I will choose the most in tune with my use cases". Secondly, HCatalog is really something worth mentioning. Basically, the difference in format handling as explained in the other articles is less hard-lined now. Regards Bertrand On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney wrote: > A presentation on Hive vs Pig by a committer on both projects is here: > http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/ > > > Russell Jurney > twitter.com/rjurney > russell.jur...@gmail.com > datasyndrome.com > > On Sep 18, 2012, at 3:01 PM, Aniket Mokashi wrote: > > (Probably not what you are looking for) Check - > http://www.larsgeorge.com/2009/10/hive-vs-pig.html > > ~Aniket > > On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney > wrote: > >> A detailed post comparing Pig/Hive performance from last week: >> http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ >> >> Russell Jurney >> twitter.com/rjurney >> russell.jur...@gmail.com >> datasyndrome.com >> >> On Sep 14, 2012, at 10:55 AM, Anurag Tangri >> wrote: >> >> > Knowing performance statistics would be good too. >> > >> > Sent from my iPhone >> > >> > On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi >> wrote: >> > >> >> Hello Community, >> >> >> >> Is there any document/blog comparing different features offered by Pig >> 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? >> >> >> >> -Bharath >> > > > > -- > "...:::Aniket:::... Quetzalco@tl" > > -- Bertrand Dechoux
size of RCFile in hive
Hi I tried to convert and merge many small text files using RCFiles using hivesql,but hive produced some small rcfiles. set hive.exec.compress.output=true; set mapred.output.compress=true; set mapred.output.compression.codec=com.hadoop.compression.lzo.LzoCodec; set io.compression.codecs=com.hadoop.compression.lzo.LzoCodec; hive.merge.mapfiles=true hive.merge.mapredfiles=true hive.merge.size.per.task=64000 hive.merge.size.smallfiles.avgsize=8000 insert overwrite table rctable select . the settings: hive.merge.mapfiles=true hive.merge.mapredfiles=true hive.merge.size.per.task=64000 hive.merge.size.smallfiles.avgsize=8000 didn't work. who could tell me how to solve it?
