RE: basic, dumb getting started question (single-node)
Alternatively, for hive-site.xml, you can create an empty XML file with just the header and a set of configuration tags () and only fill in those properties that you want to change; Hive will then use the defaults for everything else. Either approach works. -Chris Dragga From: Ritesh Kumar Singh [mailto:riteshoneinamill...@gmail.com] Sent: Thursday, November 13, 2014 3:32 PM To: user@hive.apache.org Subject: Re: basic, dumb getting started question (single-node) Great. However u can configure your hive manually when ever you have some time( or in case next time you get stuck somewhere :p). Just go to the $HIVE_HOME/conf/ directory. U will see a lot of template files in there. Each one is written with most of the basic params set. Now what we do is copy all the files with .template extensions to their normal extensions. Ex: copy hive-env.sh.template to hive-env.sh in the same directory. Once you have copied the template files as normal ones, you can manually tune them by specifying all their properties. These properties are then automatically loaded whenever you start your hive server/worker. On Fri, Nov 14, 2014 at 1:34 AM, Nicholas Murphy mailto:nick.mur...@oracle.com>> wrote: Okay, an explanation of my idiocy for future idiots: It seemed like the documentation was saying running HCatalog was a necessary prerequisite, and it's not. I couldn't start the HCatalog server out of the box (I still can't...it complains about a lack of hive-site.xml), but running hive works (I think) just fine. Thanks/sorry, Nick > On Nov 12, 2014, at 3:12 PM, Ritesh Kumar Singh > mailto:riteshoneinamill...@gmail.com>> wrote: > > Run this first: > > >cp $HIVE_HOME/conf/hive-env.sh.template $HIVE_HOME/conf/hive-env.sh > >gedit $HIVE_HOME/conf/hive-env.sh > > Uncomment the lines towards the bottom that asks for HADDOP_HOME and > HIVE_CONF_DIR and set the locations. > > On Thu, Nov 13, 2014 at 4:31 AM, Gopal V > mailto:gop...@apache.org>> wrote: > On 11/12/14, 1:27 PM, Nicholas Murphy wrote: > > Hadoop version 2.5.1, Hive version 0.13.1, Oracle JDK (1.6, I believe), > Debian 7.7. > > I notice the default conf/ directory has a bunch of template files, but only > that. Can someone > point me to a resource, or to an example of what configuration I need, to > actually run Hive > correctly out of the box on a single machine? > > I do a build the first thing every morning with the latest of Tez/Hive & > leave perf runs in the night, if all day it didn't give me any errors. > > So, I run into this problem often enough that I carry an easy build+install > combo as part of my git repos. > > https://github.com/t3rmin4t0r/tez-autobuild > > FYI, this tracks bleeding edge of Hive+Tez (& ships a rough > hive-site.xml.default which corresponds to one of my setups). > > That Makefile + the hive-site.xml.default/.frag should help - you'll have to > edit the defaults for things like the mysql:// jdbc configs for metastore. > > Cheers, > Gopal >
Re: basic, dumb getting started question (single-node)
Great. However u can configure your hive manually when ever you have some time( or in case next time you get stuck somewhere :p). Just go to the $HIVE_HOME/conf/ directory. U will see a lot of template files in there. Each one is written with most of the basic params set. Now what we do is copy all the files with .template extensions to their normal extensions. Ex: copy hive-env.sh.template to hive-env.sh in the same directory. Once you have copied the template files as normal ones, you can manually tune them by specifying all their properties. These properties are then automatically loaded whenever you start your hive server/worker. On Fri, Nov 14, 2014 at 1:34 AM, Nicholas Murphy wrote: > Okay, an explanation of my idiocy for future idiots: > > It seemed like the documentation was saying running HCatalog was a > necessary prerequisite, and it's not. I couldn't start the HCatalog server > out of the box (I still can't...it complains about a lack of > hive-site.xml), but running hive works (I think) just fine. > > Thanks/sorry, > Nick > > > On Nov 12, 2014, at 3:12 PM, Ritesh Kumar Singh < > riteshoneinamill...@gmail.com> wrote: > > > > Run this first: > > > > >cp $HIVE_HOME/conf/hive-env.sh.template $HIVE_HOME/conf/hive-env.sh > > >gedit $HIVE_HOME/conf/hive-env.sh > > > > Uncomment the lines towards the bottom that asks for HADDOP_HOME and > HIVE_CONF_DIR and set the locations. > > > > On Thu, Nov 13, 2014 at 4:31 AM, Gopal V wrote: > > On 11/12/14, 1:27 PM, Nicholas Murphy wrote: > > > > Hadoop version 2.5.1, Hive version 0.13.1, Oracle JDK (1.6, I believe), > Debian 7.7. > > > > I notice the default conf/ directory has a bunch of template files, but > only that. Can someone > > point me to a resource, or to an example of what configuration I need, > to actually run Hive > > correctly out of the box on a single machine? > > > > I do a build the first thing every morning with the latest of Tez/Hive & > leave perf runs in the night, if all day it didn't give me any errors. > > > > So, I run into this problem often enough that I carry an easy > build+install combo as part of my git repos. > > > > https://github.com/t3rmin4t0r/tez-autobuild > > > > FYI, this tracks bleeding edge of Hive+Tez (& ships a rough > hive-site.xml.default which corresponds to one of my setups). > > > > That Makefile + the hive-site.xml.default/.frag should help - you'll > have to edit the defaults for things like the mysql:// jdbc configs for > metastore. > > > > Cheers, > > Gopal > > > >
Re: basic, dumb getting started question (single-node)
Okay, an explanation of my idiocy for future idiots: It seemed like the documentation was saying running HCatalog was a necessary prerequisite, and it's not. I couldn't start the HCatalog server out of the box (I still can't...it complains about a lack of hive-site.xml), but running hive works (I think) just fine. Thanks/sorry, Nick > On Nov 12, 2014, at 3:12 PM, Ritesh Kumar Singh > wrote: > > Run this first: > > >cp $HIVE_HOME/conf/hive-env.sh.template $HIVE_HOME/conf/hive-env.sh > >gedit $HIVE_HOME/conf/hive-env.sh > > Uncomment the lines towards the bottom that asks for HADDOP_HOME and > HIVE_CONF_DIR and set the locations. > > On Thu, Nov 13, 2014 at 4:31 AM, Gopal V wrote: > On 11/12/14, 1:27 PM, Nicholas Murphy wrote: > > Hadoop version 2.5.1, Hive version 0.13.1, Oracle JDK (1.6, I believe), > Debian 7.7. > > I notice the default conf/ directory has a bunch of template files, but only > that. Can someone > point me to a resource, or to an example of what configuration I need, to > actually run Hive > correctly out of the box on a single machine? > > I do a build the first thing every morning with the latest of Tez/Hive & > leave perf runs in the night, if all day it didn't give me any errors. > > So, I run into this problem often enough that I carry an easy build+install > combo as part of my git repos. > > https://github.com/t3rmin4t0r/tez-autobuild > > FYI, this tracks bleeding edge of Hive+Tez (& ships a rough > hive-site.xml.default which corresponds to one of my setups). > > That Makefile + the hive-site.xml.default/.frag should help - you'll have to > edit the defaults for things like the mysql:// jdbc configs for metastore. > > Cheers, > Gopal >
Re: Apache Hive 0.14.0 prerequisites
To run with Tez you need Tez 0.5.2 and Hadoop 2.x. Thanks, Gunther. On Thu, Nov 13, 2014 at 12:55 AM, Uli Bethke wrote: > What are the prerequisites of running Hive 0.14 (if any)? Is Tez 0.6 > required (if I want to use TEZ as exec engine obviousy) or is Tez 0.5 ok? > What about versions of Hadoop and HDFS? Any others? > Thanks > Uli > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: question on HIVE-5891
Chen Did you find a workarround ? Anybody else have a suggestion ? Thank you Stephane On Mon, Aug 4, 2014 at 9:00 AM, Chen Song wrote: > I am using cdh5 distribution and It doesn't look like this jira > > https://issues.apache.org/jira/browse/HIVE-5891 > > is backported into cdh 5.1.0. > > Is there a workaround to modify the query that is subject to this problem? > > -- > Chen Song > >
Apache Hive 0.14.0 prerequisites
What are the prerequisites of running Hive 0.14 (if any)? Is Tez 0.6 required (if I want to use TEZ as exec engine obviousy) or is Tez 0.5 ok? What about versions of Hadoop and HDFS? Any others? Thanks Uli
