Re: Running hive on tez locally

2015-08-07 Thread Raajay
Thanks for the configs. When I run hive it crashes because TEZ libraries were not found. How do I point Hive to tez libraries? Is it sufficient to populate CLASSPATH environment variables with location of tez libraries ? Raajay On Fri, Aug 7, 2015 at 3:16 PM, Jason Dere wrote: > If you add t

Re: Running hive on tez locally

2015-08-07 Thread Jason Dere
If you add these settings (paths are up to you), you can run Hive with Tez in local mode. You'll also need to make sure your classpath has the Tez libs etc. set hive.user.install.directory=file:///tmp; set fs.default.name=file:///; set fs.defaultFS=file:///; set tez.staging-dir=/tmp; set tez.ign

Re: Running hive on tez locally

2015-08-07 Thread Prasanth Jayachandran
Hi Can you make sure the following configs are set and appropriately pointing to your corresponding local directories? set hive.user.install.directory=file:///tmp; set fs.default.name=file:///; set fs.defaultFS=file:///; set tez.staging-dir=/tmp; set tez.ignore.lib.uris=true; set tez.runtime.opt

Running hive on tez locally

2015-08-07 Thread Raajay
I have been running Hive queries on a single node (no HDFS). I realize that the queries get compiled as map-reduce jobs and not as TEZ jobs even though "hive.execution.engine=tez" is set. Is that expected ? If yes, what is the ideal environment for debugging hive on tez? Raajay

Re: Persistent (and possibly asynchronous) Hive access from within Scala

2015-08-07 Thread Jörn Franke
I have no problems to use jdbc for hiveserver2. I think you need the hive*jdbc*standalone.jar and i think hadoop-commons*.jar Le ven. 7 août 2015 à 5:23, Stephen Bly a écrit : > What library should I use if I want to make persistent connections from > within Scala/Java? I’m working on a web ser

Re: Error communicating with metastore

2015-08-07 Thread Alan Gates
What version of Hive did you say you were using? In 0.14 we switched to make sure all jdbc connections are either serializable or read_committed, yet the error message below seems to indicate you're seeing a connection request that doesn't match this. The only other thing I know to try i swit

Re: Error communicating with metastore

2015-08-07 Thread kulkarni.swar...@gmail.com
Sarath, I assume that the failure you are seeing doesn't happen immediately? The current timeout on the client is set to 5 minutes. A socket timeout usually means that the client timed out before it can even get a response from the server. So the server could either be very busy doing something if

Re: Error communicating with metastore

2015-08-07 Thread Sarath Chandra
Thanks Eugene, Alan. @Alan, As suggested checked the logs, here is what I found - - On starting metastore server, I'm seeing following messages in the log file - *2015-08-07 18:32:56,678 ERROR [Thread-7]: compactor.Initiator (Initiator.java:run(134)) - Caught an exception in the main loop