Re: A dedicated Web UI interface for Hive

2016-07-15 Thread Mich Talebzadeh
Hi Marcin, Which two web interfaces are these. I know the usual one on 8088 any other one? I want something in line with what Spark provides. I thought Gopal has got something: [image: Inline images 1] Cheers Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh

Helping Spread the Word about Apachecon EU 2016

2016-07-15 Thread Sharan Foga
Hi Everyone I'm forwarding the following message on behalf of Rich Bowen and the Apachecon team === As you are aware, we are holding ApacheCon in Seville in November. While this seems like a long way away, it is critical that we get on people's calendar now, so that they can plan, get b

Error starting HiveServer2: could not start ThriftBinaryCLIService

2016-07-15 Thread ram kumar
Hi all, I started Hive Thrift Server with command, /sbin/start-thriftserver.sh --master yarn -hiveconf hive.server2.thrift.port 10003 The Thrift server started at the particular node without any error. When doing the same, except pointing to different node to start the server, ./sbin/start-th

Hive on TEZ + LLAP

2016-07-15 Thread Ashok Kumar
Hi, Has anyone managed to make Hive work with Tez + LLAP as the query engine in place of Map-reduce please? If you configured it yourself which version of Tez and LLAP work with Hive 2. Do I need to build Tez from source for example Thanks

Re: A dedicated Web UI interface for Hive

2016-07-15 Thread Marcin Tustin
I was thinking of query and admin interfaces. There's ambari, which has plugins for introspecting what's up with tez sessions. I can't use those because I don't use the yarn history server (I find it very flaky). There's also hue, which is a query interface. If you're running on spark as the exe

Re: Hive on TEZ + LLAP

2016-07-15 Thread Jörn Franke
I would recommend a distribution such as Hortonworks were everything is already configured. As far as I know llap is currently not part of any distribution. > On 15 Jul 2016, at 17:04, Ashok Kumar wrote: > > Hi, > > Has anyone managed to make Hive work with Tez + LLAP as the query engine in >

Re: A dedicated Web UI interface for Hive

2016-07-15 Thread Mich Talebzadeh
Hi Marcin, For Hive on Spark I can use Spark 1.3.1 UI which does not have DAG diagram (later versions like 1.6.1 have it). But yes you are correct. However, I was certain that Gopal was working on a UI interface if my memory serves right. Cheers, Mich Dr Mich Talebzadeh LinkedIn * https:

Re: Hive on TEZ + LLAP

2016-07-15 Thread Long, Andrew
Amazon AWS has recently released EMR with Hive + Tez as well. Cheers Andrew From: Jörn Franke Reply-To: "user@hive.apache.org" Date: Friday, July 15, 2016 at 8:36 AM To: "user@hive.apache.org" Subject: Re: Hive on TEZ + LLAP I would recommend a distribution such as Hortonworks were everything

Re: Hash table in map join - Hive

2016-07-15 Thread Lalitha MV
Hi Gopal, Thanks a lot for the above update. I had only one question hanging: When is OOM error actually thrown? With hive.mapjoin.hybridgrace.hashtable set to true, spilling should be possible, so OOM error should not come. Is it the case when the hash table of not even one of the 16 partitions

Re: Hive on TEZ + LLAP

2016-07-15 Thread Ashok Kumar
thanks. I have also heard about Hortonworks with Tez + LLAP but that is a distro? Is it a complicated work to build it with Do It Yourself so to speak? On Friday, 15 July 2016, 19:23, "Long, Andrew" wrote: #yiv7626288998 #yiv7626288998 -- _filtered #yiv7626288998 {panose-1:2 4 5 3 5 4

Re: Hive on TEZ + LLAP

2016-07-15 Thread Andrew Sears
HDP 2.5 includes LLAP. Cheers, Andrew On Fri, Jul 15, 2016 at 11:36 AM, Jörn Franke < jornfra...@gmail.com [jornfra...@gmail.com] > wrote: I would recommend a distribution such as Hortonworks were everything is already configured. As far as I know llap is currently not part of any distribution.

Re: Hive on TEZ + LLAP

2016-07-15 Thread Gopal Vijayaraghavan
> I have also heard about Hortonworks with Tez + LLAP but that is a distro? Yes. AFAIK, during Hadoop Summit there was a HDP 2.5 techpreview sandbox instance which shipped Hive2 (scroll down all the way to end in the downloads page). Enable the "interactive mode" in Ambari for a HiveServer2 conf

Re: Hash table in map join - Hive

2016-07-15 Thread Gopal Vijayaraghavan
> When is OOM error actually thrown? With >hive.mapjoin.hybridgrace.hashtable set to true, spilling should be >possible, so OOM error should not come. ... > Is it the case when the hash table of not even one of the 16 partitions >fits in memory? It will OOM if any one of them overflows. The gra

Re: A dedicated Web UI interface for Hive

2016-07-15 Thread Edward Capriolo
I build one a long time ago still in tree very defunct best bet is working with hue or whatever Horton is pushing as not to fragment 4 ways. On Jul 15, 2016 12:56 PM, "Mich Talebzadeh" wrote: > Hi Marcin, > > For Hive on Spark I can use Spark 1.3.1 UI which does not have DAG diagram > (later vers