Re: hive concurrency not working

-- I am pretty sure that they will support it because the Spark option is supported Hortonworks support Spark but not Hive on Spark. Their official distro is Hive on Tez + LLAP Not sure where you get your information from though I got it from Hortonworks and I know that Dr Mich Talebzadeh

Re: hive concurrency not working

I am pretty sure that they will support it because the Spark option is supported. Not sure where you get your information from though... > On 05 Aug 2016, at 11:01, Mich Talebzadeh wrote: > > great in that case they can try it and I am pretty sure if they are stuck

Re: hive concurrency not working

Actually that is correct with regard to MR. The standard MapReduce as I know reads the data from HDFS, apply map-reduce algorithm and writes back to HDFS. If there are many iterations of map-reduce then, there will be many intermediate writes to HDFS. This is all serial writes to disk. Each

Re: hive concurrency not working

> Depends on how you configured scheduling in yarn ... ... >> you won't have this problem if you use Spark as the execution engine? >>That handles concurrency OK If I read this right, it is unlikely to be related to YARN configs. The Hue issue is directly related to how many Tez/Spark sessions

Re: hive concurrency not working

great in that case they can try it and I am pretty sure if they are stuck they can come and ask you for expert advice since Hortonworks do not support Hive on Spark and I know that Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: hive concurrency not working

Depends on how you configured scheduling in yarn ... > On 05 Aug 2016, at 08:39, Mich Talebzadeh wrote: > > you won't have this problem if you use Spark as the execution engine? That > handles concurrency OK > > Dr Mich Talebzadeh > > LinkedIn >

Re: hive concurrency not working

That is not correct the option is there to install it. > On 05 Aug 2016, at 08:41, Mich Talebzadeh wrote: > > You won't have this problem if you use Spark as the execution engine! This > set up handles concurrency but Hive with Spark is not part of the HW distro. >

Re: hive concurrency not working

You won't have this problem if you use Spark as the execution engine! This set up handles concurrency but Hive with Spark is not part of the HW distro. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: hive concurrency not working

you won't have this problem if you use Spark as the execution engine? That handles concurrency OK Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: hive concurrency not working

Thanks everyone.. we are raising case with Hortonworks On Wed, Aug 3, 2016 at 6:44 PM, Raj hadoop wrote: > Dear All, > > In need or your help, > > we have horton works 4 node cluster,and the problem is hive is allowing > only one user at a time, > > if any second resource

Re: hive concurrency not working

Reg " hive concurrency not working" in HDP. yes, it's known issue in HDP and with Hue 2.6 I have below information on this issue and hope it will help you. When you are running Hive queries through Hue (Beeswax), users are unable to run multiple queries

Re: hive concurrency not working

You need to configure the yarn scheduler (fair or capacity depending on your needs) > On 03 Aug 2016, at 15:14, Raj hadoop wrote: > > Dear All, > > In need or your help, > > we have horton works 4 node cluster,and the problem is hive is allowing only > one user at a

RE: hive concurrency not working

You need to increase the value for the below hive property value in Ambari hive.server2.tez.sessions.per.default.queue If this does not fix the issue then you need to update the capacity scheduler property values. From: Raj hadoop [mailto:raj.had...@gmail.com] Sent: Wednesday, August 03, 2016

Re: hive concurrency not working

Can you elaborate on not working? Is it giving an error, or hanging (and if so, does it queue and eventually execute); are you using HS2; what commands/actions do the users perform? Also, what version of Hive is this? From: Raj hadoop >