Re: Spark SQL is not returning records for HIVE transactional tables on HDP

Thanks for update Alan Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 14 March 2016 at 17:49, Alan

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

> On Mar 14, 2016, at 10:31, Mich Talebzadeh wrote: > > That is an interesting point Alan. > > Does this imply that Hive on Spark (Hive 2 encourages Spark or TEZ) is going > to have an issue with transactional tables? I was partially wrong. In HIVE-12366 Wei

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

That is an interesting point Alan. Does this imply that Hive on Spark (Hive 2 encourages Spark or TEZ) is going to have an issue with transactional tables? Besides this begs the question that we still run Hive on Spark 1.3.1 engine. We don't seem to make Hive work on Spark engine with a newer

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

I don’t know why you’re seeing Hive on Spark sometimes work with transactional tables and sometimes not. But note that in general it doesn’t work. The Spark runtime in Hive does not send heartbeats to the transaction/lock manager so it will timeout any job that takes longer than the heartbeat

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

Hi All, We are using for Spark SQL : - Hive :1.2.1 - Spark : 1.3.1 - Hadoop :2.7.1 Let me know if needs other details to debug the issue. Regards Sanjiv Singh Mob : +091 9990-447-339 On Sun, Mar 13, 2016 at 1:07 AM, Mich Talebzadeh wrote: > Hi, > >

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

Hi, Thanks for the input. I use Hive 2 and still have this issue. 1. Hive version 2 2. Hive on Spark engine 1.3.1 3. Spark 1.5.2 I have added Hive user group to this as well. So hopefully we may get some resolution. HTH Dr Mich Talebzadeh LinkedIn *

Re: Spark SQL is not returning records for HIVE transactional tables on HDP

This is an interesting one as it appears that a hive transactional table 1. Hive version 2 2. Hive on Spark engine 1.3.1 3. Spark 1.5.2 hive> create table default.foo(id int) clustered by (id) into 2 buckets STORED AS ORC TBLPROPERTIES ('transactional'='true'); hive> insert into