Re: fail to drop table after upgrade to hive 0.14.0

2015-02-23 Thread Srinivas Thunga
Apply new configuration properties for hive0.14 in hive-site.xml file then drop or delete table On Monday, February 23, 2015, Jie Zhang wrote: > Hi, > > I have an application using hive, and just upgraded from 0.13.1 to 0.14.0. > However, a bunch of unit testcases, which are using embedded derby

Re: oozie not running

2015-02-23 Thread Rahul Channe
Hi Mohammad, I checked the following path but did not find any hadoop jar /home/user/oozie-4.1.0/webapp/target/oozie-webapp-4.1.0/WEB-INF/lib user@ubuntuvm:~/oozie-4.1.0/webapp/target/oozie-webapp-4.1.0/WEB-INF/lib$ ls -ltr hadoop*.jar ls: cannot access hadoop*.jar: No such file or directory use

Re: oozie not running

2015-02-23 Thread Biswajit Nayak
you have upload the share lib jar to war ~Biswa On Mon, Feb 23, 2015 at 7:00 PM, Rahul Channe wrote: > Hi Mohammad, > > I checked the following path but did not find any hadoop jar > > /home/user/oozie-4.1.0/webapp/target/oozie-webapp-4.1.0/WEB-INF/lib > > user@ubuntuvm:~/oozie-4.1.0/webapp/ta

Re: oozie not running

2015-02-23 Thread Rahul Channe
Hi Biswajit/Mohammad, I am able to run oozie, the hadoop jars were missing during the prepare-war step. Thank you for your pointers. Regards, Rahul On Monday, February 23, 2015, Biswajit Nayak wrote: > you have upload the share lib jar to war > > ~Biswa > > > On Mon, Feb 23, 2015 at 7:00 PM,

HiveServer2 memory Problems

2015-02-23 Thread vengatesh.babu
Dear all, I am running HiveServer2(0.14). Java Heap Memory keeps on increasing for failed Queries. Below Jira looks pretty same. https://issues.apache.org/jira/browse/HIVE-7021 They have given patch for that also. Whether given patch is correct ? If yes, why patch is not merged with default

Re: fail to drop table after upgrade to hive 0.14.0

2015-02-23 Thread Jessica Zhang
Thanks for the reply! Would you please elaborate which new properties for hive 0.14? Jessica > On Feb 23, 2015, at 1:03 AM, Srinivas Thunga > wrote: > > Apply new configuration properties for hive0.14 in hive-site.xml file then > drop or delete table > >> On Monday, February 23, 2015, Jie Z

Hive Json Serde

2015-02-23 Thread Udit Mehta
I am using hive from HDP 2.2 and need to create a Hive table to query multilevel Json data in HDFS of the following format: { "timestamp": "1424100629409", "head": { "time": "2015-02-16T15:30:29.409Z", "place": { "url": null, "country": "US" }

Re: fail to drop table after upgrade to hive 0.14.0

2015-02-23 Thread Srinivas Thunga
Hi, Below are new properties to be set in Hive-Site.xml hive.support.concurrency – true hive.enforce.bucketing – true hive.exec.dynamic.partition.mode – nonstrict hive.txn.manager – org.apache.hadoop.hive.ql.lockmgr.DbTxnManager hive.compactor.initiator.on – true hive.compactor.worker.threa

Re: fail to drop table after upgrade to hive 0.14.0

2015-02-23 Thread Srinivas Thunga
hi, Table should be created as orc table like create table HiveTest (eid int,ename string,desig string,sal int,dept string) clustered by (dept) into 3 buckets stored as orc TBLPROPERTIES ('transactional'='true') ; *Thanks & Regards,* *Srinivas T* On Tue, Feb 24, 2015 at 9:47 AM, Srinivas Thun

Select distinct on partitioned column requires reading all the files?

2015-02-23 Thread Stephen Boesch
When querying a hive table according to a partitioning column, it would be logical that a simple select count(distinct partitioned_column_name) from my_partitioned_table would complete almost instantaneously. But we are seeing that both hive and impala are unable to execute this query properly:

Re: Select distinct on partitioned column requires reading all the files?

2015-02-23 Thread Gopal Vijayaraghavan
Hi, Are you sure you have hive.optimize.metadataonly=true ? I¹m not saying it will complete instantaneously (possibly even be very slow, due to the lack of a temp-table optimization of that), but it won¹t read any part of the actual table. Cheers, Gopal From: Stephen Boesch Reply-To: "user@

Re: Select distinct on partitioned column requires reading all the files?

2015-02-23 Thread Stephen Boesch
Great thanks. Is this a server-side-only /requires restart parameter? 2015-02-23 22:36 GMT-08:00 Gopal Vijayaraghavan : > Hi, > > Are you sure you have > > hive.optimize.metadataonly=true ? > > I’m not saying it will complete instantaneously (possibly even be very > slow, due to the lack of a te

RE: Hive Json Serde

2015-02-23 Thread Guy Doulberg
Hi Udit 3 years ago I extended the hive-JSON-serde to support maps and arrays. I think I am the only user of this code, ☺ It still work for me today with hive 13 You can find my code here: https://github.com/guydou/hive-json-serde Using this serde you can declare a unique field also called json