HIVE::START WITH and CONNECT BY implementation in Hive

2014-10-20 Thread yogesh dhari
Hello All How can we achive *start with .. connect by* clause can be used to select data that has a hierarchical relationship (usually some sort of parent-child (boss-employee or thing-parts). into Hive, or what would be the other work around to implement this. Please suggest Thanks in

Differenct between Parquet file Vs Hive RC file format

2014-10-20 Thread Ravi Prasad
Hi , Can anyone please tell the difference between Parquet file format and Hive RC file format. Both the file formats are *columnar storage*, then what are the advantages / disadvantage over others. -- -- Regards, RAVI PRASAD. T

Re: Hivemetastore Error: Duplicate entry

2014-10-20 Thread wzc
We also encounter this problem. It seems that it happens in various situations. Currently we patch https://issues.apache.org/jira/browse/HIVE-7167 which has some retries logics in init HiveMetaStoreClient and hope to reduce the occurrence of this problem. Thanks. 2014-07-02 22:40 GMT+08:00

UDF related: org.apache.hive.com.esotericsoftware.kryo.KryoException

2014-10-20 Thread Harel Gliksman
Hello, I am experiencing inconsistent behavior when trying to use UDF on 0.13.1 on Amazon's EMR (AMI 3.2.1). I generated a uber jar and deployed a UDF like so: create temporary function someFunction as hive.udf.localization.MyUDF using jar s3://waze.mapreduce.shared/scripts/Hive/MyHive.jar; I

select * from table and select column from table in hive

2014-10-20 Thread Raj Hadoop
I am able to see the data in the table for all the columns when I issue the following - SELECT * FROM t1 WHERE dt1='2013-11-20' But I am unable to see the column data when i issue the following - SELECT cust_num FROM t1 WHERE dt1='2013-11-20' The above shows null values. How should I

Re: select * from table and select column from table in hive

2014-10-20 Thread Nitin Pawar
whats your table create ddl? is the data in csv like format? On 21 Oct 2014 00:26, Raj Hadoop hadoop...@yahoo.com wrote: I am able to see the data in the table for all the columns when I issue the following - SELECT * FROM t1 WHERE dt1='2013-11-20' But I am unable to see the column data

Re: HIVE::START WITH and CONNECT BY implementation in Hive

2014-10-20 Thread Moore, Douglas
Look up Transitive Closure It's a fast technique to analyze hierarchical data w/o proprietary SQL extensions. - Douglas On Oct 20, 2014, at 3:12 AM, yogesh dhari yogeshh...@gmail.commailto:yogeshh...@gmail.com wrote: Hello All How can we achive start with .. connect by clause can be used to

create table exception

2014-10-20 Thread Shushant Arora
what could be the reason for create table test_table(a int); FAILED: Error in metadata: MetaException(message:javax.jdo.JDOException: Couldnt obtain a new sequence (unique id) : Binary logging not possible. Message: Transaction level 'READ-COMMITTED' in InnoDB is not safe for binlog mode