Re: Dynamic Partitioning Table Properties

2016-04-05 Thread bhanu prasad
Thank u lefty On Apr 6, 2016 6:51 AM, "Lefty Leverenz" wrote: > These are configuration properties, not table properties. Here are their > descriptions in the Hive wiki: > >- hive.exec.dynamic.partition.mode > >

Re: Dynamic Partitioning Table Properties

2016-04-05 Thread Lefty Leverenz
These are configuration properties, not table properties. Here are their descriptions in the Hive wiki: - hive.exec.dynamic.partition.mode -

Re: Hive UDF to fetch value from distributed cache not working with outer queries

2016-04-05 Thread Jason Dere
?You might be using the wrong path to reference the distributed cache - I was under the impression that the distributed cache files would accessible using a local path not something starting with '/'. I suspect query 1 is working because fetch task conversion is running the select in a local

Re: Best way of Unpivoting of hiva table data. Any Analytic function for unpivoting

2016-04-05 Thread mahender bigdata
Thanks Dudu.. So I make changes to use Union All. So i hope there is no bultin- udf for doing this functionality On 4/5/2016 2:08 PM, Markovitz, Dudu wrote: Hi Please make sure you are use “union all” and not “union”. “union all” just spools one query result after the other. “union”

Hive with PostgreSQL, PostgreSQL can't start

2016-04-05 Thread Ruhua Jiang
Hi I am using PostgreSQL as hive metastore. When I try to restart postgre service, I see following errors. Tue Apr 5 20:50:47 UTC 2016 : starting process == postgresql == 2016-04-05 20:50:47.956 PG_9.1_201105231 exists in /somepath/postgresql9.1/hive/tbls1. Was tablespaces.done deleted?

RE: Best way of Unpivoting of hiva table data. Any Analytic function for unpivoting

2016-04-05 Thread Markovitz, Dudu
Hi Please make sure you are use "union all" and not "union". "union all" just spools one query result after the other. "union" eliminates duplicated rows, therefore works much harder. Dudu From: mahender bigdata [mailto:mahender.bigd...@outlook.com] Sent: Tuesday, April 05, 2016 11:50 PM To:

Re: Best way of Unpivoting of hiva table data. Any Analytic function for unpivoting

2016-04-05 Thread mahender bigdata
Hi Adrew, Sorry for delay in response. currently I'm using Select with Union :-) . I would like to know is there any Built-in Hive UDF available for unpivoting . On 3/30/2016 2:23 PM, Andrew Sears wrote: From mytable Select id, 'mycol' as name, col1 as value Union Select id, 'mycol2' as

Error with insert overwrite to s3n

2016-04-05 Thread Andy Srine
Team, I am hitting this error discussed below and I am on Hive 1.2: http://qnalist.com/questions/6161150/hive-error-when-trying-to-write-data-to-s3n Gopal says in that thread: "Looks like the insert overwrite isn't triggering the CopyTask - MoveTask is the wrong operation for cross-FS

Re: Hive UDF to fetch value from distributed cache not working with outer queries

2016-04-05 Thread Dayong
What if you extends genericUDF Thanks, Dayong > On Apr 5, 2016, at 2:11 PM, Abhishek Dubey wrote: > > Hi, > > > We have written a Hive UDF in Java to fetch value from file added in > distributed cache which works perfectly from a select query like : > > Query 1.

Hive UDF to fetch value from distributed cache not working with outer queries

2016-04-05 Thread Abhishek Dubey
Hi, We have written a Hive UDF in Java to fetch value from file added in distributed cache which works perfectly from a select query like : Query 1. select country_key, MyFunction(country_key,"/data/MyData.txt") as capital from tablename; But not working when trying to create table from

RE: Hive Metadata tables of a schema

2016-04-05 Thread Rachna Jotwani
Hacatalog example in java… private void testHCatalogAPI() throws NoSuchObjectException, TException, HCatException { HCatClient hcatClient = null; try { HiveConf hcatConf = new HiveConf(); hcatConf.setVar(HiveConf.ConfVars.METASTOREURIS,

Re: Hive Metadata tables of a schema

2016-04-05 Thread David Morel
Better use HCatalog for this. David Le 5 avr. 2016 10:14, "Mich Talebzadeh" a écrit : > So you want to interrogate Hive metastore and get information about > objects for a given schema/database in Hive. > > These info are kept in Hive metastore database running on an

Re: Hive Metadata tables of a schema

2016-04-05 Thread Mich Talebzadeh
So you want to interrogate Hive metastore and get information about objects for a given schema/database in Hive. These info are kept in Hive metastore database running on an RDBVMS say Oracle. There are dozens of tables in Hive specific schema. For example table DBS contains Hive databases etc

Re: Can't able to access temp table via jdbc client

2016-04-05 Thread Mich Talebzadeh
Hi temp tables are session specific and private to the session. You will not be able to see temp tables created by another session in HiveContext. Likewise creating a table in Hive using a syntax similar to below CREATE TEMPORARY TABLE tmp AS SELECT t.calendar_month_desc, c.channel_desc,