Compiling the current source and running hive

2013-11-07 Thread Björn-Elmar Macek
Hi, i am currently upgrading to the new maven based version of Hive, when recently a library (kryo … something) was not available as a SNAPSHOT version anymore. What i am currently experiencing is the following: After checking out the source, i cannot simply compile the trunk with a

Schema less hive table. Is it possible?

2013-11-07 Thread Miljan Markovic
Hello. I have a set of complex structured objects that I would like to put into hive and use it's sql to query data from those objects. Now, since they are complex structures, defining a schema for every single field is a hard job. Instead I'm thinking of making a custom SerDe with custom

Re: Schema less hive table. Is it possible?

2013-11-07 Thread Nitin Pawar
This is my understanding i may be wrong so wait for others to reply as well and correct my stupid understanding In hive without creating a table, you can not access the data to create the table you will need atleast one column does it qualify to be called as a schema .. yes so in short

CDH4.4 - 0 progress on select queries

2013-11-07 Thread Keith Wright
Hi all, We have happily been using hive on our CDH install for some time without issues. We recently upgraded from CDH4.2.0 to CDH 4.4.0 and now select queries against one table fails with the syslog for the job showing what's below. Couple of things to note: * This is a partitioned

Exceptions while running Hive

2013-11-07 Thread Narla,Venkatesh
Hello, I am getting the following exception when I try to run a query. Can any body help me what the problem might be in this scenario. Thanks for you time. 2013-11-07 09:23:38,498 FATAL ExecMapper: java.lang.NoClassDefFoundError: com/dyuproject/protostuff/Schema at

Re: Exceptions while running Hive

2013-11-07 Thread Sonal Goyal
Does your hive classpath contain the jar having com.dyuproject.protostuff.Schema ? Best Regards, Sonal Nube Technologies http://www.nubetech.co http://in.linkedin.com/in/sonalgoyal On Thu, Nov 7, 2013 at 9:16 PM, Narla,Venkatesh venkatesh.na...@cerner.comwrote: Hello, I am getting the

Re: UnitTest did not pass during compile the latest hive code

2013-11-07 Thread Thejas Nair
You can use System.getProperty(test.tmp.dir) instead of '/tmp' . That is more portable. It would be wonderful if you can create a new issue in hive jira ( https://issues.apache.org/jira/browse/HIVE) and attach a patch with this change! On Tue, Nov 5, 2013 at 9:02 PM, 金杰 hellojin...@gmail.com

Predicate pushdown/indexing on ORC file

2013-11-07 Thread Avrilia Floratou
Hi all, I'm using hive-12. I have a file that contains 10 integer columns stored in ORC format. The ORC file is zlib compressed and indexing is enabled. I'm running a simple select count(*) with a predicate of the form (Col1 =0 OR col2 = 0 etc). The predicate touches all 10 columns but its

Re: Predicate pushdown/indexing on ORC file

2013-11-07 Thread Prasanth Jayachandran
AFAIK, ORC uses “hive.optimize.index.filter” hive config to enable predicate pushdown. Can you please try by setting hive.optimize.index.filter to true? Thanks Prasanth Jayachandran On Nov 7, 2013, at 4:04 PM, Avrilia Floratou avrilia.flora...@gmail.com wrote: Hi all, I'm using hive-12. I

Avro Aliases in Hive?

2013-11-07 Thread Matthew Langton
Hello, Quick question about Hive and Avro. Can I create an Avro scheme that uses aliases? I have tried a couple different ways, but so far I have not been able to get a hive query to return data for the aliased fields. for instance, I have tried the following but both return default values. {