STREAMTABLE And MAPJOIN

2013-12-03 Thread Baahu
Hi, What is the difference between hints STREAMTABLE ,MAPJOIN . Thanks, Baahu

Re: STREAMTABLE And MAPJOIN

2013-12-03 Thread Nitin Pawar
This is my understanding of both. Wait for the hive guru's to correct me if i made any mistake In Hive, when an inner join query happens the table at the last position on the right streams its records to the reducers. This is the default behavior. So say, you have a query select blah blah from

hive.query.string not reflecting the current query

2013-12-03 Thread Petter von Dolwitz (Hem)
Hi, I use hive 0.11 with a five machine cluster. I am reading the property hive.query.string from a custom RecordReader (used for reading external tables). If I first invoke a query like select * from mytable where mycolumn='myvalue'; I get the correct query string in this property. If I then

Re: How to specify Hive auxiliary jar in HDFS, not local file system

2013-12-03 Thread mpeterson2
Thanks. I just got an Oozie Hive action set up to test on a single node cluster and putting ADD JAR /path/to/hdfs/location in the hive script worked. Hopefully I won't hit any issues when I try it on a multi-node cluster. On Mon, Dec 2, 2013 at 5:37 PM, Adam Kawa kawa.a...@gmail.com wrote:

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Adam Kawa
Hmmm? Maybe it is related to the fact, that a query: select * from mytable limit 100; does not start any MapReduce job. It is starts a reading operation from HDFS (and a communication with MetaStore to know what is the schema and how to parse the data using InputFormat and SerDe). For example,

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Petter von Dolwitz (Hem)
Yes, it seems related. I think the query string is not refreshed when hive decides to run without a map reduce job. Problem is that I try to interact with the query string to apply an early filter in the record reader. Any other known way to detect that a map reduce job is not spawned so that I

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Navis류승우
Looks like a bug. I've booked this on https://issues.apache.org/jira/browse/HIVE-5935. 2013/12/4 Adam Kawa kawa.a...@gmail.com Maybe you can parse the output of EXPLAIN operator applied on your query https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain or look for other

Re: Using Hive with WebHCat

2013-12-03 Thread Thejas Nair
Can you try setting templeton.storage.root in webhcat-site.xml to a directory that exists ? On Mon, Dec 2, 2013 at 6:21 AM, Jonathan Hodges hodg...@gmail.com wrote: Hi, I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick of map reduce jobs with the REST API