Re: Using Hive with WebHCat

2013-12-03 Thread Thejas Nair
Can you try setting "templeton.storage.root" in webhcat-site.xml to a directory that exists ? On Mon, Dec 2, 2013 at 6:21 AM, Jonathan Hodges wrote: > Hi, > > I have setup WebHCat that is bundled with Hive 0.11.0. I am able to kick of > map reduce jobs with the REST API successfully. However

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Navis류승우
Looks like a bug. I've booked this on https://issues.apache.org/jira/browse/HIVE-5935. 2013/12/4 Adam Kawa > Maybe you can parse the output of EXPLAIN operator applied on your query > https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain > or look for other configuration prope

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Adam Kawa
Maybe you can parse the output of EXPLAIN operator applied on your query https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain or look for other configuration property (e.g. saying that number of map and reduce tasks is equal to 0, or something). 2013/12/3 Petter von Dolwitz (H

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Petter von Dolwitz (Hem)
Yes, it seems related. I think the query string is not refreshed when hive decides to run without a map reduce job. Problem is that I try to interact with the query string to apply an early filter in the record reader. Any other known way to detect that a map reduce job is not spawned so that I can

Re: hive.query.string not reflecting the current query

2013-12-03 Thread Adam Kawa
Hmmm? Maybe it is related to the fact, that a query: > select * from mytable limit 100; does not start any MapReduce job. It is starts a reading operation from HDFS (and a communication with MetaStore to know what is the schema and how to parse the data using InputFormat and SerDe). For example,

Re: How to specify Hive auxiliary jar in HDFS, not local file system

2013-12-03 Thread mpeterson2
Thanks. I just got an Oozie Hive action set up to test on a single node cluster and putting "ADD JAR /path/to/hdfs/location" in the hive script worked. Hopefully I won't hit any issues when I try it on a multi-node cluster. On Mon, Dec 2, 2013 at 5:37 PM, Adam Kawa wrote: > You can use ADD JAR

hive.query.string not reflecting the current query

2013-12-03 Thread Petter von Dolwitz (Hem)
Hi, I use hive 0.11 with a five machine cluster. I am reading the property hive.query.string from a custom RecordReader (used for reading external tables). If I first invoke a query like select * from mytable where mycolumn='myvalue'; I get the correct query string in this property. If I then

Re: STREAMTABLE And MAPJOIN

2013-12-03 Thread Nitin Pawar
This is my understanding of both. Wait for the hive guru's to correct me if i made any mistake In Hive, when an inner join query happens the table at the last position on the right streams its records to the reducers. This is the default behavior. So say, you have a query select blah blah from t

STREAMTABLE And MAPJOIN

2013-12-03 Thread Baahu
Hi, What is the difference between hints STREAMTABLE ,MAPJOIN . Thanks, Baahu