Re: Possible to set map/reduce log level in configuration file?

Hi Krishna, You can also set these properties in the mapred-site.xml, but this would require a restart of your cluster. Ted. Ted Reynolds Technical Support Engineer Hortonworks Work Phone: 408-645-7079 On Fri, Dec 14, 2012 at 2:44 AM, Nitin Pawar wrote: >

Re: Hive Row number

Thanks ShriKanth. On Fri, Dec 14, 2012 at 11:22 AM, shrikanth shankar wrote: > See > http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/doing_rank_with_hive > > thanks, > Shrikanth > > On Dec 14, 2012, at 8:18 AM, maya bhardwaj wrote: > > I am converting the Netezza query in hive.How can

Re: Hive Row number

See http://www.edwardcapriolo.com/roller/edwardcapriolo/entry/doing_rank_with_hive thanks, Shrikanth On Dec 14, 2012, at 8:18 AM, maya bhardwaj wrote: > I am converting the Netezza query in hive.How can i achieve following query > in hive --> row_number() over (partition by record_id, event_id

Re: Creating external table poiting to s3 folder with files not loading data

A couple of clarifying questions and suggestions. First, keep in mind that Hive doesn't care if you have a typo of some kind in your external location ;) Use DESCRIBE FORMATTED to verify the path is right. For an external partitioned table, DESCRIBE FORMATTED table PARTITION(col1=val1,col2=val2,...

Re: Running commands at hive cli or hive thirft startup

I've booked it on https://issues.apache.org/jira/browse/HIVE-3797 2012/12/14 Dean Wampler : > What about using "hive -i ~/.hiverc -f script"? I haven't tried it, but I > assume it reads the specified "rc" file in the batch mode case. True? > > > On Fri, Dec 14, 2012 at 3:41 AM, Mark Grover > wrot

Re: Running commands at hive cli or hive thirft startup

What about using "hive -i ~/.hiverc -f script"? I haven't tried it, but I assume it reads the specified "rc" file in the batch mode case. True? On Fri, Dec 14, 2012 at 3:41 AM, Mark Grover wrote: > No, .hiverc only works for CLI. > > UDFs are tricky. The only way I can think of is to add them to

Re: Possible to set map/reduce log level in configuration file?

if you want this to be set at every query you execute best would have a hiverc file and then include it as hive -i hiverc alternatively, you can create a .hiverc into your home directory and set the parameters you want, these will be included in each session On Fri, Dec 14, 2012 at 4:05 PM, Kris

Possible to set map/reduce log level in configuration file?

Hi all, is it possible to set: mapreduce.map.log.level & mapreduce.reduce.log.level, within some config file? At the moment I have to remember to set these at the start of a hive session, or script. Cheers, Krishna

RE: Running commands at hive cli or hive thirft startup

UDFs are tricky. The only way I can think of is to add them to the function registry (https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java) and recompile Hive. ` What about https

Re: Running commands at hive cli or hive thirft startup

No, .hiverc only works for CLI. UDFs are tricky. The only way I can think of is to add them to the function registry (https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java) and recompile Hive. On Mon, Dec 10, 2012 at 8:01 AM, John Omernik wrot

Re: Creating external table poiting to s3 folder with files not loading data

Fernando, It is more likely related to your SerDe and the underlying data not matching up to it and than being related to the table being external on S3. Mark On Tue, Dec 11, 2012 at 6:05 AM, Fernando Andrés Doglio Turissini wrote: > Long subject, I know.. let me explain a bit more about the pro

Re: Partition by directory

Erik, Did you find out the answer to this? I would be curious to hear what the problem is. BTW, I would check the hive logs (/var/log/apps/hive or /var/log/hive or similar on EMR). Try increasing the log level and see if that helps. Given that EMR comes with it's own distribution of Hive (which t