[ https://issues.apache.org/jira/browse/HIVE-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13669521#comment-13669521 ]
Mark Grover commented on HIVE-4403: ----------------------------------- Chu, sorry about the delay. I can test patched Hive to see if this resolves my original problem, please give me a few days. In the meanwhile, even though this is a small patch, do you mind uploading it on Reviewboard or Phabricator? Thanks for contributing! > Running Hive queries on Yarn (MR2) gives warnings related to overriding final > parameters > ---------------------------------------------------------------------------------------- > > Key: HIVE-4403 > URL: https://issues.apache.org/jira/browse/HIVE-4403 > Project: Hive > Issue Type: Bug > Affects Versions: 0.10.0 > Reporter: Mark Grover > Attachments: HIVE-4403.patch > > > While working on BIGTOP-885, I saw that Hive was giving a bunch of warnings > related to overriding final parameters in job.conf. This was on a pseudo > distributed cluster. FWIW, I didn't see this happen on a fully-distributed > cluster. Perhaps, Hive's job.conf is overriding some final parameters it > shouldn't. > Here is what the warnings looked like: > {code} > 2013-04-19 14:20:32,304 WARN [main] conf.Configuration > (Configuration.java:loadProperty(2032)) - > file:/tmp/root/hive_2013-04-19_14-20-30_159_5701876916688815815/-local-10002/jobconf.xml:an > attempt to override final parameter: > mapreduce.job.end-notification.max.retry.interval; Ignoring. > 2013-04-19 14:20:32,367 WARN [main] conf.Configuration > (Configuration.java:loadProperty(2032)) - > file:/tmp/root/hive_2013-04-19_14-20-30_159_5701876916688815815/-local-10002/jobconf.xml:an > attempt to override final parameter: > mapreduce.job.end-notification.max.attempts; Ignoring. > {code} > To reproduce, run a query like: > {code} > CREATE TABLE u_data ( > userid INT, > movieid INT, > rating INT, > unixtime STRING) > ROW FORMAT DELIMITED > FIELDS TERMINATED BY '\t' > STORED AS TEXTFILE; > {code} > Load some data into u_data, here is some sample data: > https://github.com/apache/bigtop/blob/master/bigtop-tests/test-artifacts/hive/src/main/resources/seed_data_files/ml-data/u.data > Run a simple query on that data (on YARN/MR2) > {code} > INSERT OVERWRITE DIRECTORY '/tmp/count' > SELECT COUNT(1) FROM u_data > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira