Mark Grover created HIVE-4403:
---------------------------------
Summary: Running Hive queries on Yarn (MR2) gives warnings related
to overriding final parameters
Key: HIVE-4403
URL: https://issues.apache.org/jira/browse/HIVE-4403
Project: Hive
Issue Type: Bug
Reporter: Mark Grover
While working on BIGTOP-885, I saw that Hive was giving a bunch of warnings
related to overriding final parameters in job.conf. Perhaps, Hive's job.conf is
overriding some final parameters it shouldn't.
Here is what the warnings looked like:
{code}
2013-04-19 14:20:32,304 WARN [main] conf.Configuration
(Configuration.java:loadProperty(2032)) -
file:/tmp/root/hive_2013-04-19_14-20-30_159_5701876916688815815/-local-10002/jobconf.xml:an
attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2013-04-19 14:20:32,367 WARN [main] conf.Configuration
(Configuration.java:loadProperty(2032)) -
file:/tmp/root/hive_2013-04-19_14-20-30_159_5701876916688815815/-local-10002/jobconf.xml:an
attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
{code}
To reproduce, run a query like:
{code}
CREATE TABLE u_data (
userid INT,
movieid INT,
rating INT,
unixtime STRING)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\t'
STORED AS TEXTFILE;
{code}
Load some data into u_data, here is some sample data:
https://github.com/apache/bigtop/blob/master/bigtop-tests/test-artifacts/hive/src/main/resources/seed_data_files/ml-data/u.data
Run a simple query on that data (on YARN/MR2)
{code}
INSERT OVERWRITE DIRECTORY '/tmp/count'
SELECT COUNT(1) FROM u_data
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
