[ https://issues.apache.org/jira/browse/IMPALA-8991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16980435#comment-16980435 ]
Sahil Takiar commented on IMPALA-8991: -------------------------------------- Saw this happen again in https://jenkins.impala.io/job/parallel-all-tests-nightly/1106/ > Data loading failed in Hive with error initializing MapReduce cluster > --------------------------------------------------------------------- > > Key: IMPALA-8991 > URL: https://issues.apache.org/jira/browse/IMPALA-8991 > Project: IMPALA > Issue Type: Bug > Components: Infrastructure > Reporter: Michael Ho > Priority: Major > > Data loading with {noformat} insert into table functional_seq_gzip.a > ^Mlltypesaggmultifilesnopart SELECT id, bool_col, tinyint_col, smallint_col, > int_c ^Mol, bigint_col, float_col, double_col, date_string_col, string_col, > timestamp_co ^Ml FROM functional.alltypesaggmultifilesnopa > rt where id % 4 = 2; {noformat} failed in Hive with unexpected exception: > {noformat} > java.io.IOException: Cannot initialize Cluster. Please check your > configuration for mapreduce.framework.name and the correspond server > addresses. > at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:116) > at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:109) > at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:102) > at org.apache.hadoop.mapred.JobClient.init(JobClient.java:475) > at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:454) > at > org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:402) > at > org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:151) > at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:199) > at > org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) > at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2200) > at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1843) > at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1563) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1339) > at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1334) > at > org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:256) > at > org.apache.hive.service.cli.operation.SQLOperation.access$600(SQLOperation.java:92) > at > org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:345) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) > at > org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:357) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Suppressed: java.io.IOException: Failed to use > org.apache.hadoop.mapred.LocalClientProtocolProvider due to error: > at > org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:148) > ... 25 more > Caused by: org.apache.hadoop.metrics2.MetricsException: Metrics > source LocalJobRunnerMetrics-1803220940 already exists! > at > org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.newSourceName(DefaultMetricsSystem.java:152) > at > org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.sourceName(DefaultMetricsSystem.java:125) > at > org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:229) > at > org.apache.hadoop.mapred.LocalJobRunnerMetrics.create(LocalJobRunnerMetrics.java:46) > at > org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:777) > at > org.apache.hadoop.mapred.LocalJobRunner.<init>(LocalJobRunner.java:770) > at > org.apache.hadoop.mapred.LocalClientProtocolProvider.create(LocalClientProtocolProvider.java:42) > at > org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:130) > ... 25 more > Number of reduce tasks is set to 0 since there's no reduce operator > Job Submission failed with exception 'java.io.IOException(Cannot initialize > Cluster. Please check your configuration for mapreduce.framework.name and the > correspond server addresses.)' > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Cannot initialize Cluster. > Please check your configuration for mapreduce.framework.name and the > correspond server addresses. > {noformat} > cc'ing [~stakiar], [~vihangk1] and [~joemcdonnell] -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org