xiongyinke created TEZ-4509:
-------------------------------
Summary: Error starting DAGAppMaster,Tez 0.10.2 with Hadoop 3.3.0
Key: TEZ-4509
URL: https://issues.apache.org/jira/browse/TEZ-4509
Project: Apache Tez
Issue Type: Bug
Affects Versions: 0.10.2
Reporter: xiongyinke
When I use tez0.10.2 + hadoop3.3.0 + hive3.1.3 and execute the "hive on tez"
command, DAGAppMaster fails to start and reports the following error:
2023-08-16 09:56:09,896 [INFO]
[ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerManager]
|service.AbstractService|: Service
org.apache.tez.dag.app.rm.TaskSchedulerManager failed in state STARTED
java.lang.NullPointerException at
org.apache.tez.dag.app.rm.TaskSchedulerManager.serviceStart(TaskSchedulerManager.java:653)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1786)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1807)
2023-08-16 09:56:09,899 [INFO]
[ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerManager]
|rm.TaskSchedulerManager|: Shutting down AppCallbackExecutor 2023-08-16
09:56:09,899 [INFO] [main] |service.AbstractService|: Service
org.apache.tez.dag.app.DAGAppMaster failed in state STARTED
org.apache.hadoop.service.ServiceStateException:
java.lang.ExceptionInInitializerError at
org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
at org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1865)
at org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1929) at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:194) at
org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2601) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:422) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
at
org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2597)
at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2384) Caused by:
java.lang.ExceptionInInitializerError at java.lang.Class.forName0(Native
Method) at java.lang.Class.forName(Class.java:348) at
org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2602)
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2567) at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2663) at
org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:213) at
org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848) at
org.apache.tez.dag.api.client.DAGClientServer.createServer(DAGClientServer.java:134)
at
org.apache.tez.dag.api.client.DAGClientServer.serviceStart(DAGClientServer.java:82)
at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1786)
at
org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1807)
Caused by: java.lang.IllegalArgumentException: ReRegistration of rpcKind:
RPC_PROTOCOL_BUFFER at
org.apache.hadoop.ipc.Server.registerProtocolEngine(Server.java:290) at
org.apache.hadoop.ipc.ProtobufRpcEngine.<clinit>(ProtobufRpcEngine.java:71) ...
12 more 2023-08-16 09:56:09,900 [INFO] [main] |history.HistoryEventHandler|:
Stopping HistoryEventHandler 2023-08-16 09:56:09,900 [INFO] [main]
|recovery.RecoveryService|: Stopping RecoveryService 2023-08-16 09:56:09,900
[INFO] [main] |recovery.RecoveryService|: Handle the remaining events in queue,
queue size=0
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
