xiongyinke created TEZ-4509: ------------------------------- Summary: Error starting DAGAppMaster,Tez 0.10.2 with Hadoop 3.3.0 Key: TEZ-4509 URL: https://issues.apache.org/jira/browse/TEZ-4509 Project: Apache Tez Issue Type: Bug Affects Versions: 0.10.2 Reporter: xiongyinke
When I use tez0.10.2 + hadoop3.3.0 + hive3.1.3 and execute the "hive on tez" command, DAGAppMaster fails to start and reports the following error: 2023-08-16 09:56:09,896 [INFO] [ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerManager] |service.AbstractService|: Service org.apache.tez.dag.app.rm.TaskSchedulerManager failed in state STARTED java.lang.NullPointerException at org.apache.tez.dag.app.rm.TaskSchedulerManager.serviceStart(TaskSchedulerManager.java:653) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194) at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1786) at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1807) 2023-08-16 09:56:09,899 [INFO] [ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerManager] |rm.TaskSchedulerManager|: Shutting down AppCallbackExecutor 2023-08-16 09:56:09,899 [INFO] [main] |service.AbstractService|: Service org.apache.tez.dag.app.DAGAppMaster failed in state STARTED org.apache.hadoop.service.ServiceStateException: java.lang.ExceptionInInitializerError at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105) at org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1865) at org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1929) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194) at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2601) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2597) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2384) Caused by: java.lang.ExceptionInInitializerError at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2602) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2567) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2663) at org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:213) at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848) at org.apache.tez.dag.api.client.DAGClientServer.createServer(DAGClientServer.java:134) at org.apache.tez.dag.api.client.DAGClientServer.serviceStart(DAGClientServer.java:82) at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194) at org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1786) at org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1807) Caused by: java.lang.IllegalArgumentException: ReRegistration of rpcKind: RPC_PROTOCOL_BUFFER at org.apache.hadoop.ipc.Server.registerProtocolEngine(Server.java:290) at org.apache.hadoop.ipc.ProtobufRpcEngine.<clinit>(ProtobufRpcEngine.java:71) ... 12 more 2023-08-16 09:56:09,900 [INFO] [main] |history.HistoryEventHandler|: Stopping HistoryEventHandler 2023-08-16 09:56:09,900 [INFO] [main] |recovery.RecoveryService|: Stopping RecoveryService 2023-08-16 09:56:09,900 [INFO] [main] |recovery.RecoveryService|: Handle the remaining events in queue, queue size=0 -- This message was sent by Atlassian Jira (v8.20.10#820010)