[
https://issues.apache.org/jira/browse/TEZ-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17775318#comment-17775318
]
Ayush Saxena commented on TEZ-4509:
-----------------------------------
Hive-3.1.3 doesn't support Hadoop-3.3.0, it supports Hadoop-3.1.0
Check here:
https://github.com/apache/hive/blob/rel/release-3.1.3/pom.xml#L150
> Error starting DAGAppMaster,Tez 0.10.2 with Hadoop 3.3.0
> ---------------------------------------------------------
>
> Key: TEZ-4509
> URL: https://issues.apache.org/jira/browse/TEZ-4509
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.10.2
> Reporter: xiongyinke
> Priority: Major
>
>
> When I use tez0.10.2 + hadoop3.3.0 + hive3.1.3 and execute the "hive on tez"
> command, DAGAppMaster fails to start and reports the following error:
> 2023-08-16 09:56:09,896 [INFO]
> [ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerManager]
> |service.AbstractService|: Service
> org.apache.tez.dag.app.rm.TaskSchedulerManager failed in state STARTED
> java.lang.NullPointerException at
> org.apache.tez.dag.app.rm.TaskSchedulerManager.serviceStart(TaskSchedulerManager.java:653)
> at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1786)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1807)
> 2023-08-16 09:56:09,899 [INFO]
> [ServiceThread:org.apache.tez.dag.app.rm.TaskSchedulerManager]
> |rm.TaskSchedulerManager|: Shutting down AppCallbackExecutor 2023-08-16
> 09:56:09,899 [INFO] [main] |service.AbstractService|: Service
> org.apache.tez.dag.app.DAGAppMaster failed in state STARTED
> org.apache.hadoop.service.ServiceStateException:
> java.lang.ExceptionInInitializerError at
> org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:105)
> at org.apache.tez.dag.app.DAGAppMaster.startServices(DAGAppMaster.java:1865)
> at org.apache.tez.dag.app.DAGAppMaster.serviceStart(DAGAppMaster.java:1929)
> at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
> at org.apache.tez.dag.app.DAGAppMaster$9.run(DAGAppMaster.java:2601) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:422) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
> at
> org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:2597)
> at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2384) Caused
> by: java.lang.ExceptionInInitializerError at java.lang.Class.forName0(Native
> Method) at java.lang.Class.forName(Class.java:348) at
> org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2602)
> at
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2567)
> at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2663) at
> org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:213) at
> org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:848) at
> org.apache.tez.dag.api.client.DAGClientServer.createServer(DAGClientServer.java:134)
> at
> org.apache.tez.dag.api.client.DAGClientServer.serviceStart(DAGClientServer.java:82)
> at org.apache.hadoop.service.AbstractService.start(AbstractService.java:194)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceWithDependency.start(DAGAppMaster.java:1786)
> at
> org.apache.tez.dag.app.DAGAppMaster$ServiceThread.run(DAGAppMaster.java:1807)
> Caused by: java.lang.IllegalArgumentException: ReRegistration of rpcKind:
> RPC_PROTOCOL_BUFFER at
> org.apache.hadoop.ipc.Server.registerProtocolEngine(Server.java:290) at
> org.apache.hadoop.ipc.ProtobufRpcEngine.<clinit>(ProtobufRpcEngine.java:71)
> ... 12 more 2023-08-16 09:56:09,900 [INFO] [main]
> |history.HistoryEventHandler|: Stopping HistoryEventHandler 2023-08-16
> 09:56:09,900 [INFO] [main] |recovery.RecoveryService|: Stopping
> RecoveryService 2023-08-16 09:56:09,900 [INFO] [main]
> |recovery.RecoveryService|: Handle the remaining events in queue, queue size=0
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
