[
https://issues.apache.org/jira/browse/TEZ-4272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804473#comment-17804473
]
Ayush Saxena commented on TEZ-4272:
-----------------------------------
I tried with Tez 0.10.2 & Hadoop 3.3.6 locally and it works. Attaching the
output
{noformat}
ayushsaxena@ayushsaxena apache-tez-0.10.2-bin % $HADOOP_HOME/bin/hadoop jar
tez-examples-0.10.2.jar orderedwordcount /in/hdfs /out
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/Users/ayushsaxena/code/cluster/hadoop-3.3.6/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/Users/ayushsaxena/code/cluster/apache-tez-0.10.2-bin/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
2023-12-21 10:53:49,150 INFO shim.HadoopShimsLoader: Trying to locate
HadoopShimProvider for hadoopVersion=3.3.6, majorVersion=3, minorVersion=3
2023-12-21 10:53:49,151 INFO shim.HadoopShimsLoader: Picked HadoopShim
org.apache.tez.hadoop.shim.DefaultHadoopShim, providerName=null,
overrideProviderViaConfig=null, hadoopVersion=3.3.6, majorVersion=3,
minorVersion=3
2023-12-21 10:53:49,245 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2023-12-21 10:53:49,314 INFO counters.Limits: Counter limits initialized with
parameters: GROUP_NAME_MAX=256, MAX_GROUPS=500, COUNTER_NAME_MAX=64,
MAX_COUNTERS=1200
2023-12-21 10:53:49,314 INFO counters.Limits: Counter limits initialized with
parameters: GROUP_NAME_MAX=256, MAX_GROUPS=500, COUNTER_NAME_MAX=64,
MAX_COUNTERS=1200
2023-12-21 10:53:49,314 INFO client.TezClient: Tez Client Version: [
component=tez-api, version=0.10.2,
revision=72977b8720b2337ab0a0a3bf3b12e1c57900fa69,
SCM-URL=scm:git:https://gitbox.apache.org/repos/asf/tez.git,
buildTime=2022-07-08T16:21:10Z, buildUser=laszlobodor,
buildJavaVersion=1.8.0_292 ]
2023-12-21 10:53:49,351 INFO client.DefaultNoHARMFailoverProxyProvider:
Connecting to ResourceManager at /0.0.0.0:8032
2023-12-21 10:53:50,394 INFO examples.OrderedWordCount: Running OrderedWordCount
2023-12-21 10:53:50,479 INFO client.TezClient: Submitting DAG application with
id: application_1703099201534_0006
2023-12-21 10:53:50,482 INFO client.TezClientUtils: Using tez.lib.uris value
from configuration: hdfs://localhost:52714/apps/tez/tez.tar.gz
2023-12-21 10:53:50,482 INFO client.TezClientUtils: Using
tez.lib.uris.classpath value from configuration: null
2023-12-21 10:53:50,533 INFO client.TezClient: Tez system stage directory
hdfs://localhost:52714/tmp/ayushsaxena/tez/staging/.tez/application_1703099201534_0006
doesn't exist and is created
2023-12-21 10:53:50,551 INFO conf.Configuration: resource-types.xml not found
2023-12-21 10:53:50,551 INFO resource.ResourceUtils: Unable to find
'resource-types.xml'.
2023-12-21 10:53:51,106 INFO client.TezClient: Submitting DAG to YARN,
applicationId=application_1703099201534_0006, dagName=OrderedWordCount,
callerContext={ context=TezExamples, callerType=null, callerId=null }
2023-12-21 10:53:51,138 INFO impl.YarnClientImpl: Submitted application
application_1703099201534_0006
2023-12-21 10:53:51,140 INFO client.TezClient: The url to track the Tez AM:
http://localhost:8088/proxy/application_1703099201534_0006/
2023-12-21 10:53:53,818 INFO client.DAGClientImpl: DAG initialized:
CurrentState=Running
2023-12-21 10:53:53,819 INFO client.DAGClientImpl: DAG: State: RUNNING
Progress: 0% TotalTasks: 3 Succeeded: 0 Running: 0 Failed: 0 Killed: 0
2023-12-21 10:53:53,830 INFO client.DAGClientImpl: VertexStatus:
VertexName: Tokenizer Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0
Failed: 0 Killed: 0
2023-12-21 10:53:53,830 INFO client.DAGClientImpl: VertexStatus:
VertexName: Summation Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0
Failed: 0 Killed: 0
2023-12-21 10:53:53,831 INFO client.DAGClientImpl: VertexStatus:
VertexName: Sorter Progress: 0% TotalTasks: 1 Succeeded: 0 Running: 0 Failed: 0
Killed: 0
2023-12-21 10:53:56,797 INFO client.DAGClientImpl: DAG: State: SUCCEEDED
Progress: 100% TotalTasks: 3 Succeeded: 3 Running: 0 Failed: 0 Killed: 0
2023-12-21 10:53:56,798 INFO client.DAGClientImpl: VertexStatus:
VertexName: Tokenizer Progress: 100% TotalTasks: 1 Succeeded: 1 Running: 0
Failed: 0 Killed: 0
2023-12-21 10:53:56,800 INFO client.DAGClientImpl: VertexStatus:
VertexName: Summation Progress: 100% TotalTasks: 1 Succeeded: 1 Running: 0
Failed: 0 Killed: 0
2023-12-21 10:53:56,801 INFO client.DAGClientImpl: VertexStatus:
VertexName: Sorter Progress: 100% TotalTasks: 1 Succeeded: 1 Running: 0 Failed:
0 Killed: 0
2023-12-21 10:53:56,801 INFO client.DAGClientImpl: DAG completed.
FinalState=SUCCEEDED
{noformat}
> Service org.apache.tez.dag.app.DAGAppMaster failed in state STARTED
> org.apache.hadoop.service.ServiceStateException:
> java.lang.ExceptionInInitializerError
> ----------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: TEZ-4272
> URL: https://issues.apache.org/jira/browse/TEZ-4272
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.9.2, 0.10.0
> Reporter: Nomen'Aina
> Priority: Major
> Attachments: log.txt
>
>
> Hello to all.
> Currently I am trying to install Apache tez by following step by step, the
> instructions on the official website, and when I run the command:
> $HADOOP_PREFIX/bin/hadoop jar tez-examples.jar orderedwordcount
> /tmp/input/file.txt /tmp/outout
> I get the following errors:
> Service org.apache.tez.dag.app.rm.TaskSchedulerManager failed in state
> STARTED java.lang.NullPointerException at
> org.apache.tez.dag.app.rm.TaskSchedulerManager.serviceStart(TaskSchedulerManager.java:653)
> and
> Error starting DAGAppMaster org.apache.hadoop.service.ServiceStateException:
> java.lang.ExceptionInInitializerError
>
>
> hadoop version:3.3.0 / tez version: 0.10.0
--
This message was sent by Atlassian Jira
(v8.20.10#820010)