[
https://issues.apache.org/jira/browse/HADOOP-19864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18074863#comment-18074863
]
ASF GitHub Bot commented on HADOOP-19864:
-----------------------------------------
steveloughran commented on PR #8433:
URL: https://github.com/apache/hadoop/pull/8433#issuecomment-4281305065
failures are legitimate
org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpcLeakLegacy
```
java.lang.IllegalStateException: No RPC engine configured for
org.apache.hadoop.hdfs.protocol.ClientDatanodeProtocol
at
org.apache.hadoop.util.Preconditions.checkState(Preconditions.java:298)
at org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:227)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:677)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:642)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:544)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:520)
at
org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpcLeak(TestBlockToken.java:400)
at
org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpcLeakLegacy(TestBlockToken.java:435)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
```
org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpcLeakProtobuf
```
java.lang.IllegalStateException: No RPC engine configured for
org.apache.hadoop.hdfs.protocol.ClientDatanodeProtocol
at
org.apache.hadoop.util.Preconditions.checkState(Preconditions.java:298)
at org.apache.hadoop.ipc.RPC.getProtocolEngine(RPC.java:227)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:677)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:642)
at org.apache.hadoop.ipc.RPC.getProtocolProxy(RPC.java:544)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:520)
at
org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpcLeak(TestBlockToken.java:400)
at
org.apache.hadoop.hdfs.security.token.block.TestBlockToken.testBlockTokenRpcLeakProtobuf(TestBlockToken.java:440)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
```
final failure less obvious
```
Failed
org.apache.hadoop.hdfs.server.datanode.TestDataNodeLifeline.testSendLifelineIfHeartbeatBlocked
Failing for the past 1 build (Since
[Failed#3](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8433/3/) )
[Took 5.5
sec.](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8433/3/testReport/junit/org.apache.hadoop.hdfs.server.datanode/TestDataNodeLifeline/testSendLifelineIfHeartbeatBlocked/history)
Error Message
Could not change property dfs.datanode.data.dir from '' to
'/home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-8433/ubuntu-noble/src/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs/data/data-new'
Stacktrace
org.apache.hadoop.conf.ReconfigurationException: Could not change property
dfs.datanode.data.dir from '' to
'/home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-8433/ubuntu-noble/src/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs/data/data-new'
at
org.apache.hadoop.hdfs.server.datanode.DataNode.reconfigurePropertyImpl(DataNode.java:665)
at
org.apache.hadoop.hdfs.server.datanode.TestDataNodeLifeline.testSendLifelineIfHeartbeatBlocked(TestDataNodeLifeline.java:205)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
at java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
Caused by: java.io.IOException: FAILED to ADD:
[DISK]file:/home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-8433/ubuntu-noble/src/hadoop-hdfs-project/hadoop-hdfs/target/test/data/2/dfs/data/data-new:
java.util.concurrent.ExecutionException: java.lang.IndexOutOfBoundsException:
Index 0 out of bounds for length 0
at
org.apache.hadoop.hdfs.server.datanode.DataNode.refreshVolumes(DataNode.java:1362)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.reconfigurePropertyImpl(DataNode.java:647)
... 4 more
```
But if heartbeats were failing, that could be the trigger.
> Cut WritableRPCEngine
> ---------------------
>
> Key: HADOOP-19864
> URL: https://issues.apache.org/jira/browse/HADOOP-19864
> Project: Hadoop Common
> Issue Type: Improvement
> Components: ipc
> Affects Versions: 3.6.0
> Reporter: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> Cut {{WritableRpcEngine}} from the code
> It's been obsolete for over a decade, with MAPREDUCE-6706 not needed
> internally.
> Tez still uses it (TEZ-4708 ) so this removal will be incompatible for them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
