[
https://issues.apache.org/jira/browse/MAPREDUCE-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shilun Fan resolved MAPREDUCE-7521.
-----------------------------------
Fix Version/s: 3.5.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Fix TestUberAM failures after JUnit 5 migration
> -----------------------------------------------
>
> Key: MAPREDUCE-7521
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7521
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mapreduce-client
> Affects Versions: 3.5.0
> Reporter: Shilun Fan
> Assignee: Shilun Fan
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.5.0
>
>
> *Background:*
> After migrating the project to {*}JUnit 5{*}, the {{TestUberAM}} unit test
> started failing intermittently. The error message observed during test
> execution is as follows:
> {code:java}
> Remote File /apps_staging_dir/jenkins/.staging/job_1759472296837_0013/job.jar
> could only be written to 0 of the 1 minReplication nodes.
> There are 2 datanode(s) running and 2 node(s) are excluded in this operation.
> {code}
> This error originates from
> {code:java}
> org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock
> {code}
> indicating that the MiniDFSCluster used in the test failed to find available
> data nodes for block writes during execution.
> *Change Summary:*
> * Removed redundant invocation of the parent class’s {{BeforeAll}} method in
> subclasses to prevent double initialization.
> * Increased MiniDFSCluster data node count from 2 to 5 to improve fault
> tolerance.
> * Verified that all affected tests pass successfully.
> *Impact Scope:*
> * Affects only AM tests based on MiniDFSCluster.
> * No impact on business logic or production code.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
