[
https://issues.apache.org/jira/browse/HBASE-29370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang resolved HBASE-29370.
-------------------------------
Fix Version/s: 3.0.0-beta-2
Hadoop Flags: Reviewed
Resolution: Fixed
Pushed to master and branch-3.
Thanks [~wchevreuil] for reviewing!
> TestHFileOutputFormat2 fails 100% on flaky dashboard
> ----------------------------------------------------
>
> Key: HBASE-29370
> URL: https://issues.apache.org/jira/browse/HBASE-29370
> Project: HBase
> Issue Type: Bug
> Components: mapreduce, test
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.0.0-beta-2
>
>
> It can pass locally but on flaky dashboard, it always fail with the below
> message. Need to dig more.
> {noformat}
> 2025-06-03T00:50:56,968 ERROR [Time-limited test {}]
> mapreduce.TestHFileOutputFormat2$7(1552): Failed to configure partitioner
> java.io.IOException: Mkdirs failed to create file:/home/jenkins/hbase-staging
> (exists=false,
> cwd=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_master/hbase-mapreduce)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:715)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:700)
> ~[hadoop-common-3.4.1.jar:?]
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1233)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:1176)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.io.SequenceFile$RecordCompressWriter.<init>(SequenceFile.java:1541)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:290)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:312)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.writePartitions(HFileOutputFormat2.java:550)
> ~[classes/:?]
> at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat2.configurePartitioner(HFileOutputFormat2.java:894)
> ~[classes/:?]
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2$7.run(TestHFileOutputFormat2.java:1550)
> ~[test-classes/:?]
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2$7.run(TestHFileOutputFormat2.java:1546)
> ~[test-classes/:?]
> at
> java.security.AccessController.doPrivileged(AccessController.java:399) ~[?:?]
> at javax.security.auth.Subject.doAs(Subject.java:376) ~[?:?]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2.TestConfigurePartitioner(TestHFileOutputFormat2.java:1546)
> ~[test-classes/:?]
> at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method) ~[?:?]
> at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
> ~[?:?]
> at
> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:?]
> at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> ~[junit-4.13.2.jar:4.13.2]
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
> ~[junit-4.13.2.jar:4.13.2]
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
> ~[junit-4.13.2.jar:4.13.2]
> at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
> at java.lang.Thread.run(Thread.java:840) ~[?:?]
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
