[ https://issues.apache.org/jira/browse/HBASE-28743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17868149#comment-17868149 ]
Hudson commented on HBASE-28743: -------------------------------- Results for branch branch-3 [build #257 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/257/]: (x) *{color:red}-1 overall{color}* ---- details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/257/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk17 hadoop3 checks{color} -- For more information [see jdk17 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/257/JDK17_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (x) {color:red}-1 client integration test{color} -- Something went wrong with this stage, [check relevant console output|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/257//console]. > Snapshot based mapreduce jobs fails with NPE while trying to close mslab > within mapper > -------------------------------------------------------------------------------------- > > Key: HBASE-28743 > URL: https://issues.apache.org/jira/browse/HBASE-28743 > Project: HBase > Issue Type: Bug > Components: snapshots > Reporter: Ujjawal Kumar > Assignee: Vineet Kumar Maheshwari > Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2, 2.6.1, 2.5.11 > > > {code:java} > 2024-07-11 10:20:38,800 WARN [main] client.ClientSideRegionScanner - > Exception while closing region > java.io.IOException: java.lang.NullPointerException > at > org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1808) > at > org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1557) > at > org.apache.hadoop.hbase.client.ClientSideRegionScanner.close(ClientSideRegionScanner.java:133) > at > org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormatImpl$RecordReader.close(TableSnapshotInputFormatImpl.java:310) > at > org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat$TableSnapshotRegionRecordReader.close(TableSnapshotInputFormat.java:184) > at > org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.close(MapTask.java:536) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:804) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:348) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172) > Caused by: java.lang.NullPointerException > at > org.apache.hadoop.hbase.regionserver.MemStoreLABImpl.recycleChunks(MemStoreLABImpl.java:296) > at > org.apache.hadoop.hbase.regionserver.MemStoreLABImpl.lambda$new$0(MemStoreLABImpl.java:109) > at org.apache.hadoop.hbase.nio.RefCnt.deallocate(RefCnt.java:95) > at > org.apache.hbase.thirdparty.io.netty.util.AbstractReferenceCounted.handleRelease(AbstractReferenceCounted.java:86) > at > org.apache.hbase.thirdparty.io.netty.util.AbstractReferenceCounted.release(AbstractReferenceCounted.java:76) > at org.apache.hadoop.hbase.nio.RefCnt.release(RefCnt.java:84) > at > org.apache.hadoop.hbase.regionserver.MemStoreLABImpl.close(MemStoreLABImpl.java:269) > at > org.apache.hadoop.hbase.regionserver.Segment.close(Segment.java:143) > at > org.apache.hadoop.hbase.regionserver.AbstractMemStore.close(AbstractMemStore.java:381) > at > org.apache.hadoop.hbase.regionserver.HStore.closeWithoutLock(HStore.java:723) > at org.apache.hadoop.hbase.regionserver.HStore.close(HStore.java:795) > at > org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1786) > at > org.apache.hadoop.hbase.regionserver.HRegion$2.call(HRegion.java:1783) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:750) {code} > This happens because the ChunkCreator is only initialized as part of > HRegionServer > [here.|https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java#L410-L431] > HRegion created on top of snapshot files within mapper wouldn't have > ChunkCreator initialized causing NPE while trying to close the memstore > This is seen after https://issues.apache.org/jira/browse/HBASE-28401 > There are 2 possible solutions here : > 1. Initialize ChunkCreator as while trying to create HRegion within snapashot > based mapper > 2. Disable the mslab altogether (via hbase.hregion.memstore.mslab.enabled set > to false) within snapashot based mapper -- This message was sent by Atlassian Jira (v8.20.10#820010)