Kiran Kumar Maturi created HBASE-29348:
------------------------------------------
Summary: NPE While reading store files for compaction
Key: HBASE-29348
URL: https://issues.apache.org/jira/browse/HBASE-29348
Project: HBase
Issue Type: Bug
Components: Compaction
Affects Versions: 2.5.11
Reporter: Kiran Kumar Maturi
In our production clusters we are observing null pointer exception during
compaction which avoids the compaction and causes the hfiles to grow
indefinitely . We are observing this only for date tiered compaction
This is the first NPE that is observed
{{}}
{code:java}
Exception in thread "regionserver/regionserverXXXX:60020-shortCompactions-8"
java.lang.NullPointerException
at
org.apache.hadoop.hbase.regionserver.HStoreFile.getMaximumTimestamp(HStoreFile.java:647)
at
org.apache.hadoop.hbase.regionserver.StoreFileComparators$GetMaxTimestamp.applyAsLong(StoreFileComparators.java:84)
at
org.apache.hadoop.hbase.regionserver.StoreFileComparators$GetMaxTimestamp.applyAsLong(StoreFileComparators.java:80)
at java.util.Comparator.lambda$comparingLong$6043328a$1(Comparator.java:511)
at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:217)
at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:216)
at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:216)
at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:216)
at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355)
at java.util.TimSort.sort(TimSort.java:220)
at java.util.Arrays.sort(Arrays.java:1438)
at
org.apache.hbase.thirdparty.com.google.common.collect.ImmutableList.sortedCopyOf(ImmutableList.java:347)
at
org.apache.hadoop.hbase.regionserver.DefaultStoreFileManager.addCompactionResults(DefaultStoreFileManager.java:128)
at
org.apache.hadoop.hbase.regionserver.StoreEngine.replaceStoreFiles(StoreEngine.java:497)
at
org.apache.hadoop.hbase.regionserver.HStore.replaceStoreFiles(HStore.java:1251)
at
org.apache.hadoop.hbase.regionserver.HStore.removeUnneededFiles(HStore.java:1577)
at
org.apache.hadoop.hbase.regionserver.HStore.requestCompaction(HStore.java:1445)
at
org.apache.hadoop.hbase.regionserver.CompactSplit.selectCompaction(CompactSplit.java:444)
at
org.apache.hadoop.hbase.regionserver.CompactSplit.access$200(CompactSplit.java:65)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:628)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:716)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
{code}
{{After this the hfiles keep growing as compaction fails with the following
exception}}
{{}}
{code:java}
Exception in thread "regionserver/regionserverXXXX:60020-shortCompactions-3"
java.lang.IllegalArgumentException
at
org.apache.hbase.thirdparty.com.google.common.base.Preconditions.checkArgument(Preconditions.java:131)
at
org.apache.hadoop.hbase.regionserver.compactions.SortedCompactionPolicy.getCurrentEligibleFiles(SortedCompactionPolicy.java:172)
at
org.apache.hadoop.hbase.regionserver.compactions.SortedCompactionPolicy.preSelectCompactionForCoprocessor(SortedCompactionPolicy.java:53)
at
org.apache.hadoop.hbase.regionserver.DateTieredStoreEngine$DateTieredCompactionContext.preSelect(DateTieredStoreEngine.java:68)
at
org.apache.hadoop.hbase.regionserver.HStore.requestCompaction(HStore.java:1454)
at
org.apache.hadoop.hbase.regionserver.CompactSplit.selectCompaction(CompactSplit.java:444)
at
org.apache.hadoop.hbase.regionserver.CompactSplit.access$200(CompactSplit.java:65)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:628)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:716)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750){code}
{{}}{{ }}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
