[
https://issues.apache.org/jira/browse/HBASE-27919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17732962#comment-17732962
]
Liangjun He edited comment on HBASE-27919 at 6/15/23 9:44 AM:
--------------------------------------------------------------
Setup a 5 slave nodes cluster, and run this command:
{code:java}
hbase org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList
-DIntegrationTestBigLinkedList.table=itbll -m slowDeterministic Loop 10 10
100000000 /tmp/biglinkedlist 100
{code}
Some RegionServer are experiencing the following error:
{code:java}
java.lang.NullPointerException
at
org.apache.hadoop.hbase.regionserver.StoreFileReader.passesGeneralRowPrefixBloomFilter(StoreFileReader.java:352)
at
org.apache.hadoop.hbase.regionserver.StoreFileReader.passesBloomFilter(StoreFileReader.java:265)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.shouldUseScanner(StoreFileScanner.java:483)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.selectScannersFrom(StoreScanner.java:467)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:320)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:289)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.createScanner(Compactor.java:544)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor$1.createScanner(Compactor.java:269)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:358)
at
org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:64)
at
org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122)
at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1176)
at
org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2407)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:667)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:716)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
{code}
And the definition of the itbll table is as follows:
{code:java}
'itbll', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy',
'hbase.store.file-tracker.impl' => 'DEFAULT'}}}, {NAME => 'EPvNy', VERSIONS =>
'3', MIN_VERSIONS => '3', METADATA => {'COMPRESSION_COMPACT' => 'BZIP2'}},
{NAME => 'IrePz', VERSIONS => '3', MIN_VERSIONS => '3', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}}, {NAME => 'big', VERSIONS => '3',
MIN_VERSIONS => '3', BLOOMFILTER => 'ROWCOL', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}}, {NAME => 'meta', VERSIONS => '3',
MIN_VERSIONS => '3', BLOOMFILTER => 'ROWCOL', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}, CONFIGURATION =>
{'RowPrefixBloomFilter.prefix_length' => '10'}}, {NAME => 'tiny', VERSIONS =>
'3', MIN_VERSIONS => '3', BLOOMFILTER => 'ROWCOL', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}}
{code}
[~zhangduo] sir, can you take a look at this issue, thanks?
was (Author: heliangjun):
Setup a 5 slave nodes cluster, and run this command:
{code:java}
hbase org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList
-DIntegrationTestBigLinkedList.table=itbll -m slowDeterministic Loop 10 10
100000000 /tmp/biglinkedlist 100
{code}
Some RegionServer are experiencing the following error:
{code:java}
java.lang.NullPointerException
at
org.apache.hadoop.hbase.regionserver.StoreFileReader.passesGeneralRowPrefixBloomFilter(StoreFileReader.java:352)
at
org.apache.hadoop.hbase.regionserver.StoreFileReader.passesBloomFilter(StoreFileReader.java:265)
at
org.apache.hadoop.hbase.regionserver.StoreFileScanner.shouldUseScanner(StoreFileScanner.java:483)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.selectScannersFrom(StoreScanner.java:467)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:320)
at
org.apache.hadoop.hbase.regionserver.StoreScanner.<init>(StoreScanner.java:289)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.createScanner(Compactor.java:544)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor$1.createScanner(Compactor.java:269)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:358)
at
org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:64)
at
org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:122)
at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1176)
at
org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:2407)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:667)
at
org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:716)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
{code}
And the definition of the itbll table is as follows:
{code:java}
'itbll', {TABLE_ATTRIBUTES => {METADATA => {'SPLIT_POLICY' =>
'org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy',
'hbase.store.file-tracker.impl' => 'DEFAULT'}}}, {NAME => 'EPvNy', VERSIONS =>
'3', MIN_VERSIONS => '3', METADATA => {'COMPRESSION_COMPACT' => 'BZIP2'}},
{NAME => 'IrePz', VERSIONS => '3', MIN_VERSIONS => '3', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}}, {NAME => 'big', VERSIONS => '3',
MIN_VERSIONS => '3', BLOOMFILTER => 'ROWCOL', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}}, {NAME => 'meta', VERSIONS => '3',
MIN_VERSIONS => '3', BLOOMFILTER => 'ROWCOL', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}, CONFIGURATION =>
{'RowPrefixBloomFilter.prefix_length' => '10'}}, {NAME => 'tiny', VERSIONS =>
'3', MIN_VERSIONS => '3', BLOOMFILTER => 'ROWCOL', METADATA =>
{'COMPRESSION_COMPACT' => 'BZIP2'}}
{code}
> Run ITBLL for branch-3
> ----------------------
>
> Key: HBASE-27919
> URL: https://issues.apache.org/jira/browse/HBASE-27919
> Project: HBase
> Issue Type: Sub-task
> Components: integration tests
> Reporter: Duo Zhang
> Assignee: Liangjun He
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
