[
https://issues.apache.org/jira/browse/PHOENIX-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007057#comment-16007057
]
Mujtaba Chohan edited comment on PHOENIX-3797 at 5/11/17 7:36 PM:
------------------------------------------------------------------
[~jamestaylor], [~rajeshbabu] Repros consistently with Bloom filter turned back
on. Tested with HBase 0.98.23 and head of Phoenix 4.x.
{noformat}
ERROR [RS:0;RS-smallCompactions-1494529773221] regionserver.CompactSplitThread:
Compaction failed Request =
regionName=T,00Dxx0000001gES005001xx000003DGQW\x80\x00\x01H\xF7\xAA,1494529828163.b505fb3b8b97119ff0a0da18b6e11171.,
storeName=L#0, fileCount=9, fileSize=126.4 M (15.7 M, 23.5 M, 23.5 M, 23.5 M,
8.0 M, 8.1 M, 8.1 M, 8.0 M, 8.1 M), priority=2, time=9328384816705648
java.io.IOException: Non-increasing Bloom keys:
00Dxx0000001gES005001xx000003DGQW\x80\x00\x01H\xF7\xAA\x00\x0000Dxx0000001gER\x80\x00\x01H*\xEA\x86p001001xx000003DGPb0171499340na
after
00Dxx0000001gES005001xx000003DGQW\x80\x00\x01H\xF7\xAA\x00\x0000Dxx0000001gER\x80\x00\x01I,T\xFE@001001xx000003DGPa01776146431b
at
org.apache.hadoop.hbase.regionserver.StoreFile$Writer.appendGeneralBloomfilter(StoreFile.java:960)
at
org.apache.hadoop.hbase.regionserver.StoreFile$Writer.append(StoreFile.java:996)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.performCompaction(Compactor.java:428)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:276)
at
org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:64)
at
org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:121)
{noformat}
Schema:
{noformat}
CREATE TABLE IF NOT EXISTS T (
OD CHAR(15) NOT NULL,
PX CHAR(3) NOT NULL,
PD CHAR(15) NOT NULL,
CRD DATE NOT NULL,
ED CHAR(15) NOT NULL,
FHD CHAR(15),
CONSTRAINT PK PRIMARY KEY
(
OD,
PX,
PD,
CRD,
ED
)
) MULTI_TENANT=true,IMMUTABLE_ROWS=true,VERSIONS=1
CREATE LOCAL INDEX IF NOT EXISTS T_IDX ON T (CRD)
{noformat}
was (Author: mujtabachohan):
[~jamestaylor], [~rajeshbabu] Repros consistently with Bloom filter turned back
on. Tested with HBase 0.98.23 and head of Phoenix 4.x.
{noformat}
ERROR [RS:0;RS-smallCompactions-1494529773221] regionserver.CompactSplitThread:
Compaction failed Request =
regionName=T,00Dxx0000001gES005001xx000003DGQW\x80\x00\x01H\xF7\xAA,1494529828163.b505fb3b8b97119ff0a0da18b6e11171.,
storeName=L#0, fileCount=9, fileSize=126.4 M (15.7 M, 23.5 M, 23.5 M, 23.5 M,
8.0 M, 8.1 M, 8.1 M, 8.0 M, 8.1 M), priority=2, time=9328384816705648
java.io.IOException: Non-increasing Bloom keys:
00Dxx0000001gES005001xx000003DGQW\x80\x00\x01H\xF7\xAA\x00\x0000Dxx0000001gER\x80\x00\x01H*\xEA\x86p001001xx000003DGPb0171499340na
after
00Dxx0000001gES005001xx000003DGQW\x80\x00\x01H\xF7\xAA\x00\x0000Dxx0000001gER\x80\x00\x01I,T\xFE@001001xx000003DGPa01776146431b
at
org.apache.hadoop.hbase.regionserver.StoreFile$Writer.appendGeneralBloomfilter(StoreFile.java:960)
at
org.apache.hadoop.hbase.regionserver.StoreFile$Writer.append(StoreFile.java:996)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.performCompaction(Compactor.java:428)
at
org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:276)
at
org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:64)
at
org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:121)
{noformat}
Schema:
{noformat}
CREATE TABLE IF NOT EXISTS T (
OD CHAR(15) NOT NULL,
PX CHAR(3) NOT NULL,
PD CHAR(15) NOT NULL,
CRD DATE NOT NULL,
ED CHAR(15) NOT NULL,
FHD CHAR(15),
CONSTRAINT PK PRIMARY KEY
(
OD,
PX,
PD,
CRD,
ED
)
) MULTI_TENANT=true,IMMUTABLE_ROWS=true,VERSIONS=1
CREATE LOCAL INDEX IF NOT EXISTS T_IDX ON FHA (CRD)
{noformat}
> Local Index - Compaction fails on table with local index due to
> non-increasing bloom keys
> -----------------------------------------------------------------------------------------
>
> Key: PHOENIX-3797
> URL: https://issues.apache.org/jira/browse/PHOENIX-3797
> Project: Phoenix
> Issue Type: Bug
> Environment: Head of 4.x-HBase-0.98 with PHOENIX-3796 patch applied.
> HBase 0.98.23-hadoop2
> Reporter: Mujtaba Chohan
> Fix For: 4.11.0
>
>
> Compaction fails on table with local index.
> {noformat}
> 2017-04-19 16:37:56,521 ERROR
> [RS:0;host:59455-smallCompactions-1492644947594]
> regionserver.CompactSplitThread: Compaction failed Request =
> regionName=FHA,00Dxx0000001gES005001xx000003DGPd,1492644985470.92ec6436984981cdc8ef02388005a957.,
> storeName=L#0, fileCount=3, fileSize=44.4 M (23.0 M, 10.7 M, 10.8 M),
> priority=7, time=7442973347247614
> java.io.IOException: Non-increasing Bloom keys:
> 00Dxx0000001gES005001xx000003DGPd\x00\x00\x80\x00\x01H+&\xA1(00Dxx0000001gER001001xx000003DGPb01739544DCtf
> after
> 00Dxx0000001gES005001xx000003DGPd\x00\x00\x80\x00\x01I+\xF4\x9Ax00Dxx0000001gER001001xx000003DGPa017115434KTM
>
> at
> org.apache.hadoop.hbase.regionserver.StoreFile$Writer.appendGeneralBloomfilter(StoreFile.java:960)
> at
> org.apache.hadoop.hbase.regionserver.StoreFile$Writer.append(StoreFile.java:996)
> at
> org.apache.hadoop.hbase.regionserver.compactions.Compactor.performCompaction(Compactor.java:428)
> at
> org.apache.hadoop.hbase.regionserver.compactions.Compactor.compact(Compactor.java:276)
> at
> org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:64)
> at
> org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:121)
> at org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:1154)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1559)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.doCompaction(CompactSplitThread.java:502)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:540)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:722)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
