[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Fix Version/s: (was: 0.94.0) > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0 > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, sequenceid=7934, filesize=1.3k > 2012-03-27 04:36:12,642 DEBUG [Thread-118] > regionserver.TestAtomicOperation$2(392): [] > Exception in thread "Thread-118" junit.framework.Asserti
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Fix Version/s: 0.94.2 > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, sequenceid=7934, filesize=1.3k > 2012-03-27 04:36:12,642 DEBUG [Thread-118] > regionserver.TestAtomicOperation$2(392): [] > Exception in thread "Thread-118" junit.framework.AssertionF
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Attachment: 5659.txt While this (probably) won't fix the problem I would like to propose this simple change to the logic introduced in HBASE-5121. The observation is that a change top KV is only a problem when the KV's row has changed from the previous one. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperati
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Status: Patch Available (was: Open) > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, sequenceid=7934, filesize=1.3k > 2012-03-27 04:36:12,642 DEBUG [Thread-118] > regionserver.TestAt
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Attachment: 5659-v2.txt Patch that only compares rows when top KV is changed and also reduces the number of ops/thread to 500 in testMultiRowMutationMultiThreads (same value now as in testRowMutationMultiThreads). I will commit this soon, if no objections. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestA
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Resolution: Fixed Fix Version/s: (was: 0.94.2) 0.94.1 Status: Resolved (was: Patch Available) Committed to 0.94 and 0.96. I'll watch the test results. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e2197
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Attachment: 5659-addendum.txt Here's the addendum I have in mind. Makes TestAtomicOperation pass even with a low "open files" setting (256, which previously would always fail). The previous changes are still valid. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiR
[jira] [Updated] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HBASE-5659: - Attachment: 5659-addendum-v2.txt The reader being closed in commitFile was a dud, I think. Here's a patch that throws in some compactions during the test. With that I can reliably run TestAtomicOperation with "open files" set to 512 (which would other reliably fail the test). The test machines have "open files" = 1024, so that would provide enough buffer. Addendum-v2 is not contentious I think. Will commit soon, unless there are objections. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/619