[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13419722#comment-13419722 ] Lars Hofhansl commented on HBASE-5659: -- Without parent the revised test fails every time. With parent it fails rarely. I do not know what the issue is. This only happens when the test does heavy flushing (during the course of the test > 1000 flushes happen. So the problem might be there. I can offer to disable the test or to reduce the number of flushes for now, but of course that pastes over the problem. I also would not mind if somebody else has a look at the test and check whether test logic itself is flawed. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0 > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:1
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420098#comment-13420098 ] Lars Hofhansl commented on HBASE-5659: -- This always comes after the change from HBASE-5121 is triggered. Looking back at HBASE-5121 it should only be triggered during a major compaction, but apparently it is not. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420099#comment-13420099 ] Lars Hofhansl commented on HBASE-5659: -- I think there is a subtle bug lurking somewhere. This test just happens to trigger that problem. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, sequenceid=7934, filesize=1.3k > 2012-03-27
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420114#comment-13420114 ] Hadoop QA commented on HBASE-5659: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12537477/5659.txt against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 hadoop2.0. The patch compiles against the hadoop 2.0 profile. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings). -1 findbugs. The patch appears to introduce 14 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.hbase.master.TestSplitLogManager Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2423//console This message is automatically generated. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/targ
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420281#comment-13420281 ] Lars Hofhansl commented on HBASE-5659: -- The patch is also a slight performance improvement. HBASE-5121 is too eager I think. The tests introduced with HBASE-5121 still pass with this change. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e21971
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420314#comment-13420314 ] Lars Hofhansl commented on HBASE-5659: -- In the latest failed runs I see this: {quote} org.apache.hadoop.hbase.DroppedSnapshotException: region: testtable,,1342893920897.74c4711d8d09b8d84618388ce125cedd.at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1474) at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1353) at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:1294) at org.apache.hadoop.hbase.regionserver.TestAtomicOperation$1.run(TestAtomicOperation.java:278) Caused by: java.io.FileNotFoundException: /home/hudson/hudson-slave/workspace/HBase-0.94/trunk/target/test-data/bca87d6a-50fb-4cdc-9e8c-72912928f4ed/TestAtomicOperationtestRowMutationMultiThreads/testtable/74c4711d8d09b8d84618388ce125cedd/.tmp/62b35712575041f28c04f6f953830b80 (Too many open files) at java.io.FileOutputStream.open(Native Method) at java.io.FileOutputStream.(FileOutputStream.java:194) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:188) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:184) at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:255) at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:236) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.(ChecksumFileSystem.java:335) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:381) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:364) at org.apache.hadoop.hbase.util.FSUtils.create(FSUtils.java:151) at org.apache.hadoop.hbase.util.FSUtils.create(FSUtils.java:126) at org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.createOutputStream(AbstractHFileWriter.java:271) at org.apache.hadoop.hbase.io.hfile.HFile$WriterFactory.create(HFile.java:393) at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.(StoreFile.java:956) at org.apache.hadoop.hbase.regionserver.StoreFile$Writer.(StoreFile.java:901) at org.apache.hadoop.hbase.regionserver.StoreFile$WriterBuilder.build(StoreFile.java:815) at org.apache.hadoop.hbase.regionserver.Store.createWriterInTmp(Store.java:836) at org.apache.hadoop.hbase.regionserver.Store.createWriterInTmp(Store.java:816) at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:717) at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:674) at org.apache.hadoop.hbase.regionserver.Store.access$400(Store.java:108) at org.apache.hadoop.hbase.regionserver.Store$StoreFlusherImpl.flushCache(Store.java:2247) at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1449) ... 3 more {quote} > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting,
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420316#comment-13420316 ] Lars Hofhansl commented on HBASE-5659: -- In fact all recent runs with this test failed show this exception. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, seq
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420320#comment-13420320 ] Lars Hofhansl commented on HBASE-5659: -- So then here's a new theory: The produces > 1000 flushes. Compactions can't keep up, hence a scan will need to merge all these files together. The limit for the test is 1024 open files. I would still like to include the first patch. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420337#comment-13420337 ] stack commented on HBASE-5659: -- Patch seems fine to me. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, sequenceid=7934, filesize=1.3k > 2012-03-27 04:36
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420343#comment-13420343 ] Hadoop QA commented on HBASE-5659: -- -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12537521/5659-v2.txt against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 hadoop2.0. The patch compiles against the hadoop 2.0 profile. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings). -1 findbugs. The patch appears to introduce 14 new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2427//console This message is automatically generated. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420393#comment-13420393 ] chunhui shen commented on HBASE-5659: - @Lars Could you add the failed test result except the exception caused by too many open files. >From the description, I don't see the following debug log {code} if (r.size() != 1) { LOG.debug(r); failures.incrementAndGet(); fail(); } {code} > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/wo
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420395#comment-13420395 ] chunhui shen commented on HBASE-5659: - Sorry, I find the debug log...Let me think about why... > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, seq
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420401#comment-13420401 ] chunhui shen commented on HBASE-5659: - The description log is 2012-03-27, from the log {quote}2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): Storescanner.peek() is changed where before = rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 {quote} Major compaction deleted the two KVs(rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922 rowB/colfamily11:qual1/7202/DeleteColumn), but the scanner is not closed, we shouldn't do the deleting. However, it is previous log, is there any recent log? > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAt
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420403#comment-13420403 ] chunhui shen commented on HBASE-5659: - About the patch, I don't think so, it will affect the scan's correctness again Why Storescanner.peek() will be changed when checkReseek()(Only do this action after Flush or Compaction), in current logic it shouldn't happen as per MVCC > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-40
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420414#comment-13420414 ] chunhui shen commented on HBASE-5659: - @Lars The above is something wrong, I think patch is OK, sorry to make mistake. I run the test many times but can't reproduce, so it's hard to find the reason, waiting for your recent logs, thanks! > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOper
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420428#comment-13420428 ] Lars Hofhansl commented on HBASE-5659: -- Thanks for looking at this Chunhui. This is a tricky area. Let me check in this change and see whether it happens again. A failed run is here: https://builds.apache.org/job/HBase-0.94/354/testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testRowMutationMultiThreads/ and here: https://builds.apache.org/job/HBase-0.94/353/testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testRowMutationMultiThreads/ Although, now I am beginning to think this is something new. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThread
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420435#comment-13420435 ] chunhui shen commented on HBASE-5659: - I think a case to fail the case, maybe it is quite rare, For the testRowMutationMultiThreads, assume there are 3 threads 1.Thread 1: rowA/colfamily11:qual1/1/Put/vlen=6/ rowA/colfamily11:qual2/1/DeleteColumn/vlen=6/ 2.Thread 3: rowA/colfamily11:qual1/3/DeleteColumn/vlen=6/ rowA/colfamily11:qual2/3/Put/vlen=6/ 3.Make major compaction 4.Thread 2:rowA/colfamily11:qual1/2/Put/vlen=6/ rowA/colfamily11:qual2/2/DeleteColumn/vlen=6/ 5.Thread 2: Get rowA, and the result is rowA/colfamily11:qual1/2/Put/vlen=6/ + rowA/colfamily11:qual2/3/Put/vlen=6/ > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.2 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/T
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420442#comment-13420442 ] chunhui shen commented on HBASE-5659: - For the above failed tests( https://builds.apache.org/job/HBase-0.94/353/ https://builds.apache.org/job/HBase-0.94/354/), I took a look and find they were both caused by too many open files > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtest
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420443#comment-13420443 ] Lars Hofhansl commented on HBASE-5659: -- Oops. Didn't see the comment. The problem in HBASE-5121 was that the scanner.next(...) would see a mix of KV from different rows, which would violate the scanner contract. Is this a different problem? Is the a problem with my change here? Lastly, could you make a runnable test? That'd be extremely helpful. If it fails, even if rarely, it is a bug. :) > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserv
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420444#comment-13420444 ] Lars Hofhansl commented on HBASE-5659: -- Re: Failed tests. Yes, I cannot find a single run that was not caused by TooManyOpenFiles. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e46
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420445#comment-13420445 ] Lars Hofhansl commented on HBASE-5659: -- So you think the change is bad (comparing just the row of the old and new top KV)? > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420447#comment-13420447 ] chunhui shen commented on HBASE-5659: - @Lars I think patch won't make some problem, but I don't think it's the reason of the failed tests. If all failed test were caused by TooManyOpenFiles, maybe there's no problem in current logic. Correct me if wrong...Thanks > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420468#comment-13420468 ] Hudson commented on HBASE-5659: --- Integrated in HBase-TRUNK #3163 (See [https://builds.apache.org/job/HBase-TRUNK/3163/]) HBASE-5659 TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally (Revision 1364501) Result = FAILURE larsh : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/6195461
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420472#comment-13420472 ] Lars Hofhansl commented on HBASE-5659: -- @Chunhui: I am not convinced either, honestly. Since the failure is so hard to reproduce I can only wait until the next failure now. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420477#comment-13420477 ] Hudson commented on HBASE-5659: --- Integrated in HBase-0.94 #355 (See [https://builds.apache.org/job/HBase-0.94/355/]) HBASE-5659 TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally (Revision 1364502) Result = FAILURE larsh : Files : * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a3
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13420575#comment-13420575 ] Hudson commented on HBASE-5659: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #106 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/106/]) HBASE-5659 TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally (Revision 1364501) Result = FAILURE larsh : Files : * /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421104#comment-13421104 ] Lars Hofhansl commented on HBASE-5659: -- >From Store.commitFile(...) {code} StoreFile sf = new StoreFile(this.fs, dstPath, this.conf, this.cacheConf, this.family.getBloomFilterType(), this.dataBlockEncoder); passSchemaMetricsTo(sf); StoreFile.Reader r = sf.createReader(); this.storeSize += r.length(); this.totalUncompressedBytes += r.getTotalUncompressedBytes(); {code} The created reader then is not closed. Is that by design (i.e. the reader is preopened for performance, because we expect the flushed file to be read soon), or is this an oversight? Maybe somebody else could have a look? > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b90
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421106#comment-13421106 ] Lars Hofhansl commented on HBASE-5659: -- I tested this by setting the "open files" limit to small value. When the reader is closed in commitFile(...) the "too many open files" exception does not occur. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThread
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421121#comment-13421121 ] Zhihong Ted Yu commented on HBASE-5659: --- Nice finding. Should true be passed to r.close() ? bulkLoadHFile() has a reader which is not closed. Should the reader be closed ? > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtab
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421130#comment-13421130 ] Lars Hofhansl commented on HBASE-5659: -- It's not 100% clear to me that the reader should be closed. There are other places where a reader is created but not closed (just searching for "createreader" in Store.java reveal a bunch). In this case I just tried figure out why so many storefiles are opened (I used lsof to list the open files). In Store.completeCompation() loops over all StoreFiles and expects that each has an opened reader (suggesting my addendum change would actually be incorrect). TestAtomicOperation just creates a *lot* of storefiles. The other thing I found is that while TestAtomicOperation#testRowMutationMultiThreads causes 25 threads to have all storefiles open (even though the test only uses 10 threads). When I run the test with only one thread I see 16 threads having all storefiles open. Something is funky. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421137#comment-13421137 ] Zhihong Ted Yu commented on HBASE-5659: --- I don't see completeCompation in Store.java Can you list the line number ? > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/6195461900
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421142#comment-13421142 ] Lars Hofhansl commented on HBASE-5659: -- Line 1664 (sorry, the 0.94 codeline) > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57, > entries=12, s
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421150#comment-13421150 ] Zhihong Ted Yu commented on HBASE-5659: --- Found it. I think StoreFile readers should be closed at the end of Store.completeCompaction() > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/c
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421154#comment-13421154 ] Zhihong Ted Yu commented on HBASE-5659: --- Correction for above observation. Readers for old store files are deleted already (line 1714): {code} // Finally, delete old store files. for (StoreFile hsf: compactedFiles) { hsf.deleteReader(); } {code} > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-dat
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421158#comment-13421158 ] Lars Hofhansl commented on HBASE-5659: -- I think that all StoreFiles in Store.storefiles are supposed to have an open reader: >From completeCompaction. {code} // 4. Compute new store size this.storeSize = 0L; this.totalUncompressedBytes = 0L; for (StoreFile hsf : this.storefiles) { StoreFile.Reader r = hsf.getReader(); if (r == null) { LOG.warn("StoreFile " + hsf + " has a null Reader"); continue; } {code} Another change, which fixes TestAtomicOperation is to introduce a compaction for each 10 flushes. I would still like to find out why so many have threads have the *same* HFiles open. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421167#comment-13421167 ] Lars Hofhansl commented on HBASE-5659: -- Never mind. Threads of the same process share the same open files of course. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum.txt, 5659-v2.txt, 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/6195461900
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421176#comment-13421176 ] ramkrishna.s.vasudevan commented on HBASE-5659: --- I think by design we keep the storefiles open. We have observed that if we have a bigger value for files to compact and we continuously keep flushing then lsof keeps raising. Frequent minor compaction reduces the count of lsof. May be for this testcase we have so many flushes happening and the compaction is not happening so often. Even when you do openRegion on a new RS one of the step is to open up all the readers and have it. {code} this.storefiles = sortAndClone(loadStoreFiles()); {code} > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421177#comment-13421177 ] ramkrishna.s.vasudevan commented on HBASE-5659: --- @Lars Oops, comments crossed. Just saw patch. +1. Doing frequent compactions should resolve this problem. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMu
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421204#comment-13421204 ] Hudson commented on HBASE-5659: --- Integrated in HBase-0.94 #359 (See [https://builds.apache.org/job/HBase-0.94/359/]) HBASE-5659 Addendum (Revision 1364894) Result = FAILURE larsh : Files : * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/works
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421224#comment-13421224 ] Hudson commented on HBASE-5659: --- Integrated in HBase-TRUNK #3169 (See [https://builds.apache.org/job/HBase-TRUNK/3169/]) HBASE-5659 Addendum (Revision 1364895) Result = SUCCESS larsh : Files : * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-sl
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421236#comment-13421236 ] stack commented on HBASE-5659: -- Yeah, we keep readers open so we don't pay the opening price once rather than inline w/ reads. > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Added > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421341#comment-13421341 ] Hudson commented on HBASE-5659: --- Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #108 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/108/]) HBASE-5659 Addendum (Revision 1364895) Result = FAILURE larsh : Files : * /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/colfamily11/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,634 INFO [Thread-126] regionserver.Store(818): Add
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13421667#comment-13421667 ] Hudson commented on HBASE-5659: --- Integrated in HBase-0.94-security #45 (See [https://builds.apache.org/job/HBase-0.94-security/45/]) HBASE-5659 Addendum (Revision 1364894) HBASE-5659 TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally (Revision 1364502) Result = FAILURE larsh : Files : * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java larsh : Files : * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/jenkins/jenkins-slave/wo
[jira] [Commented] (HBASE-5659) TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[ https://issues.apache.org/jira/browse/HBASE-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13428752#comment-13428752 ] Hudson commented on HBASE-5659: --- Integrated in HBase-0.94-security-on-Hadoop-23 #6 (See [https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/6/]) HBASE-5659 Addendum (Revision 1364894) HBASE-5659 TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally (Revision 1364502) Result = FAILURE larsh : Files : * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java larsh : Files : * /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java * /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java > TestAtomicOperation.testMultiRowMutationMultiThreads is still failing > occasionally > -- > > Key: HBASE-5659 > URL: https://issues.apache.org/jira/browse/HBASE-5659 > Project: HBase > Issue Type: Sub-task >Reporter: Lars Hofhansl >Assignee: Lars Hofhansl >Priority: Minor > Fix For: 0.96.0, 0.94.1 > > Attachments: 5659-addendum-v2.txt, 5659-addendum.txt, 5659-v2.txt, > 5659.txt > > > See run here: > https://builds.apache.org/job/PreCommit-HBASE-Build/1318//testReport/org.apache.hadoop.hbase.regionserver/TestAtomicOperation/testMultiRowMutationMultiThreads/ > {quote} > 2012-03-27 04:36:12,627 DEBUG [Thread-118] regionserver.StoreScanner(499): > Storescanner.peek() is changed where before = > rowB/colfamily11:qual1/7202/Put/vlen=6/ts=7922,and after = > rowB/colfamily11:qual1/7199/DeleteColumn/vlen=0/ts=0 > 2012-03-27 04:36:12,629 INFO [Thread-121] regionserver.HRegion(1558): > Finished memstore flush of ~2.9k/2952, currentsize=1.6k/1640 for region > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81. in 14ms, > sequenceid=7927, compaction requested=true > 2012-03-27 04:36:12,629 DEBUG [Thread-126] > regionserver.TestAtomicOperation$2(362): flushing > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1426): > Started memstore flush for > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., current region > memstore size 1.9k > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1474): > Finished snapshotting > testtable,,1332822963417.7cd30e219714cfc5e91f69def66e7f81., commencing wait > for mvcc, flushsize=1968 > 2012-03-27 04:36:12,630 DEBUG [Thread-126] regionserver.HRegion(1484): > Finished snapshotting, commencing flushing stores > 2012-03-27 04:36:12,630 DEBUG [Thread-126] util.FSUtils(153): Creating > file=/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > with permission=rwxrwxrwx > 2012-03-27 04:36:12,631 DEBUG [Thread-126] hfile.HFileWriterV2(143): > Initialized with CacheConfig:enabled [cacheDataOnRead=true] > [cacheDataOnWrite=false] [cacheIndexesOnWrite=false] > [cacheBloomsOnWrite=false] [cacheEvictOnClose=false] [cacheCompressed=false] > 2012-03-27 04:36:12,631 INFO [Thread-126] > regionserver.StoreFile$Writer(997): Delete Family Bloom filter type for > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57: > CompoundBloomFilterWriter > 2012-03-27 04:36:12,632 INFO [Thread-126] > regionserver.StoreFile$Writer(1220): NO General Bloom and NO DeleteFamily was > added to HFile > (/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57) > > 2012-03-27 04:36:12,632 INFO [Thread-126] regionserver.Store(770): Flushed , > sequenceid=7934, memsize=1.9k, into tmp file > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > 2012-03-27 04:36:12,632 DEBUG [Thread-126] regionserver.Store(795): Renaming > flushed file at > /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/trunk/target/test-data/b9091c3c-961e-4035-850a-83ad14d517cc/TestAtomicOperationtestMultiRowMutationMultiThreads/testtable/7cd30e219714cfc5e91f69def66e7f81/.tmp/61954619003e469baf1a34be5ff2ec57 > to > /home/