[ https://issues.apache.org/jira/browse/HBASE-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ted Yu updated HBASE-9836: -------------------------- Attachment: 9836-v6.txt > Intermittent > TestRegionObserverScannerOpenHook#testRegionObserverCompactionTimeStacking > failure > ----------------------------------------------------------------------------------------------- > > Key: HBASE-9836 > URL: https://issues.apache.org/jira/browse/HBASE-9836 > Project: HBase > Issue Type: Test > Reporter: Ted Yu > Assignee: Ted Yu > Fix For: 0.98.0 > > Attachments: 9836-v1.txt, 9836-v3.txt, 9836-v4.txt, 9836-v5.txt, > 9836-v6.txt > > > Here were two recent examples: > https://builds.apache.org/job/hbase-0.96-hadoop2/99/testReport/org.apache.hadoop.hbase.coprocessor/TestRegionObserverScannerOpenHook/testRegionObserverCompactionTimeStacking/ > https://builds.apache.org/job/PreCommit-HBASE-Build/7616/testReport/junit/org.apache.hadoop.hbase.coprocessor/TestRegionObserverScannerOpenHook/testRegionObserverCompactionTimeStacking/ > From the second: > {code} > 2013-10-24 18:08:10,080 INFO [Priority.RpcServer.handler=1,port=58174] > regionserver.HRegionServer(3672): Flushing > testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. > ... > 2013-10-24 18:08:10,544 INFO [Priority.RpcServer.handler=1,port=58174] > regionserver.HRegion(1645): Finished memstore flush of ~128.0/128, > currentsize=0.0/0 for region > testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. > in 464ms, sequenceid=5, compaction requested=true > 2013-10-24 18:08:10,546 DEBUG [Priority.RpcServer.handler=1,port=58174] > regionserver.CompactSplitThread(319): Small Compaction requested: system; > Because: Compaction through user triggered flush; compaction_queue=(0:0), > split_queue=0, merge_queue=0 > 2013-10-24 18:08:10,547 DEBUG > [RS:0;asf002:58174-smallCompactions-1382638090545] > compactions.RatioBasedCompactionPolicy(92): Selecting compaction from 2 store > files, 0 compacting, 2 eligible, 10 blocking > 2013-10-24 18:08:10,547 DEBUG [pool-1-thread-1] catalog.CatalogTracker(209): > Stopping catalog tracker org.apache.hadoop.hbase.catalog.CatalogTracker@4be179 > 2013-10-24 18:08:10,549 DEBUG > [RS:0;asf002:58174-smallCompactions-1382638090545] > compactions.ExploringCompactionPolicy(112): Exploring compaction algorithm > has selected 2 files of size 1999 starting at candidate #0 after considering > 1 permutations with 1 in ratio > 2013-10-24 18:08:10,551 DEBUG > [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HStore(1329): > e96920e43ea374ba1bd559df115870cf - A: Initiating major compaction > 2013-10-24 18:08:10,551 INFO > [RS:0;asf002:58174-smallCompactions-1382638090545] > regionserver.HRegion(1294): Starting compaction on A in region > testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. > 2013-10-24 18:08:10,551 INFO > [RS:0;asf002:58174-smallCompactions-1382638090545] regionserver.HStore(982): > Starting compaction of 2 file(s) in A of > testRegionObserverCompactionTimeStacking,,1382638088230.e96920e43ea374ba1bd559df115870cf. > into > tmpdir=hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/.tmp, > totalSize=2.0k > 2013-10-24 18:08:10,552 DEBUG > [RS:0;asf002:58174-smallCompactions-1382638090545] > compactions.Compactor(168): Compacting > hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/A/44f87b94732149c08f20bdba00dd7140, > keycount=1, bloomtype=ROW, size=992.0, encoding=NONE, seqNum=3, > earliestPutTs=1382638089528 > 2013-10-24 18:08:10,552 DEBUG > [RS:0;asf002:58174-smallCompactions-1382638090545] > compactions.Compactor(168): Compacting > hdfs://localhost:49506/user/jenkins/hbase/data/default/testRegionObserverCompactionTimeStacking/e96920e43ea374ba1bd559df115870cf/A/0b2e580cbda246718bbf64c21e81cd18, > keycount=1, bloomtype=ROW, size=1007.0, encoding=NONE, seqNum=5, > earliestPutTs=1382638090053 > 2013-10-24 18:08:10,564 DEBUG > [RS:0;asf002:58174-smallCompactions-1382638090545] util.FSUtils(305): DFS > Client does not support most favored nodes create; using default create > ... > Potentially hanging thread: RS:0;asf002:58174-smallCompactions-1382638090545 > java.lang.Object.wait(Native Method) > java.lang.Object.wait(Object.java:485) > org.apache.hadoop.ipc.Client.call(Client.java:1099) > org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229) > $Proxy9.complete(Unknown Source) > sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > java.lang.reflect.Method.invoke(Method.java:597) > > org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:85) > > org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:62) > $Proxy9.complete(Unknown Source) > sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > java.lang.reflect.Method.invoke(Method.java:597) > org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:266) > $Proxy15.complete(Unknown Source) > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.closeInternal(DFSClient.java:4121) > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.close(DFSClient.java:4022) > > org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:61) > org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:86) > > org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.finishClose(AbstractHFileWriter.java:251) > org.apache.hadoop.hbase.io.hfile.HFileWriterV2.close(HFileWriterV2.java:408) > > org.apache.hadoop.hbase.regionserver.StoreFile$Writer.close(StoreFile.java:984) > > org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor.compact(DefaultCompactor.java:91) > > org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext.compact(DefaultStoreEngine.java:103) > org.apache.hadoop.hbase.regionserver.HStore.compact(HStore.java:991) > org.apache.hadoop.hbase.regionserver.HRegion.compact(HRegion.java:1300) > > org.apache.hadoop.hbase.regionserver.CompactSplitThread$CompactionRunner.run(CompactSplitThread.java:475) > {code} > Looks like the compaction was still running when assertion failed. -- This message was sent by Atlassian JIRA (v6.1#6144)