[ 
https://issues.apache.org/jira/browse/HBASE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13628039#comment-13628039
 ] 

Jonathan Hsieh commented on HBASE-7606:
---------------------------------------


Yikes! hadoop1 version of this used 10k rows and the test took 9+ minutes to 
complete. [1]
{code}
Test name   Duration   Status   
testJoinedScanners      9 min 8 sec     Passed
{code}

I've notched it down to 1k rows and the test completes, it passes for me 
locally for both h1 and h2 profiles on the order of a minute.  Hadoop2 has a 
2.5x regression, similar to HBASE-7605.
{code}
hadoop1:
  <testcase time="30.496" 
classname="org.apache.hadoop.hbase.regionserver.TestJoinedScanners" 
name="testJoinedScanners"/>

hadoop2:
<testcase time="80.085" 
classname="org.apache.hadoop.hbase.regionserver.TestJoinedScanners" 
name="testJoinedScanners"/>

{code}

[1] 
http://54.241.6.143/job/HBase-TRUNK/org.apache.hbase$hbase-server/119/testReport/org.apache.hadoop.hbase.regionserver/TestJoinedScanners/
                
> TestJoinedScanners fails in trunk build on hadoop 2.0
> -----------------------------------------------------
>
>                 Key: HBASE-7606
>                 URL: https://issues.apache.org/jira/browse/HBASE-7606
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Ted Yu
>            Assignee: Jonathan Hsieh
>         Attachments: hbase-7606.patch
>
>
> From 
> https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/353/testReport/junit/org.apache.hadoop.hbase.regionserver/TestJoinedScanners/testJoinedScanners/
>  :
> {code}
> 2013-01-17 13:41:18,113 WARN  
> [RegionServer:2;juno.apache.org,44920,1358430022974.cacheFlusher] 
> hdfs.DFSInputStream(664): DFS Read
> org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: 
> BP-624872226-67.195.138.61-1358430016098:blk_2914319395625853770_1224 
> file=/user/jenkins/hbase/TestJoinedScanners/4742bbe27e31aed5dfafd8b1e6dede03/.tmp/4ca392f6a0154df79cfafd3448f2c8aa
>       at 
> org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:734)
>       at 
> org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:448)
>       at 
> org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:645)
>       at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:689)
>       at java.io.DataInputStream.readFully(DataInputStream.java:178)
>       at 
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(FixedFileTrailer.java:428)
>       at 
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:555)
>       at 
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
>       at 
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1294)
>       at 
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
>       at 
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
>       at 
> org.apache.hadoop.hbase.regionserver.HStore.validateStoreFile(HStore.java:1259)
>       at 
> org.apache.hadoop.hbase.regionserver.HStore.commitFile(HStore.java:844)
>       at 
> org.apache.hadoop.hbase.regionserver.HStore.access$400(HStore.java:108)
>       at 
> org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.commit(HStore.java:1841)
>       at 
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1606)
>       at 
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1504)
>       at 
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:1445)
>       at 
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:410)
>       at 
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:384)
>       at 
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:247)
>       at java.lang.Thread.run(Thread.java:662)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to