[ 
https://issues.apache.org/jira/browse/HBASE-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14006685#comment-14006685
 ] 

Hudson commented on HBASE-9857:
-------------------------------

FAILURE: Integrated in HBase-0.98 #311 (See 
[https://builds.apache.org/job/HBase-0.98/311/])
HBASE-9857 Blockcache prefetch option (apurtell: rev 
9b9f4df87a432778cc6f16becfeeea72e507e526)
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderV3.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheOnWrite.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCache.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCacheOnWriteInSchema.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileReaderV2.java
* hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CombinedBlockCache.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileDataBlockEncoder.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/PrefetchExecutor.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/util/CompoundBloomFilter.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/CacheTestUtils.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/RandomSeek.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SlabCache.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/bucket/TestBucketCache.java
* hbase-shell/src/main/ruby/hbase/admin.rb
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/DoubleBlockCache.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SingleSizeCache.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestLruBlockCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
* hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestPrefetch.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/SimpleBlockCache.java
* hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
* 
hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockIndex.java
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFileBlockIndex.java
Amend HBASE-9857 Blockcache prefetch option; add missing license header 
(apurtell: rev f87fc3cea43698e9f417b12aabb7bd4f7932155a)
* 
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/AbstractHFileReader.java


> Blockcache prefetch option
> --------------------------
>
>                 Key: HBASE-9857
>                 URL: https://issues.apache.org/jira/browse/HBASE-9857
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>             Fix For: 0.99.0, 0.98.3
>
>         Attachments: 9857.patch, 9857.patch, HBASE-9857-0.98.patch, 
> HBASE-9857-trunk.patch, HBASE-9857-trunk.patch
>
>
> Attached patch implements a prefetching function for HFile (v3) blocks, if 
> indicated by a column family or regionserver property. The purpose of this 
> change is to as rapidly after region open as reasonable warm the blockcache 
> with all the data and index blocks of (presumably also in-memory) table data, 
> without counting those block loads as cache misses. Great for fast reads and 
> keeping the cache hit ratio high. Can tune the IO impact versus time until 
> all data blocks are in cache. Works a bit like CompactSplitThread. Makes some 
> effort not to stampede.
> I have been using this for setting up various experiments and thought I'd 
> polish it up a bit and throw it out there. If the data to be preloaded will 
> not fit in blockcache, or if as a percentage of blockcache it is large, this 
> is not a good idea, will just blow out the cache and trigger a lot of useless 
> GC activity. Might be useful as an expert tuning option though. Or not.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to