Rajeshbabu Chintaguntla created HBASE-27365:
-----------------------------------------------

             Summary: Minimise block addition failures due to no space in 
bucket cache writers queue by introducing wait time
                 Key: HBASE-27365
                 URL: https://issues.apache.org/jira/browse/HBASE-27365
             Project: HBase
          Issue Type: Improvement
          Components: BucketCache
            Reporter: Rajeshbabu Chintaguntla
            Assignee: Rajeshbabu Chintaguntla


Currently in bucket cache asynchronous caching mechanism introduced where 
initially the blocks to be cached will be added to queue and writer threads 
consume the blocks from the queue and write to bucket cache. In case if block 
writing to bucket cache is slow then there is a chance that  queue of writer 
threads become full  and following block additions will be failed. In case of 
slower storages like s3 might introduce latencies even if we enable bigger 
sizes of bucket cache using ephemeral storages. So we can allow configurable 
wait time while adding blocks to queue so that chances of queue free up is 
possible during the wait time and block addition failures can be minimised.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to