Re: Stripe Compactions Stability

2018-09-17 Thread sudhir patil
Have you considered below options to reduce number/time of compactions? - Reduce memstore flushes to create fewer hfiles there by reducing number of compactions. By setting hbase.hregion.memstore.flush.size and other parameters. - hbase.offpeak.start & end , so that compactions triggered during

Re: Stripe Compactions Stability

2018-09-17 Thread Ted Yu
Hi, To my knowledge, stripe compaction has not seen patches for a few years. Have you looked at : http://hbase.apache.org/book.html#ops.date.tiered If the above doesn't suit your needs, can you tell us more about your use case ? Thanks On Mon, Sep 17, 2018 at 11:39 AM Austin Heyne wrote: >

Stripe Compactions Stability

2018-09-17 Thread Austin Heyne
The HBase cluster we're running has well over 100TB of data spread across two tables and as you'd guess we're suffering from compaction times taking way to long (and we need to double or triple that volume). I've found information on Stripe Compactions [1] which it seems like we could benefit