Re: Stripe Compactions Stability

2018-09-19 Thread Austin Heyne
Thanks for the info. Looks like I'll avoid using that feature then. We have a fairly complicated and well thought out compaction management running but since we're moving into needing near 100% uptime we don't have the window for tables to be tied up compacting. We're working on a solution to

Re: Stripe Compactions Stability

2018-09-17 Thread sudhir patil
Have you considered below options to reduce number/time of compactions? - Reduce memstore flushes to create fewer hfiles there by reducing number of compactions. By setting hbase.hregion.memstore.flush.size and other parameters. - hbase.offpeak.start & end , so that compactions triggered during

Re: Stripe Compactions Stability

2018-09-17 Thread Ted Yu
Hi, To my knowledge, stripe compaction has not seen patches for a few years. Have you looked at : http://hbase.apache.org/book.html#ops.date.tiered If the above doesn't suit your needs, can you tell us more about your use case ? Thanks On Mon, Sep 17, 2018 at 11:39 AM Austin Heyne wrote: >

Stripe Compactions Stability

2018-09-17 Thread Austin Heyne
The HBase cluster we're running has well over 100TB of data spread across two tables and as you'd guess we're suffering from compaction times taking way to long (and we need to double or triple that volume). I've found information on Stripe Compactions [1] which it seems like we could benefit