Re: Hbase write stream blocking and any solutions?

2013-06-10 Thread Kevin O'dell
: Sunday, June 9, 2013 6:28 AM Subject: Hbase write stream blocking and any solutions? Hi, All HBase could block the online write operations when there are too many data in memstore (to be more efficient for the potential compaction incurred by this flush when there're many files

Re: Hbase write stream blocking and any solutions?

2013-06-10 Thread lars hofhansl
Subject: Re: Hbase write stream blocking and any solutions? thanks lars for the insights. I guess current hbase may have to block write stream even when data write rate does not reach the limit of IO subsystems. Blocking happen because of the compaction which is so consuming and has to be invoked

Re: Hbase write stream blocking and any solutions?

2013-06-10 Thread lars hofhansl
...@cloudera.com To: user@hbase.apache.org user@hbase.apache.org Cc: lars hofhansl la...@apache.org Sent: Monday, June 10, 2013 6:37 AM Subject: Re: Hbase write stream blocking and any solutions? Hi Yun, Sorry for the novel, also I am not fully awake so hopefully all of this makes sense!   Something

Hbase write stream blocking and any solutions?

2013-06-09 Thread yun peng
Hi, All HBase could block the online write operations when there are too many data in memstore (to be more efficient for the potential compaction incurred by this flush when there're many files on disk). This blocking effect is also observed by others (e.g.,

Re: Hbase write stream blocking and any solutions?

2013-06-09 Thread lars hofhansl
more graceful. -- Lars From: yun peng pengyunm...@gmail.com To: user@hbase.apache.org Sent: Sunday, June 9, 2013 6:28 AM Subject: Hbase write stream blocking and any solutions? Hi, All HBase could block the online write operations when there are too many data

Re: Hbase write stream blocking and any solutions?

2013-06-09 Thread yun peng
, 2013 6:28 AM Subject: Hbase write stream blocking and any solutions? Hi, All HBase could block the online write operations when there are too many data in memstore (to be more efficient for the potential compaction incurred by this flush when there're many files on disk). This blocking effect