how to measure IO on HBase
Hello, I have a HBase cluster of 1 Master node and 5 Region Servers deployed on HDFS. What is the best way to measure IO for the operations on cluster such as 1. Scan 2. Get 3. Put I need to conduct the measurement in 2 scenarios. In the first scenario, a have a simple table (size > 1GB), consisting of just one column family. The second scenario will be slightly more complicated with the 'primary key' being stored in the memstore or HFile in parts. -- View this message in context: http://apache-hbase.679495.n3.nabble.com/how-to-measure-IO-on-HBase-tp4061207.html Sent from the HBase User mailing list archive at Nabble.com.
Re: how to measure IO on HBase
Thank you very much! I'll take a look. Regards Sahana On Thu, Jul 10, 2014 at 12:02 PM, Ted Yu-3 [via Apache HBase] < ml-node+s679495n4061208...@n3.nabble.com> wrote: > Please see chapter 17 of refguide. > > Especially http://hbase.apache.org/book.html#ops.monitoring > > Cheers > > On Jul 10, 2014, at 2:51 AM, sahanashankar <[hidden email] > <http://user/SendEmail.jtp?type=node&node=4061208&i=0>> wrote: > > > Hello, > > > > I have a HBase cluster of 1 Master node and 5 Region Servers deployed on > > HDFS. > > > > What is the best way to measure IO for the operations on cluster such as > > > > 1. Scan > > 2. Get > > 3. Put > > > > I need to conduct the measurement in 2 scenarios. In the first scenario, > a > > have a simple table (size > 1GB), consisting of just one column family. > The > > second scenario will be slightly more complicated with the 'primary key' > > being stored in the memstore or HFile in parts. > > > > > > > > > > > > -- > > View this message in context: > http://apache-hbase.679495.n3.nabble.com/how-to-measure-IO-on-HBase-tp4061207.html > > Sent from the HBase User mailing list archive at Nabble.com. > > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-hbase.679495.n3.nabble.com/how-to-measure-IO-on-HBase-tp4061207p4061208.html > To unsubscribe from how to measure IO on HBase, click here > <http://apache-hbase.679495.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4061207&code=c2FoYW5hc2hhbmthcjkwQGdtYWlsLmNvbXw0MDYxMjA3fDM5ODU4NTQ5Mg==> > . > NAML > <http://apache-hbase.679495.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-hbase.679495.n3.nabble.com/how-to-measure-IO-on-HBase-tp4061207p4061374.html Sent from the HBase User mailing list archive at Nabble.com.
Usage of HBase Slow Query Log
Hello, I am having difficulty in understanding how to use the HBase Slow Query Log. I understand the theory and its intended use but i am facing problems with its implementation. Can somebody please guide me to any such example implementation of slow query log so that i get an idea of how to use this structure? I did try searching the internet for any such information but i couldn't find anything helpful. Thanks -- View this message in context: http://apache-hbase.679495.n3.nabble.com/Usage-of-HBase-Slow-Query-Log-tp4061580.html Sent from the HBase User mailing list archive at Nabble.com.
can read operation be performed during the execution of major compaction
Hello, I am trying to understand the working of major compaction and i am wondering if a read operation can be performed while the major compaction process is running on HBase. Will the read operation be queued and start after major compaction has finished executing? or can both execute together? To be more general, will only the particular region be blocked during major compaction or will the entire RegionServer hosting the region be blocked ? Thanks in advance Sahana -- View this message in context: http://apache-hbase.679495.n3.nabble.com/can-read-operation-be-performed-during-the-execution-of-major-compaction-tp4065208.html Sent from the HBase User mailing list archive at Nabble.com.
Re: can read operation be performed during the execution of major compaction
Thank u so much for your response. It makes sense to me now. On 20 Oct 2014 20:27, "Elliott Clark-3 [via Apache HBase]" < ml-node+s679495n4065210...@n3.nabble.com> wrote: > No read operations are not blocked by any compactions. > > Compaction will swap in it's newly created file for any subsequent read > requests. Any read requests that come in during the compaction will be > answered from the files already there and the memstore. > > On Mon, Oct 20, 2014 at 8:52 AM, sahanashankar <[hidden email] > <http://user/SendEmail.jtp?type=node&node=4065210&i=0>> > wrote: > > > Hello, > > > > I am trying to understand the working of major compaction and i am > > wondering > > if a read operation can be performed while the major compaction process > is > > running on HBase. Will the read operation be queued and start after > major > > compaction has finished executing? or can both execute together? > > > > To be more general, will only the particular region be blocked during > major > > compaction or will the entire RegionServer hosting the region be blocked > ? > > > > Thanks in advance > > Sahana > > > > > > > > -- > > View this message in context: > > > http://apache-hbase.679495.n3.nabble.com/can-read-operation-be-performed-during-the-execution-of-major-compaction-tp4065208.html > > Sent from the HBase User mailing list archive at Nabble.com. > > > > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-hbase.679495.n3.nabble.com/can-read-operation-be-performed-during-the-execution-of-major-compaction-tp4065208p4065210.html > To unsubscribe from can read operation be performed during the execution > of major compaction, click here > <http://apache-hbase.679495.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4065208&code=c2FoYW5hc2hhbmthcjkwQGdtYWlsLmNvbXw0MDY1MjA4fDM5ODU4NTQ5Mg==> > . > NAML > <http://apache-hbase.679495.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-hbase.679495.n3.nabble.com/can-read-operation-be-performed-during-the-execution-of-major-compaction-tp4065208p4065323.html Sent from the HBase User mailing list archive at Nabble.com.
