Thanks for the replies.I understand the difficulty in tracking distributed scans.Meanwhile I found that "responseTooSlow" queries, do get written to log. The entry contains scan details(table, start and endrowkey, response size and processing time)So I was thinking to lower the threshold so that most queries get logged, and then ingesting the log to elasticsearch with logstash. The other option is Trace log level..which is bad?
Sent from my Samsung Galaxy smartphone. -------- Original message --------From: Wei-Chiu Chuang <[email protected]> Date: 1/9/19 14:38 (GMT+02:00) To: [email protected] Subject: Re: HBase top activity FWIW, Andrew proposed a htop utility: https://issues.apache.org/jira/browse/HBASE-11062 On Wed, Jan 9, 2019 at 4:36 AM Wellington Chevreuil < [email protected]> wrote: > I don't think it is possible to track individual scans resources usage, > current available JMX metrics are an aggregation of all request types > (scanNext, append, get, delete) per regions level at individual RSes, and > these are basically counts on the number of those requests. Resources usage > are measured at RS process level, so that also adds a challenge to account > those for individual scans. Sure, you could break those down by looking at > each thread usage with some monitoring tool such as VisualVM, but then you > would still need to map each RPC handler to an specific scan, and depending > on how large the result, a single scan would be addressed by different > handlers every time it calls "next" fetch another batch of results it's > iterating through. > > Em seg, 7 de jan de 2019 às 14:27, [email protected] < > [email protected]> escreveu: > > > Maybe coprocessor can help you in some way. > > > > > > > > [email protected] > > > > From: Meirav Malka > > Date: 2019-01-07 19:22 > > To: Hbase User Group; dev > > Subject: HBase top activity > > Hi, > > > > Does anyone know i there's a way to get the current operations running > in a > > HBase cluster? > > We want to be able to detect the running scans, their execution time, > > number of executions,cpu, memory and io.(as can be found in Oracle > > database) > > Is there any tracking of this data in HBase? > > > > Thanks > > >
