Thanks, Stack. There is a log line for each failed get and in this test
there is a lot of gets. I will dig to understand if it can occur in
reasonable production conditions as well...
On Tue, Mar 26, 2013 at 7:57 PM, Stack <st...@duboce.net> wrote:
> When a request goes into a server, a function is called to evaluate whether
> it should be high or low priority (The mechanism for making the
> function-to-call pluggable is a guava facility). This mechanism has been
> in place for ever.
>
> On the recent rpc commit, this QoS stuff had to be refactored. Previous,
> in essence, it undid the request to figure what region the request was for
> because if it was say .META., then the request should be given a high
> priority. With the move to pb and the refactor of the way we do parameters
> and requests, there is less to undo.
>
> As part of the refactor, I enabled logging. At a minimum, this exposed the
> following interesting phenomeon: If we get a request for a region that is
> not on the particular server, NotServingRegionException is thrown, which
> QoS then catches and sets priority to 'normal'.. then it lets the request
> come into the regionserver and it throws NSRE again.
>
> Anyway, if it is logging too much turn it down... I can. I enabled it so
> could see what was going on.
>
> Sorry about that,
> St.Ack
>
>
> On Tue, Mar 26, 2013 at 10:17 AM, Nicolas Liochon <nkey...@gmail.com>
> wrote:
>
> > Yes on trunk. I found this line, which seems to be written for guava.
> > That's the global picture behind this line that I don't have :-)
> >
> >
> > On Tue, Mar 26, 2013 at 6:15 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> >
> > > You tested with trunk, right ?
> > >
> > > Here it is:
> > >
> > > if (LOG.isDebugEnabled()) LOG.debug("Marking normal priority
> after
> > > getting exception=" + ex);
> > >
> > >
> >
> ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/QosFunction.java
> > >
> > > On Tue, Mar 26, 2013 at 10:07 AM, Nicolas Liochon <nkey...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > I'm doing some recovery tests (unplugging a server) I've got
> something
> > > new:
> > > > hundreds of line like this one in the region server logs. Does anyone
> > > know
> > > > where it comes from?
> > > >
> > > > Thanks,
> > > >
> > > >
> > > > 2013-03-26 17:59:40,693 DEBUG
> > > > org.apache.hadoop.hbase.regionserver.QosFunction: Marking normal
> > priority
> > > > after getting
> > > >
> exception=org.apache.hadoop.hbase.exceptions.NotServingRegionException:
> > > > Region is not online: 3dfeaf95dd18d06c24fc679a0ab016d2
> > > > 2013-03-26 17:59:40,693 DEBUG
> > > > org.apache.hadoop.hbase.regionserver.QosFunction: Marking normal
> > priority
> > > > after getting
> > > >
> exception=org.apache.hadoop.hbase.exceptions.NotServingRegionException:
> > > > Region is not online: 3dfeaf95dd18d06c24fc679a0ab016d2
> > > > 2013-03-26 17:59:40,897 DEBUG
> > > > org.apache.hadoop.hbase.regionserver.QosFunction: Marking normal
> > priority
> > > > after getting
> > > >
> exception=org.apache.hadoop.hbase.exceptions.NotServingRegionException:
> > > > Region is not online: 3dfeaf95dd18d06c24fc679a0ab016d2
> > > > 2013-03-26 17:59:40,897 DEBUG
> > > > org.apache.hadoop.hbase.regionserver.QosFunction: Marking normal
> > priority
> > > > after getting
> > > >
> exception=org.apache.hadoop.hbase.exceptions.NotServingRegionException:
> > > > Region is not online: 3dfeaf95dd18d06c24fc679a0ab016d2
> > > > 2013-03-26 17:59:41,100 DEBUG
> > > > org.apache.hadoop.hbase.regionserver.QosFunction: Marking normal
> > priority
> > > > after getting
> > > >
> exception=org.apache.hadoop.hbase.exceptions.NotServingRegionException:
> > > > Region is not online: 3dfeaf95dd18d06c24fc679a0ab016d2
> > > >
> > >
> >
>
