[ 
https://issues.apache.org/jira/browse/HBASE-21032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587865#comment-16587865
 ] 

Andrey Elenskiy commented on HBASE-21032:
-----------------------------------------

I'm hitting another issue I've had before with 2.1 when upgrading dev cluster. 
HBase master is stuck initializing because it can't get to hbase:namespace 
region:

{{18/08/21 18:52:28 INFO client.RpcRetryingCallerImpl: Call exception, 
tries=32, retries=46, started=471534 ms ago, cancelled=false, 
msg=org.apache.hadoop.hbase.NotServingRegionException: 
hbase:namespace,,1508805323559.2ad4d95f7b9d9ba0d746b8da50a7f9a7. is not online 
on regionserver-0,16020,1534877035908}}
{{    at 
org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:3287)}}
{{    at 
org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3264)}}
{{    at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:1428)}}
{{    at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2443)}}
{{    at 
org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:41998)}}
{{    at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)}}
{{    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)}}
{{    at 
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)}}
{{    at 
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)}}
{{, details=row 'default' on table 'hbase:namespace' at 
region=hbase:namespace,,1508805323559.2ad4d95f7b9d9ba0d746b8da50a7f9a7., 
hostname=regionserver-0,16020,1534538897512, seqNum=172}}

 

And there's nothing about hbase:namespace in regionserver-0's logs. Don't 
really know how to work around this.

> ScanResponses contain only one cell each
> ----------------------------------------
>
>                 Key: HBASE-21032
>                 URL: https://issues.apache.org/jira/browse/HBASE-21032
>             Project: HBase
>          Issue Type: Bug
>          Components: Performance, Scanners
>    Affects Versions: 2.1.0
>         Environment: HBase 2.1.0
> Hadoop 2.8.4
> Java 8
>            Reporter: Andrey Elenskiy
>            Assignee: Andrey Elenskiy
>            Priority: Major
>             Fix For: 3.0.0, 2.2.0, 2.1.1
>
>         Attachments: App.java, HBASE-21032-v1.patch, HBASE-21032-v1.patch, 
> HBASE-21032.patch
>
>
> I have a long row with a bunch of columns that I'm scanning with 
> setAllowPartialResults(true). In the response I'm getting the first partial 
> ScanResponse being around 2MB with multiple cells while all of the consequent 
> ones being 1 cell per ScanResponse. After digging more, I found that each of 
> those single cell ScanResponse partials are preceded by a heartbeat (zero 
> cells). This results in two requests per cell to a regionserver.
> I've attached code to reproduce it on hbase version 2.1.0 (it works as 
> expected on 2.0.0 and 2.0.1).
> [^App.java]
> I'm fairly certain it's a serverside issue as 
> [gohbase|https://github.com/tsuna/gohbase] client is having the same issue. I 
> have not tried to reproduce this with multi-row scan.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to