[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728376#comment-16728376
]
Hudson commented on HBASE-21621:
Results for branch branch-2
[build #1575 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1575/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1575//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1575//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2/1575//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Fix For: 3.0.0, 2.2.0, 2.1.2, 2.0.4
>
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials:
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728344#comment-16728344
]
Hudson commented on HBASE-21621:
Results for branch master
[build #679 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/master/679/]: (x)
*{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/master/679//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/679//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/master/679//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Fix For: 3.0.0, 2.2.0, 2.1.2, 2.0.4
>
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
>
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728041#comment-16728041
]
Hudson commented on HBASE-21621:
Results for branch branch-2.1
[build #708 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/708/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/708//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/708//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/708//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Fix For: 3.0.0, 2.2.0, 2.1.2, 2.0.4
>
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728026#comment-16728026
]
Hudson commented on HBASE-21621:
Results for branch branch-2.0
[build #1191 on
builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1191/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1191//General_Nightly_Build_Report/]
(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1191//JDK8_Nightly_Build_Report_(Hadoop2)/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.0/1191//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Fix For: 3.0.0, 2.2.0, 2.1.2, 2.0.4
>
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727765#comment-16727765
]
Duo Zhang commented on HBASE-21621:
---
+1.
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true track_scan_metrics: false renew: false
> 2018-12-19 21:55:33,060 DEBUG [Time-limited test]
> client.ScannerCallableWithReplicas(200): Scan with primary region returns
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected
> nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id:
> 2421102592655360183 number_of_rows: 2147483647 close_scanner: false
> next_call_seq: 0 client_handles_partials: true client_handles_heartbeats:
> true track_scan_metrics: false renew: false
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.checkScanNextCallSeq(RSRpcServices.java:3122)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3455)
> at
>
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16727155#comment-16727155
]
Guanghao Zhang commented on HBASE-21621:
Ping [~stack] [~Apache9]. I thought this should be merged to 2.1.2 and 2.0.4
release.
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true track_scan_metrics: false renew: false
> 2018-12-19 21:55:33,060 DEBUG [Time-limited test]
> client.ScannerCallableWithReplicas(200): Scan with primary region returns
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected
> nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id:
> 2421102592655360183 number_of_rows: 2147483647 close_scanner: false
> next_call_seq: 0 client_handles_partials: true client_handles_heartbeats:
> true track_scan_metrics: false renew: false
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.checkScanNextCallSeq(RSRpcServices.java:3122)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3455)
> at
>
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726588#comment-16726588
]
Toshihiro Suzuki commented on HBASE-21621:
--
+1
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Assignee: Guanghao Zhang
>Priority: Critical
> Attachments: HBASE-21621.master.001.patch,
> HBASE-21621.master.002.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true track_scan_metrics: false renew: false
> 2018-12-19 21:55:33,060 DEBUG [Time-limited test]
> client.ScannerCallableWithReplicas(200): Scan with primary region returns
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected
> nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id:
> 2421102592655360183 number_of_rows: 2147483647 close_scanner: false
> next_call_seq: 0 client_handles_partials: true client_handles_heartbeats:
> true track_scan_metrics: false renew: false
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.checkScanNextCallSeq(RSRpcServices.java:3122)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3455)
> at
>
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725774#comment-16725774
]
Hadoop QA commented on HBASE-21621:
---
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
12s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 3 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
12s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
47s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
6s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 3m
54s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
28s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 3m
58s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
8m 20s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
10s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
30s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}117m
44s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
19s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}154m 19s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21621 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12952474/HBASE-21621.master.002.patch
|
| Optional Tests | dupname asflicense javac javadoc unit findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux ff0dc722e925 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2
17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 8991877bb2 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.0-RC3 |
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/15340/testReport/ |
| Max. process+thread count | 4854 (vs. ulimit of 1) |
| modules | C: hbase-server U: hbase-server |
| Console output |
https://builds.apache.org/job/PreCommit-HBASE-Build/15340/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Reversed scan does not
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725644#comment-16725644
]
Hadoop QA commented on HBASE-21621:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
12s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 2 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
45s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
56s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
10s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
10s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
30s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
34s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
25s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 2m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 2m
3s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
15s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 4m
8s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
9m 20s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
44s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
35s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green}150m
8s{color} | {color:green} hbase-server in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
19s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}190m 52s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21621 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12952450/HBASE-21621.master.001.patch
|
| Optional Tests | dupname asflicense javac javadoc unit findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux be323a30fe9a 4.4.0-139-generic #165~14.04.1-Ubuntu SMP Wed Oct
31 10:55:11 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 8991877bb2 |
| maven | version: Apache Maven 3.5.4
(1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z) |
| Default Java | 1.8.0_181 |
| findbugs | v3.1.0-RC3 |
| whitespace |
https://builds.apache.org/job/PreCommit-HBASE-Build/15336/artifact/patchprocess/whitespace-eol.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HBASE-Build/15336/testReport/ |
| Max. process+thread count | 4254 (vs. ulimit of 1) |
| modules | C: hbase-server U: hbase-server |
| Console
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725631#comment-16725631
]
Nihal Jain commented on HBASE-21621:
{quote}The problem may be StoreScanner#trySwitchToStreamRead method should new
a ReversedKeyValueHeap for revsered scan
{quote}
[~zghaobac] That was the exact issue actually. The UT passes now.
But, we need to remove {{ Connection conn = TEST_UTIL.getConnection();}}
outside try block, otherwise the connection will get closed and other tests may
fail in the test class.
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Priority: Critical
> Attachments: HBASE-21621.master.001.patch, HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true track_scan_metrics: false renew: false
> 2018-12-19 21:55:33,060 DEBUG [Time-limited test]
> client.ScannerCallableWithReplicas(200): Scan with primary region returns
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected
> nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id:
> 2421102592655360183 number_of_rows: 2147483647 close_scanner: false
> next_call_seq: 0 client_handles_partials: true client_handles_heartbeats:
> true track_scan_metrics: false renew: false
> at
>
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725580#comment-16725580
]
Guanghao Zhang commented on HBASE-21621:
Thanks [~nihaljain.cs] for the nice ut. The problem may be
StoreScanner#trySwitchToStreamRead method should new a ReversedKeyValueHeap for
revsered scan... Let me prepare a patch for this.
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Priority: Critical
> Attachments: HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true track_scan_metrics: false renew: false
> 2018-12-19 21:55:33,060 DEBUG [Time-limited test]
> client.ScannerCallableWithReplicas(200): Scan with primary region returns
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected
> nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id:
> 2421102592655360183 number_of_rows: 2147483647 close_scanner: false
> next_call_seq: 0 client_handles_partials: true client_handles_heartbeats:
> true track_scan_metrics: false renew: false
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.checkScanNextCallSeq(RSRpcServices.java:3122)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3455)
> at
>
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725341#comment-16725341
]
Hadoop QA commented on HBASE-21621:
---
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
16s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} hbaseanti {color} | {color:green} 0m
0s{color} | {color:green} Patch does not have any anti-patterns. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 4m
4s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
49s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
2s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 3m
42s{color} | {color:green} branch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
3s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
29s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
1s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} whitespace {color} | {color:red} 0m
0s{color} | {color:red} The patch has 1 line(s) that end in whitespace. Use git
apply --whitespace=fix <>. Refer https://git-scm.com/docs/git-apply
{color} |
| {color:green}+1{color} | {color:green} shadedjars {color} | {color:green} 3m
49s{color} | {color:green} patch has no errors when building our shaded
downstream artifacts. {color} |
| {color:green}+1{color} | {color:green} hadoopcheck {color} | {color:green}
8m 28s{color} | {color:green} Patch does not cause any errors with Hadoop 2.7.4
or 3.0.0. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
13s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
31s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}242m 40s{color}
| {color:red} hbase-server in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
24s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}278m 48s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hbase.client.TestFromClientSide3 |
| | hadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas |
| | hadoop.hbase.client.TestSnapshotDFSTemporaryDirectory |
| | hadoop.hbase.master.procedure.TestServerCrashProcedureWithReplicas |
| | hadoop.hbase.client.TestAdmin1 |
| | hadoop.hbase.client.TestFromClientSide |
| | hadoop.hbase.regionserver.TestJoinedScanners |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hbase:b002b0b |
| JIRA Issue | HBASE-21621 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12952377/HBASE-21621.master.UT.patch
|
| Optional Tests | dupname asflicense javac javadoc unit findbugs
shadedjars hadoopcheck hbaseanti checkstyle compile |
| uname | Linux 3eb8b0d2eb1d 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2
17:16:02 UTC 2018 x86_64 GNU/Linux |
| Build tool | maven |
| Personality |
/home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh
|
| git revision | master / 8991877bb2 |
| maven | version: Apache Maven 3.5.4
[jira] [Commented] (HBASE-21621) Reversed scan does not return expected number of rows
[
https://issues.apache.org/jira/browse/HBASE-21621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725166#comment-16725166
]
Nihal Jain commented on HBASE-21621:
Attached an UT patch to reproduce the same.
Note: The UT does not fail if we explicitly specify readtype ({{STREAM}} or
{{PREAD}}).
> Reversed scan does not return expected number of rows
> --
>
> Key: HBASE-21621
> URL: https://issues.apache.org/jira/browse/HBASE-21621
> Project: HBase
> Issue Type: Bug
> Components: scan
>Affects Versions: 3.0.0, 2.1.1
>Reporter: Nihal Jain
>Priority: Critical
> Attachments: HBASE-21621.master.UT.patch
>
>
> *Steps to reproduce*
> # Create a table and put some data into it (data should be big enough, say N
> rows)
> # Flush the table
> # Scan the table with reversed set to true
> *Expected Result*
> N rows should be retrieved in reversed order
> *Actual Result*
> Less than expected number of rows is retrieved with following error in logs
> {noformat}
> 2018-12-19 21:55:32,944 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> regionserver.StoreScanner(1000): Switch to stream read (scanned=262214 bytes)
> of cf
> 2018-12-19 21:55:32,955 ERROR
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.RpcServer(471): Unexpected throwable object
> java.lang.AssertionError: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> at
> org.apache.hadoop.hbase.regionserver.ReversedStoreScanner.checkScanOrder(ReversedStoreScanner.java:105)
> at
> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:568)
> at
> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:153)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6598)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6762)
> at
> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6535)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3252)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3501)
> at
> org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42002)
> at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
> at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:130)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)
> at
> org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304)
> 2018-12-19 21:55:32,955 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 508 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=java.io.IOException: Key
> \x00\x00\x00\x00\x00\x00\x00\x09/cf:a/1545236714675/Put/vlen=131072/seqid=4
> followed by a error order key
> \x00\x00\x00\x00\x00\x00\x00\x0F/cf:a/1545236715545/Put/vlen=131072/seqid=8
> in cf cf in reversed scan
> 2018-12-19 21:55:33,060 DEBUG
> [RpcServer.default.FPBQ.Fifo.handler=4,queue=0,port=39007]
> ipc.CallRunner(142): callId: 511 service: ClientService methodName: Scan
> size: 47 connection: 127.0.0.1:48328 deadline: 1545236792955,
> exception=org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> Expected nextCallSeq: 1 But the nextCallSeq got from client: 0;
> request=scanner_id: 2421102592655360183 number_of_rows: 2147483647
> close_scanner: false next_call_seq: 0 client_handles_partials: true
> client_handles_heartbeats: true track_scan_metrics: false renew: false
> 2018-12-19 21:55:33,060 DEBUG [Time-limited test]
> client.ScannerCallableWithReplicas(200): Scan with primary region returns
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected
> nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id:
> 2421102592655360183 number_of_rows: 2147483647 close_scanner: false
> next_call_seq: 0 client_handles_partials: true client_handles_heartbeats:
> true track_scan_metrics: false renew: false
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.checkScanNextCallSeq(RSRpcServices.java:3122)
> at
> org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3455)
> at
>
