Re: Scan got exception
I report a bug: https://issues.apache.org/jira/browse/HBASE-14046 2015-07-09 16:27 GMT+08:00 Louis Hust : > Yes, i will report as a bug > > 2015-07-09 0:48 GMT+08:00 Vladimir Rodionov : > >> Is this issue reproducible? If - yes, then please submit a bug. >> >> -Vlad >> >> On Wed, Jul 8, 2015 at 2:32 AM, Louis Hust wrote: >> >> > Any idea? >> > >> > 2015-07-01 9:50 GMT+08:00 Louis Hust : >> > >> > > So the cdh5.2.0 is patched with HBASE-11678 ? >> > > >> > > 2015-07-01 6:43 GMT+08:00 Stack : >> > > >> > >> I checked Vladimir and 5.2.0 is the first release with the >> > >> necessary HBASE-11678 "BucketCache ramCache fills heap after running >> a >> > few >> > >> hours". >> > >> >> > >> FYI, >> > >> Thanks, >> > >> St.Ack >> > >> >> > >> On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov < >> > >> vladrodio...@gmail.com> >> > >> wrote: >> > >> >> > >> > I believe CDH 5.2.0 does not contain all BucketCache critical >> patches, >> > >> but >> > >> > I may be wrong. >> > >> > >> > >> > -Vlad >> > >> > >> > >> > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust > > >> > >> wrote: >> > >> > >> > >> > > >> > >> > > hbase.bucketcache.size >> > >> > > 80 >> > >> > > hbase-site.xml >> > >> > > >> > >> > > >> > >> > > hbase.bucketcache.ioengine >> > >> > > file:/export/hbase/cache.data >> > >> > > hbase-site.xml >> > >> > > >> > >> > > >> > >> > > hbase.bucketcache.combinedcache.enabled >> > >> > > false >> > >> > > hbase-site.xml >> > >> > > >> > >> > > >> > >> > > 2015-06-30 12:22 GMT+08:00 Ted Yu : >> > >> > > >> > >> > > > How do you configure BucketCache ? >> > >> > > > >> > >> > > > Thanks >> > >> > > > >> > >> > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust < >> louis.h...@gmail.com >> > > >> > >> > > wrote: >> > >> > > > >> > >> > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 >> > >> > > > > >> > >> > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust > >: >> > >> > > > > >> > >> > > > > > Hi, all >> > >> > > > > > >> > >> > > > > > When I scan a table using hbase shell, got the following >> > >> message: >> > >> > > > > > >> > >> > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' >> > >> > > > > > ROW >> COLUMN+CELL >> > >> > > > > > >> > >> > > > > > ERROR: >> > >> > > > >> org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: >> > >> > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from >> client: >> > 0; >> > >> > > > > > request=scanner_id: 201542113 number_of_rows: 100 >> > close_scanner: >> > >> > > false >> > >> > > > > > next_call_seq: 0 >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) >> > >> > > > > > at >> > >> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) >> > >> > > > > > at >> > >> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) >> > >> > > > > > at >> > >> > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) >> > >> > > > > > at java.lang.Thread.run(Thread.java:744) >> > >> > > > > > >> > >> > > > > > >> > >> > > > > > *And the region server got the following error:* >> > >> > > > > > >> > >> > > > > > 2015-06-30 11:08:11,877 ERROR >> > >> > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] >> > >> ipc.RpcServer: >> > >> > > > > > Unexpected throwable object >> > >> > > > > > java.lang.IllegalArgumentException: Negative position >> > >> > > > > > at >> > >> > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> > >> > > > >> > >> > > >> > >> > >> > >> >> > >> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) >> > >> > > > > > at >> > >> > > > > > >> > >> > > > > >> >
Re: Scan got exception
Yes, i will report as a bug 2015-07-09 0:48 GMT+08:00 Vladimir Rodionov : > Is this issue reproducible? If - yes, then please submit a bug. > > -Vlad > > On Wed, Jul 8, 2015 at 2:32 AM, Louis Hust wrote: > > > Any idea? > > > > 2015-07-01 9:50 GMT+08:00 Louis Hust : > > > > > So the cdh5.2.0 is patched with HBASE-11678 ? > > > > > > 2015-07-01 6:43 GMT+08:00 Stack : > > > > > >> I checked Vladimir and 5.2.0 is the first release with the > > >> necessary HBASE-11678 "BucketCache ramCache fills heap after running a > > few > > >> hours". > > >> > > >> FYI, > > >> Thanks, > > >> St.Ack > > >> > > >> On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov < > > >> vladrodio...@gmail.com> > > >> wrote: > > >> > > >> > I believe CDH 5.2.0 does not contain all BucketCache critical > patches, > > >> but > > >> > I may be wrong. > > >> > > > >> > -Vlad > > >> > > > >> > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust > > >> wrote: > > >> > > > >> > > > > >> > > hbase.bucketcache.size > > >> > > 80 > > >> > > hbase-site.xml > > >> > > > > >> > > > > >> > > hbase.bucketcache.ioengine > > >> > > file:/export/hbase/cache.data > > >> > > hbase-site.xml > > >> > > > > >> > > > > >> > > hbase.bucketcache.combinedcache.enabled > > >> > > false > > >> > > hbase-site.xml > > >> > > > > >> > > > > >> > > 2015-06-30 12:22 GMT+08:00 Ted Yu : > > >> > > > > >> > > > How do you configure BucketCache ? > > >> > > > > > >> > > > Thanks > > >> > > > > > >> > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust < > louis.h...@gmail.com > > > > > >> > > wrote: > > >> > > > > > >> > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > >> > > > > > > >> > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > >> > > > > > > >> > > > > > Hi, all > > >> > > > > > > > >> > > > > > When I scan a table using hbase shell, got the following > > >> message: > > >> > > > > > > > >> > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > >> > > > > > ROW COLUMN+CELL > > >> > > > > > > > >> > > > > > ERROR: > > >> > > > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > >> > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: > > 0; > > >> > > > > > request=scanner_id: 201542113 number_of_rows: 100 > > close_scanner: > > >> > > false > > >> > > > > > next_call_seq: 0 > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > >> > > > > > at > > >> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > >> > > > > > at > > >> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > >> > > > > > at > > >> > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > >> > > > > > at java.lang.Thread.run(Thread.java:744) > > >> > > > > > > > >> > > > > > > > >> > > > > > *And the region server got the following error:* > > >> > > > > > > > >> > > > > > 2015-06-30 11:08:11,877 ERROR > > >> > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] > > >> ipc.RpcServer: > > >> > > > > > Unexpected throwable object > > >> > > > > > java.lang.IllegalArgumentException: Negative position > > >> > > > > > at > > >> > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.regio
Re: Scan got exception
+1 to what Vladmir says. If you can reproduce it that would be great too. On Wed, Jul 8, 2015 at 10:18 PM, Vladimir Rodionov wrote: > Is this issue reproducible? If - yes, then please submit a bug. > > -Vlad > > On Wed, Jul 8, 2015 at 2:32 AM, Louis Hust wrote: > > > Any idea? > > > > 2015-07-01 9:50 GMT+08:00 Louis Hust : > > > > > So the cdh5.2.0 is patched with HBASE-11678 ? > > > > > > 2015-07-01 6:43 GMT+08:00 Stack : > > > > > >> I checked Vladimir and 5.2.0 is the first release with the > > >> necessary HBASE-11678 "BucketCache ramCache fills heap after running a > > few > > >> hours". > > >> > > >> FYI, > > >> Thanks, > > >> St.Ack > > >> > > >> On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov < > > >> vladrodio...@gmail.com> > > >> wrote: > > >> > > >> > I believe CDH 5.2.0 does not contain all BucketCache critical > patches, > > >> but > > >> > I may be wrong. > > >> > > > >> > -Vlad > > >> > > > >> > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust > > >> wrote: > > >> > > > >> > > > > >> > > hbase.bucketcache.size > > >> > > 80 > > >> > > hbase-site.xml > > >> > > > > >> > > > > >> > > hbase.bucketcache.ioengine > > >> > > file:/export/hbase/cache.data > > >> > > hbase-site.xml > > >> > > > > >> > > > > >> > > hbase.bucketcache.combinedcache.enabled > > >> > > false > > >> > > hbase-site.xml > > >> > > > > >> > > > > >> > > 2015-06-30 12:22 GMT+08:00 Ted Yu : > > >> > > > > >> > > > How do you configure BucketCache ? > > >> > > > > > >> > > > Thanks > > >> > > > > > >> > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust < > louis.h...@gmail.com > > > > > >> > > wrote: > > >> > > > > > >> > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > >> > > > > > > >> > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > >> > > > > > > >> > > > > > Hi, all > > >> > > > > > > > >> > > > > > When I scan a table using hbase shell, got the following > > >> message: > > >> > > > > > > > >> > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > >> > > > > > ROW COLUMN+CELL > > >> > > > > > > > >> > > > > > ERROR: > > >> > > > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > >> > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: > > 0; > > >> > > > > > request=scanner_id: 201542113 number_of_rows: 100 > > close_scanner: > > >> > > false > > >> > > > > > next_call_seq: 0 > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > >> > > > > > at > > >> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > >> > > > > > at > > >> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > >> > > > > > at > > >> > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > >> > > > > > at java.lang.Thread.run(Thread.java:744) > > >> > > > > > > > >> > > > > > > > >> > > > > > *And the region server got the following error:* > > >> > > > > > > > >> > > > > > 2015-06-30 11:08:11,877 ERROR > > >> > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] > > >> ipc.RpcServer: > > >> > > > > > Unexpected throwable object > > >> > > > > > java.lang.IllegalArgumentException: Negative position > > >> > > > > > at > > >> > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > >> > > > > > at > > >> > > > > > > > >> > > > > > > >> > > > >
Re: Scan got exception
Is this issue reproducible? If - yes, then please submit a bug. -Vlad On Wed, Jul 8, 2015 at 2:32 AM, Louis Hust wrote: > Any idea? > > 2015-07-01 9:50 GMT+08:00 Louis Hust : > > > So the cdh5.2.0 is patched with HBASE-11678 ? > > > > 2015-07-01 6:43 GMT+08:00 Stack : > > > >> I checked Vladimir and 5.2.0 is the first release with the > >> necessary HBASE-11678 "BucketCache ramCache fills heap after running a > few > >> hours". > >> > >> FYI, > >> Thanks, > >> St.Ack > >> > >> On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov < > >> vladrodio...@gmail.com> > >> wrote: > >> > >> > I believe CDH 5.2.0 does not contain all BucketCache critical patches, > >> but > >> > I may be wrong. > >> > > >> > -Vlad > >> > > >> > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust > >> wrote: > >> > > >> > > > >> > > hbase.bucketcache.size > >> > > 80 > >> > > hbase-site.xml > >> > > > >> > > > >> > > hbase.bucketcache.ioengine > >> > > file:/export/hbase/cache.data > >> > > hbase-site.xml > >> > > > >> > > > >> > > hbase.bucketcache.combinedcache.enabled > >> > > false > >> > > hbase-site.xml > >> > > > >> > > > >> > > 2015-06-30 12:22 GMT+08:00 Ted Yu : > >> > > > >> > > > How do you configure BucketCache ? > >> > > > > >> > > > Thanks > >> > > > > >> > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust > > >> > > wrote: > >> > > > > >> > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > >> > > > > > >> > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > >> > > > > > >> > > > > > Hi, all > >> > > > > > > >> > > > > > When I scan a table using hbase shell, got the following > >> message: > >> > > > > > > >> > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > >> > > > > > ROW COLUMN+CELL > >> > > > > > > >> > > > > > ERROR: > >> > > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > >> > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: > 0; > >> > > > > > request=scanner_id: 201542113 number_of_rows: 100 > close_scanner: > >> > > false > >> > > > > > next_call_seq: 0 > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > >> > > > > > at > >> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > >> > > > > > at > >> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > >> > > > > > at > >> > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > >> > > > > > at java.lang.Thread.run(Thread.java:744) > >> > > > > > > >> > > > > > > >> > > > > > *And the region server got the following error:* > >> > > > > > > >> > > > > > 2015-06-30 11:08:11,877 ERROR > >> > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] > >> ipc.RpcServer: > >> > > > > > Unexpected throwable object > >> > > > > > java.lang.IllegalArgumentException: Negative position > >> > > > > > at > >> > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > >> > > > > > at > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > org.ap
Re: Scan got exception
Any idea? 2015-07-01 9:50 GMT+08:00 Louis Hust : > So the cdh5.2.0 is patched with HBASE-11678 ? > > 2015-07-01 6:43 GMT+08:00 Stack : > >> I checked Vladimir and 5.2.0 is the first release with the >> necessary HBASE-11678 "BucketCache ramCache fills heap after running a few >> hours". >> >> FYI, >> Thanks, >> St.Ack >> >> On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov < >> vladrodio...@gmail.com> >> wrote: >> >> > I believe CDH 5.2.0 does not contain all BucketCache critical patches, >> but >> > I may be wrong. >> > >> > -Vlad >> > >> > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust >> wrote: >> > >> > > >> > > hbase.bucketcache.size >> > > 80 >> > > hbase-site.xml >> > > >> > > >> > > hbase.bucketcache.ioengine >> > > file:/export/hbase/cache.data >> > > hbase-site.xml >> > > >> > > >> > > hbase.bucketcache.combinedcache.enabled >> > > false >> > > hbase-site.xml >> > > >> > > >> > > 2015-06-30 12:22 GMT+08:00 Ted Yu : >> > > >> > > > How do you configure BucketCache ? >> > > > >> > > > Thanks >> > > > >> > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust >> > > wrote: >> > > > >> > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 >> > > > > >> > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : >> > > > > >> > > > > > Hi, all >> > > > > > >> > > > > > When I scan a table using hbase shell, got the following >> message: >> > > > > > >> > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' >> > > > > > ROW COLUMN+CELL >> > > > > > >> > > > > > ERROR: >> > > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: >> > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; >> > > > > > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: >> > > false >> > > > > > next_call_seq: 0 >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) >> > > > > > at >> org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) >> > > > > > at >> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) >> > > > > > at >> > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) >> > > > > > at java.lang.Thread.run(Thread.java:744) >> > > > > > >> > > > > > >> > > > > > *And the region server got the following error:* >> > > > > > >> > > > > > 2015-06-30 11:08:11,877 ERROR >> > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] >> ipc.RpcServer: >> > > > > > Unexpected throwable object >> > > > > > java.lang.IllegalArgumentException: Negative position >> > > > > > at >> > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) >> > > > > > at >> > > > > > >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.regionserver.H
Re: Scan got exception
So the cdh5.2.0 is patched with HBASE-11678 ? 2015-07-01 6:43 GMT+08:00 Stack : > I checked Vladimir and 5.2.0 is the first release with the > necessary HBASE-11678 "BucketCache ramCache fills heap after running a few > hours". > > FYI, > Thanks, > St.Ack > > On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov > > wrote: > > > I believe CDH 5.2.0 does not contain all BucketCache critical patches, > but > > I may be wrong. > > > > -Vlad > > > > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust > wrote: > > > > > > > > hbase.bucketcache.size > > > 80 > > > hbase-site.xml > > > > > > > > > hbase.bucketcache.ioengine > > > file:/export/hbase/cache.data > > > hbase-site.xml > > > > > > > > > hbase.bucketcache.combinedcache.enabled > > > false > > > hbase-site.xml > > > > > > > > > 2015-06-30 12:22 GMT+08:00 Ted Yu : > > > > > > > How do you configure BucketCache ? > > > > > > > > Thanks > > > > > > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust > > > wrote: > > > > > > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > > > > > > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > > > > > > > > > > Hi, all > > > > > > > > > > > > When I scan a table using hbase shell, got the following message: > > > > > > > > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > > > > > ROW COLUMN+CELL > > > > > > > > > > > > ERROR: > > > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; > > > > > > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: > > > false > > > > > > next_call_seq: 0 > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > > > > at > org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > > > > at > org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > > > > > at > > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > > > > > at java.lang.Thread.run(Thread.java:744) > > > > > > > > > > > > > > > > > > *And the region server got the following error:* > > > > > > > > > > > > 2015-06-30 11:08:11,877 ERROR > > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] ipc.RpcServer: > > > > > > Unexpected throwable object > > > > > > java.lang.IllegalArgumentException: Negative position > > > > > > at > > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3858) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3849) > > > > > > at > > > > > > > > > > > > > > > > > > > > > org.apac
Re: Scan got exception
I checked Vladimir and 5.2.0 is the first release with the necessary HBASE-11678 "BucketCache ramCache fills heap after running a few hours". FYI, Thanks, St.Ack On Tue, Jun 30, 2015 at 3:03 PM, Vladimir Rodionov wrote: > I believe CDH 5.2.0 does not contain all BucketCache critical patches, but > I may be wrong. > > -Vlad > > On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust wrote: > > > > > hbase.bucketcache.size > > 80 > > hbase-site.xml > > > > > > hbase.bucketcache.ioengine > > file:/export/hbase/cache.data > > hbase-site.xml > > > > > > hbase.bucketcache.combinedcache.enabled > > false > > hbase-site.xml > > > > > > 2015-06-30 12:22 GMT+08:00 Ted Yu : > > > > > How do you configure BucketCache ? > > > > > > Thanks > > > > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust > > wrote: > > > > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > > > > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > > > > > > > > Hi, all > > > > > > > > > > When I scan a table using hbase shell, got the following message: > > > > > > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > > > > ROW COLUMN+CELL > > > > > > > > > > ERROR: > > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; > > > > > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: > > false > > > > > next_call_seq: 0 > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > > > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > > > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > > > > at > org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > > > > at java.lang.Thread.run(Thread.java:744) > > > > > > > > > > > > > > > *And the region server got the following error:* > > > > > > > > > > 2015-06-30 11:08:11,877 ERROR > > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] ipc.RpcServer: > > > > > Unexpected throwable object > > > > > java.lang.IllegalArgumentException: Negative position > > > > > at > sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3858) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3849) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3245) > > > > > at > > > > > > > > > > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > > > at > > > > org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > > > at > > > > org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > > > > > > > > > > > > >
Re: Scan got exception
I believe CDH 5.2.0 does not contain all BucketCache critical patches, but I may be wrong. -Vlad On Tue, Jun 30, 2015 at 12:25 AM, Louis Hust wrote: > > hbase.bucketcache.size > 80 > hbase-site.xml > > > hbase.bucketcache.ioengine > file:/export/hbase/cache.data > hbase-site.xml > > > hbase.bucketcache.combinedcache.enabled > false > hbase-site.xml > > > 2015-06-30 12:22 GMT+08:00 Ted Yu : > > > How do you configure BucketCache ? > > > > Thanks > > > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust > wrote: > > > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > > > > > > Hi, all > > > > > > > > When I scan a table using hbase shell, got the following message: > > > > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > > > ROW COLUMN+CELL > > > > > > > > ERROR: > > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; > > > > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: > false > > > > next_call_seq: 0 > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > > > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > > > at java.lang.Thread.run(Thread.java:744) > > > > > > > > > > > > *And the region server got the following error:* > > > > > > > > 2015-06-30 11:08:11,877 ERROR > > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] ipc.RpcServer: > > > > Unexpected throwable object > > > > java.lang.IllegalArgumentException: Negative position > > > > at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3858) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3849) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3245) > > > > at > > > > > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > > at > > > org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > > at > > > org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > > > > > > > >
Re: Scan got exception
hbase.bucketcache.size 80 hbase-site.xml hbase.bucketcache.ioengine file:/export/hbase/cache.data hbase-site.xml hbase.bucketcache.combinedcache.enabled false hbase-site.xml 2015-06-30 12:22 GMT+08:00 Ted Yu : > How do you configure BucketCache ? > > Thanks > > On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust wrote: > > > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > > > > Hi, all > > > > > > When I scan a table using hbase shell, got the following message: > > > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > > ROW COLUMN+CELL > > > > > > ERROR: > org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; > > > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: false > > > next_call_seq: 0 > > > at > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > > at > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > at > > > > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > > at java.lang.Thread.run(Thread.java:744) > > > > > > > > > *And the region server got the following error:* > > > > > > 2015-06-30 11:08:11,877 ERROR > > > [B.defaultRpcServer.handler=27,queue=0,port=60020] ipc.RpcServer: > > > Unexpected throwable object > > > java.lang.IllegalArgumentException: Negative position > > > at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > > at > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > > at > > > > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > > at > > > > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > > at > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > > at > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > > at > > > > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3858) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3849) > > > at > > > > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3245) > > > at > > > > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > > at > > org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > > at > > org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > > > > >
Re: Scan got exception
How do you configure BucketCache ? Thanks On Mon, Jun 29, 2015 at 8:35 PM, Louis Hust wrote: > BTW, the hbase is hbase0.98.6 CHD5.2.0 > > 2015-06-30 11:31 GMT+08:00 Louis Hust : > > > Hi, all > > > > When I scan a table using hbase shell, got the following message: > > > > hbase(main):001:0> scan 'atpco:ttf_record6' > > ROW COLUMN+CELL > > > > ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; > > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: false > > next_call_seq: 0 > > at > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > > at > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > at > > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > > at java.lang.Thread.run(Thread.java:744) > > > > > > *And the region server got the following error:* > > > > 2015-06-30 11:08:11,877 ERROR > > [B.defaultRpcServer.handler=27,queue=0,port=60020] ipc.RpcServer: > > Unexpected throwable object > > java.lang.IllegalArgumentException: Negative position > > at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > > at > > > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > > at > > > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > > at > > > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > > at > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > > at > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > > at > > > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > > at > > > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > > at > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > > at > > > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > > at > > > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) > > at > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) > > at > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) > > at > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3858) > > at > > > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3849) > > at > > > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3245) > > at > > > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > > at > org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > > at > org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > > >
Re: Scan got exception
BTW, the hbase is hbase0.98.6 CHD5.2.0 2015-06-30 11:31 GMT+08:00 Louis Hust : > Hi, all > > When I scan a table using hbase shell, got the following message: > > hbase(main):001:0> scan 'atpco:ttf_record6' > ROW COLUMN+CELL > > ERROR: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: > Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; > request=scanner_id: 201542113 number_of_rows: 100 close_scanner: false > next_call_seq: 0 > at > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3193) > at > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) > at > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:114) > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) > at java.lang.Thread.run(Thread.java:744) > > > *And the region server got the following error:* > > 2015-06-30 11:08:11,877 ERROR > [B.defaultRpcServer.handler=27,queue=0,port=60020] ipc.RpcServer: > Unexpected throwable object > java.lang.IllegalArgumentException: Negative position > at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:675) > at > org.apache.hadoop.hbase.io.hfile.bucket.FileIOEngine.read(FileIOEngine.java:87) > at > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getBlock(BucketCache.java:406) > at > org.apache.hadoop.hbase.io.hfile.LruBlockCache.getBlock(LruBlockCache.java:389) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2.readBlock(HFileReaderV2.java:359) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$AbstractScannerV2.readNextDataBlock(HFileReaderV2.java:635) > at > org.apache.hadoop.hbase.io.hfile.HFileReaderV2$ScannerV2.next(HFileReaderV2.java:749) > at > org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:136) > at > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:108) > at > org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:507) > at > org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:140) > at > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:3900) > at > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:3980) > at > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3858) > at > org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:3849) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3245) > at > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29587) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2031) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) >