Re: Exception in HBase get

2017-07-06 Thread Graceline Abigail Prem Kumar
Hi We are currently used Hbase 1.2.5. This exception occurs frequently, both on the server and on the client side. Regards, Graceline Abigail P On Thu, Jul 6, 2017 at 11:08 AM, Graceline Abigail Prem Kumar < pgabigai...@gmail.com> wrote: > Hi > > We have got an IllegalStateException during HBas

RE: NPE in ReplicationZKLockCleanerChore

2017-07-06 Thread Kang Minwoo
Okay, Thanks for your reply. Best regards, Minwoo Kang 보낸 사람: Ted Yu 보낸 날짜: 2017년 7월 7일 금요일 오전 9:24:21 받는 사람: user@hbase.apache.org 제목: Re: NPE in ReplicationZKLockCleanerChore Here is related code: List replicators = queues.getListOfReplicators();

Re: org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append sequenceId=8689

2017-07-06 Thread anil gupta
Thanks for the pointers Aaron. We checked hdfs. Its reporting 0 underreplicated or corrupted blocks. @Ted: we are using Hadoop 2.7.3(EMR5.7.2) On Thu, Jul 6, 2017 at 4:49 PM, Ted Yu wrote: > Which hadoop release are you using ? > > In FSOutputSummer.java, I see the following around line 106: >

Re: NPE in ReplicationZKLockCleanerChore

2017-07-06 Thread Ted Yu
Here is related code: List replicators = queues.getListOfReplicators(); for (String replicator: replicators) { replicators seems to be null. Can you log a JIRA (and attach redacted log if possible) ? Cheers On Thu, Jul 6, 2017 at 5:10 PM, Kang Minwoo wrote: > I am using 1.2.5 (re

RE: NPE in ReplicationZKLockCleanerChore

2017-07-06 Thread Kang Minwoo
I am using 1.2.5 (revision=d7b05f79dee10e0ada614765bb354b93d615a157) Yes, I see NPE repeatedly. This occurs every minute. Should I fix it? Best regards, Minwoo Kang 보낸 사람: Kang Minwoo 보낸 날짜: 2017년 7월 6일 목요일 오전 9:29:35 받는 사람: user@hbase.apache.org 제목: NP

Re: org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append sequenceId=8689

2017-07-06 Thread Ted Yu
Which hadoop release are you using ? In FSOutputSummer.java, I see the following around line 106: checkClosed(); if (off < 0 || len < 0 || off > b.length - len) { throw new ArrayIndexOutOfBoundsException(); You didn't get ArrayIndexOutOfBoundsException - maybe b was null ? On Thu

Re: org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append sequenceId=8689

2017-07-06 Thread M. Aaron Bossert
I can't be definitive, but I have had a very similar issue in the past. The root cause was the my NTP server had died and a couple of nodes in the cluster got wildly out of sync. Check your HDFS health And if there are under-replicated blocks...this "could" be your issue (though root cause cou

Re: org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append sequenceId=8689

2017-07-06 Thread anil gupta
Hey Ted, This is what i see in one of region server log(NPE at the bottom): 2017-07-06 19:07:07,778 INFO [ip-10-74-5-153.us-west-2.compute.internal,16020,1499320260501_ChoreService_1] regionserver.HRegionServer: ip-10-74-5-153.us-west-2.compute.internal,16020,1499320260501-MemstoreFlusherChore req

Re: scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Veerraju Tadimeti
I would like to invoke postScannerNext() based on a scan attribute. When two different scans are invoked simultaneously, one with attribute and one without attribute , how can I invoke postScannerNext() based on the scan attribute. Currently i am doing like this - checking the scan attribute

Re: org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append sequenceId=8689

2017-07-06 Thread Ted Yu
HBASE-16960 mentioned the following : Caused by: java.net.SocketTimeoutException: 2 millis timeout while waiting for channel to be ready for read Do you see similar line in region server log ? Cheers On Thu, Jul 6, 2017 at 1:48 PM, anil gupta wrote: > Hi All, > > We are running HBase/Phoe

org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append sequenceId=8689

2017-07-06 Thread anil gupta
Hi All, We are running HBase/Phoenix on EMR5.2(HBase1.2.3 and Phoenix4.7) and we running into following exception when we are trying to load data into one of our Phoenix table: 2017-07-06 19:57:57,507 INFO [hconnection-0x60e5272-shared--pool2-t249] org.apache.hadoop.hbase.client.AsyncProcess: #1,

Re: [ANNOUNCE] Devaraj Das joins the Apache HBase PMC

2017-07-06 Thread Thiruvel Thirumoolan
Congratulations Devaraj! -Thiruvel On Wednesday, July 5, 2017, 2:53:02 PM PDT, Jerry He wrote: Congrats, Devaraj ! Thanks, Jerry On Wed, Jul 5, 2017 at 1:36 PM, Nick Dimiduk wrote: > Congratulations Devaraj! > > On Wed, Jul 5, 2017 at 9:27 AM, Josh Elser wrote: > >> I'm pleased to announc

Re: scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Ted Yu
If the two different scan operations are for the same region, same instance of coprocessor is involved. Otherwise, different instances of coprocessor are involved. On Thu, Jul 6, 2017 at 11:22 AM, Veerraju Tadimeti wrote: > for two different scan operations , will same instance of coprocessor >

Re: scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Veerraju Tadimeti
for two different scan operations , will same instance of coprocessor executes? Thanks, Raju, (972)273-0155. On Thu, Jul 6, 2017 at 11:53 AM, Ted Yu wrote: > sharedData is created when coprocessor is loaded (per region). > > So as long as the coprocessor instance doesn't change, the data you pu

Re: [ANNOUNCE] Chunhui Shen joins the Apache HBase PMC

2017-07-06 Thread Enis Söztutar
Congrats! Enis On Thu, Jul 6, 2017 at 10:57 AM, Devaraj Das wrote: > Congratulations, Chunhui! > > From: Yu Li > Sent: Monday, July 03, 2017 10:24 PM > To: d...@hbase.apache.org; Hbase-User > Subject: [ANNOUNCE] Chunhui Shen joins the Apache HBase PMC >

Re: [ANNOUNCE] Chunhui Shen joins the Apache HBase PMC

2017-07-06 Thread Devaraj Das
Congratulations, Chunhui! From: Yu Li Sent: Monday, July 03, 2017 10:24 PM To: d...@hbase.apache.org; Hbase-User Subject: [ANNOUNCE] Chunhui Shen joins the Apache HBase PMC On behalf of the Apache HBase PMC I am pleased to announce that Chunhui Shen has ac

Re: scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Ted Yu
sharedData is created when coprocessor is loaded (per region). So as long as the coprocessor instance doesn't change, the data you put in should be there. On Thu, Jul 6, 2017 at 9:20 AM, Veerraju Tadimeti wrote: > Is sharedData per Operation request ? > > I mean for a scan operation, if we put

Re: scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Veerraju Tadimeti
Is sharedData per Operation request ? I mean for a scan operation, if we put variables in sharedData in coprocessor, with a value, will the same variables exists(with the same value) in sharedData in coprocessor for new scan operation ? Thanks, Raju, (972)273-0155. On Thu, Jul 6, 2017 at 10:38

Re: scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Ted Yu
sharedData is in RegionEnvironment which is created by RegionCoprocessorHost. RegionCoprocessorHost is per region. When variable is removed in postScannerClose(), it wouldn't affect sharedData in another region. FYI On Thu, Jul 6, 2017 at 7:14 AM, Veerraju Tadimeti wrote: > hi, > > I have few

scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Tadimeti, Veera
hi, I have few questions regarding scope of RegionCoprocessorEnvironment sharedData. * Is sharedData map is shared accross all instances simultaneously ? o I am putting a variable in sharedData in preScannerOpen() based on scan attribute, o check that variable exists in postScannerNext() then

scope of RegionCoprocessorEnvironment sharedData

2017-07-06 Thread Veerraju Tadimeti
hi, I have few questions regarding scope of *RegionCoprocessorEnvironment* sharedData. - *Is sharedData map is shared accross all instances simultaneously ?* - I am putting a variable in sharedData in preScannerOpen() based on scan attribute, - check that variable exists

Re: Exception in HBase get

2017-07-06 Thread Ted Yu
Which hbase release are you using ? Looking at ScanDeleteTracker.java from branch-1.2, the line number seems to match the trace: int ret = Bytes.compareTo(deleteBuffer, deleteOffset, deleteLength, cell.getQualifierArray(), qualifierOffset, qualifierLength); ... } else {