[
https://issues.apache.org/jira/browse/HBASE-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13192348#comment-13192348
]
Benoit Sigoure commented on HBASE-5249:
---------------------------------------
I just ran into this again, still on JD's 0.92 test cluster.
>From the logs of OpenTSDB:
{code}
2012-01-24 18:32:17,605 ERROR [New I/O server worker #1-1] UniqueId: Put
failed, attempts left=5 (retrying in 800 ms), put=PutRequest(table="tsdb-uid",
key="\x00", family="id", qualifier="metrics
", value=[0, 0, 0, 0, 0, 0, 0, 1], lockid=-1, durable=true, bufferable=false,
attempt=0, region=RegionInfo(table="tsdb-uid",
region_name="tsdb-uid,,1327429528678.c421780d32aae9959a1b821a441fca86.",
stop_key=""))
org.hbase.async.RemoteException: java.io.IOException:
java.lang.NullPointerException
at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1076)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.convertThrowableToIOE(HRegionServer.java:1065)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1348)
Caused by: java.lang.NullPointerException
at
java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:922)
at
org.apache.hadoop.hbase.regionserver.HRegion.releaseRowLock(HRegion.java:2639)
at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1658)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1813)
... 6 more
{code}
>From the logs of the RegionServer:
{code}
2012-01-24 18:31:47,545 DEBUG
org.apache.hadoop.hbase.regionserver.HRegionServer: Row lock
-8669450923246717741 explicitly acquired by client
2012-01-24 18:32:17,554 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer:
java.lang.NullPointerException
at
java.util.concurrent.ConcurrentHashMap.remove(ConcurrentHashMap.java:922)
at
org.apache.hadoop.hbase.regionserver.HRegion.releaseRowLock(HRegion.java:2639)
at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:1658)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.put(HRegionServer.java:1813)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1348)
2012-01-24 18:32:47,549 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Row Lock
-8669450923246717741 lease expired
2012-01-24 18:32:47,576 WARN org.apache.hadoop.ipc.HBaseServer:
(operationTooSlow):
{"processingtimems":29166,"client":"10.4.13.49:47018","starttimems":1327429938406,"queuetimems":0,"class":"HRegionServer","responsesize":0,"method":"put","totalColumns":1,"table":"tsdb-uid","families":{"id":[{"timestamp":-8669450923246717741,"qualifier":"metrics","vlen":8}]},"row":"\\x00"}
{code}
> NPE getting a rowlock, 'Error obtaining row lock (fsOk: true)'
> --------------------------------------------------------------
>
> Key: HBASE-5249
> URL: https://issues.apache.org/jira/browse/HBASE-5249
> Project: HBase
> Issue Type: Bug
> Reporter: stack
> Assignee: stack
> Priority: Critical
> Fix For: 0.92.1
>
>
> See
> http://search-hadoop.com/m/ZTJxL1S7Hq61/Error+obtaining+row+lock+%2528fsOk%253A+true%2529&subj=Re+NPE+while+obtaining+row+lock
> Benoit just ran into this too testing tsdb against 0.92:
> {code}
> 2012-01-20 17:09:54,074 ERROR
> org.apache.hadoop.hbase.regionserver.HRegionServer: Error obtaining
> row lock (fsOk: true)
> java.lang.NullPointerException
> at
> java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:881)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.addRowLock(HRegionServer.java:2313)
> at
> org.apache.hadoop.hbase.regionserver.HRegionServer.lockRow(HRegionServer.java:2299)
> at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1327)
> It happened only once out of thousands of RPCs that grabbed and
> released a row lock.
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
