[ 
https://issues.apache.org/jira/browse/HBASE-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505510#comment-14505510
 ] 

Elliott Clark commented on HBASE-13339:
---------------------------------------

It's not just not recommended. It's that the client that we're shipping by 
default is un-able to handle any timeouts. So about 2 times a day we have 
integration tests fail with regions stuck opening forever.

{code}
Thread 30178 (StoreFileOpenerThread-meta-1):
  State: RUNNABLE
  Blocked count: 4
  Waited count: 9
  Stack:
    sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
    sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
    sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
    sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
    sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
    
org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
    org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
    org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
    org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
    org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118)
    java.io.FilterInputStream.read(FilterInputStream.java:83)
    org.apache.hadoop.hdfs.protocolPB.PBHelper.vintPrefixed(PBHelper.java:1998)
    
org.apache.hadoop.hdfs.RemoteBlockReader2.newBlockReader(RemoteBlockReader2.java:408)
    
org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:787)
    
org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:666)
    org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:326)
    org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:570)
    
org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:793)
    org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:840)
    java.io.DataInputStream.readFully(DataInputStream.java:195)
Thread 30177 (StoreOpener-dbf37ef3cd559c78c591140285715c3f-1):
  State: WAITING
  Blocked count: 4
  Waited count: 9
  Waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@446083e5
  Stack:
    sun.misc.Unsafe.park(Native Method)
    java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
    
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
    java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
    
java.util.concurrent.ExecutorCompletionService.take(ExecutorCompletionService.java:193)
    org.apache.hadoop.hbase.regionserver.HStore.openStoreFiles(HStore.java:542)
    org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:510)
    org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:272)
    
org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:4847)
    org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:887)
    org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:884)
    java.util.concurrent.FutureTask.run(FutureTask.java:266)
    java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    java.util.concurrent.FutureTask.run(FutureTask.java:266)
    
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    java.lang.Thread.run(Thread.java:745)
{code}


The abstract fear of maybe having some incompatibility that users would have to 
deal with doesn't seem to me to justify staying behind when there are bug fixes 
and new features.

> Update default Hadoop version to 2.6.0
> --------------------------------------
>
>                 Key: HBASE-13339
>                 URL: https://issues.apache.org/jira/browse/HBASE-13339
>             Project: HBase
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 2.0.0, 1.1.0
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>         Attachments: HBASE-13339-v1.patch, HBASE-13339.patch
>
>
> Current default Hadoop version is getting a little long in the tooth. We 
> should update to the latest version. The latest version is backwards 
> compatible with 2.5.1's dfs and mr so this should be painless.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to