[ 
https://issues.apache.org/jira/browse/HCATALOG-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13752905#comment-13752905
 ] 

Sushanth Sowmyan commented on HCATALOG-631:
-------------------------------------------

Committed to hive svn trunk. Thanks, Daniel!
                
> HBase e2e tests on single nodes on Hadoop 2.0.3 with 
> "dfs.client.read.shortcircuit" turning on for HBase 
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HCATALOG-631
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-631
>             Project: HCatalog
>          Issue Type: Bug
>          Components: hbase
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.6
>
>         Attachments: HCATALOG-631-1.patch
>
>
> All HBase e2e fail: Pig_HBase_1, Pig_HBase_2.
> Here is diagnosis:
> * "dfs.client.read.shortcircuit" in hbase-site.xml is set to true, and 
> "dfs.block.local-path-access.user" in hdfs-site.xml is set to "hbase"
> * HCat is running as "hcat"
> * HCat reads the hbase config and try to access hdfs block using local path
> * "hcat" is not in "dfs.block.local-path-access.user", so local access fail
> HDFS-4595 fix the issue in hdfs side. When local access fail, fall back to 
> conventional read. However, performance wise, it is not desired because every 
> time hdfs will try and fail while we know this will fail.
> Another possible fix is on hbase side, which separate client/server config, 
> since "dfs.client.read.shortcircuit" is only needed on server side.
> Before hbase do anything, I provide a walk around to force 
> "dfs.client.read.shortcircuit" to false on hcat side.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to