[ https://issues.apache.org/jira/browse/HCATALOG-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13752905#comment-13752905 ]
Sushanth Sowmyan commented on HCATALOG-631: ------------------------------------------- Committed to hive svn trunk. Thanks, Daniel! > HBase e2e tests on single nodes on Hadoop 2.0.3 with > "dfs.client.read.shortcircuit" turning on for HBase > --------------------------------------------------------------------------------------------------------- > > Key: HCATALOG-631 > URL: https://issues.apache.org/jira/browse/HCATALOG-631 > Project: HCatalog > Issue Type: Bug > Components: hbase > Reporter: Daniel Dai > Assignee: Daniel Dai > Fix For: 0.6 > > Attachments: HCATALOG-631-1.patch > > > All HBase e2e fail: Pig_HBase_1, Pig_HBase_2. > Here is diagnosis: > * "dfs.client.read.shortcircuit" in hbase-site.xml is set to true, and > "dfs.block.local-path-access.user" in hdfs-site.xml is set to "hbase" > * HCat is running as "hcat" > * HCat reads the hbase config and try to access hdfs block using local path > * "hcat" is not in "dfs.block.local-path-access.user", so local access fail > HDFS-4595 fix the issue in hdfs side. When local access fail, fall back to > conventional read. However, performance wise, it is not desired because every > time hdfs will try and fail while we know this will fail. > Another possible fix is on hbase side, which separate client/server config, > since "dfs.client.read.shortcircuit" is only needed on server side. > Before hbase do anything, I provide a walk around to force > "dfs.client.read.shortcircuit" to false on hcat side. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira