[
https://issues.apache.org/jira/browse/HIVE-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phabricator updated HIVE-2643:
------------------------------
Attachment: HIVE-2643.D765.1.patch
cwsteinbach requested code review of "HIVE-2643 [jira] Recent patch prevents
Hadoop confs from loading in 0.20.204".
Reviewers: JIRA
HIVE-2643
After the application of <a
href="https://issues.apache.org/jira/browse/HIVE-2362"; title="HiveConf
properties not appearing in the output of 'set' or 'set
-v'"><del>HIVE-2362</del></a>, we're unable to run queries against the Hive
cluster (RC2 and 3): <div class="preformatted panel" style="border-width:
1px;"><div class="preformattedContent panelContent"> <pre>java.io.IOException:
Failed to set permissions of path: /user/jhoman-667872320/.staging to 0700
at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653) at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
at
org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
at
org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)</pre>
</div>
</div>
this is due to all the hadoop confs not being loaded and the LocalJobRunner
(which builds staging directories in this manner) being used instead of the
regular one. It's also not possible to access the hdfs since no default fs is
specified.
Reverting 2362 fixes this, but I've not yet looked at that patch to see the
exact cause.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D765
AFFECTED FILES
common/build.xml
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
common/src/test/org/apache/hadoop/hive/conf/TestHiveConf.java
common/src/test/resources/core-site.xml
common/src/test/resources/hive-site.xml
ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/1617/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> Recent patch prevents Hadoop confs from loading in 0.20.204
> -----------------------------------------------------------
>
> Key: HIVE-2643
> URL: https://issues.apache.org/jira/browse/HIVE-2643
> Project: Hive
> Issue Type: Bug
> Components: Configuration
> Reporter: Jakob Homan
> Assignee: Carl Steinbach
> Priority: Blocker
> Attachments: HIVE-2643.1.patch.txt, HIVE-2643.D747.1.patch,
> HIVE-2643.D753.1.patch, HIVE-2643.D759.1.patch, HIVE-2643.D759.2.patch,
> HIVE-2643.D765.1.patch
>
>
> After the application of HIVE-2362, we're unable to run queries against the
> Hive cluster (RC2 and 3):
> {noformat}java.io.IOException: Failed to set permissions of path:
> /user/jhoman-667872320/.staging to 0700
> at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:680)
> at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:653)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:483)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318)
> at
> org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183)
> at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116){noformat}
> this is due to all the hadoop confs not being loaded and the LocalJobRunner
> (which builds staging directories in this manner) being used instead of the
> regular one. It's also not possible to access the hdfs since no default fs is
> specified.
> Reverting 2362 fixes this, but I've not yet looked at that patch to see the
> exact cause.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
