[jira] [Commented] (HIVE-6602) Multi-user HiveServer2 throws error
[ https://issues.apache.org/jira/browse/HIVE-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931584#comment-13931584 ] Vaibhav Gumashta commented on HIVE-6602: [~rhbutani] I think HIVE-6627 and HIVE-6626 should also get in if we're keeping this for 13. Or else this should be deferred. [~thejas]: What do you say? Multi-user HiveServer2 throws error --- Key: HIVE-6602 URL: https://issues.apache.org/jira/browse/HIVE-6602 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.13.0 Reporter: Vaibhav Gumashta Assignee: Vaibhav Gumashta Fix For: 0.14.0 Attachments: HIVE-6602.1.patch Error thrown: Error while processing statement: FAILED: RuntimeException org.apache.hadoop.security.AccessControlException: Permission denied: user=user_1, access=WRITE, inode=/tmp/hive-hive:hdfs:drwxr-xr-x For hive query execution, a scratch directory specified by hive.exec.scratchdir is created with default permission 700. In HiveServer2, during the CLIService startup, we check for the presence of scratch directories (local + dfs) and if they don't exist, create them with permission 777. However, we should also change the permission from the default 700 to 777 in case the dfs scratch directory already exists. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (HIVE-6602) Multi-user HiveServer2 throws error
[
https://issues.apache.org/jira/browse/HIVE-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13930099#comment-13930099
]
Hive QA commented on HIVE-6602:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12633685/HIVE-6602.1.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 5376 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_auto_sortmerge_join_16
{noformat}
Test results:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1699/testReport
Console output:
http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1699/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12633685
Multi-user HiveServer2 throws error
---
Key: HIVE-6602
URL: https://issues.apache.org/jira/browse/HIVE-6602
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 0.13.0
Reporter: Vaibhav Gumashta
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: HIVE-6602.1.patch
Error thrown:
Error while processing statement: FAILED: RuntimeException
org.apache.hadoop.security.AccessControlException: Permission denied:
user=user_1, access=WRITE, inode=/tmp/hive-hive:hdfs:drwxr-xr-x
For hive query execution, a scratch directory specified by
hive.exec.scratchdir is created with default permission 700. In HiveServer2,
during the CLIService startup, we check for the presence of scratch
directories (local + dfs) and if they don't exist, create them with
permission 777. However, we should also change the permission from the
default 700 to 777 in case the dfs scratch directory already exists.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-6602) Multi-user HiveServer2 throws error
[
https://issues.apache.org/jira/browse/HIVE-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13925770#comment-13925770
]
Thejas M Nair commented on HIVE-6602:
-
This looks like a race condition between threads, where one thread has created
the dir but not set the permissions, and at that instance another thread finds
that dir has been created but later finds permissions are not what it expects.
Should we just synchronize this section of code ?
{code}
if (!fs.exists(scratchDir)) {
fs.mkdirs(scratchDir);
FsPermission fsPermission = new FsPermission((short)0777);
fs.setPermission(scratchDir, fsPermission);
}
{code}
Multi-user HiveServer2 throws error
---
Key: HIVE-6602
URL: https://issues.apache.org/jira/browse/HIVE-6602
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 0.13.0
Reporter: Vaibhav Gumashta
Assignee: Vaibhav Gumashta
Fix For: 0.13.0
Attachments: HIVE-6602.1.patch
Error thrown:
Error while processing statement: FAILED: RuntimeException
org.apache.hadoop.security.AccessControlException: Permission denied:
user=user_1, access=WRITE, inode=/tmp/hive-hive:hdfs:drwxr-xr-x
For hive query execution, a scratch directory specified by
hive.exec.scratchdir is created with default permission 700. In HiveServer2,
during the CLIService startup, we check for the presence of scratch
directories (local + dfs) and if they don't exist, create them with
permission 777. However, we should also change the permission from the
default 700 to 777 in case the dfs scratch directory already exists.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HIVE-6602) Multi-user HiveServer2 throws error
[ https://issues.apache.org/jira/browse/HIVE-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13925774#comment-13925774 ] Thejas M Nair commented on HIVE-6602: - +1 Multi-user HiveServer2 throws error --- Key: HIVE-6602 URL: https://issues.apache.org/jira/browse/HIVE-6602 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.13.0 Reporter: Vaibhav Gumashta Assignee: Vaibhav Gumashta Fix For: 0.13.0 Attachments: HIVE-6602.1.patch Error thrown: Error while processing statement: FAILED: RuntimeException org.apache.hadoop.security.AccessControlException: Permission denied: user=user_1, access=WRITE, inode=/tmp/hive-hive:hdfs:drwxr-xr-x For hive query execution, a scratch directory specified by hive.exec.scratchdir is created with default permission 700. In HiveServer2, during the CLIService startup, we check for the presence of scratch directories (local + dfs) and if they don't exist, create them with permission 777. However, we should also change the permission from the default 700 to 777 in case the dfs scratch directory already exists. -- This message was sent by Atlassian JIRA (v6.2#6252)
