[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758713#comment-13758713
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop2 #404 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/404/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519897)
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758023#comment-13758023
]
Hudson commented on HIVE-4441:
--
SUCCESS: Integrated in Hive-trunk-h0.21 #2309 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/2309/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519897)
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757953#comment-13757953
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop1-ptest #150 (See
[https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/150/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519897)
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757850#comment-13757850
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop2-ptest #83 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/83/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519897)
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757775#comment-13757775
]
Hudson commented on HIVE-4441:
--
FAILURE: Integrated in Hive-trunk-hadoop2 #403 (See
[https://builds.apache.org/job/Hive-trunk-hadoop2/403/])
HIVE-4441: WebHCat does not honor user home directory (Daniel Dai) (daijy:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1519884)
* /hive/trunk/RELEASE_NOTES.txt
*
/hive/trunk/hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757387#comment-13757387
]
Sushanth Sowmyan commented on HIVE-4441:
(Note, abovementioned git commit ids map to svn revisions r1519884 and r1519897
respectively)
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757380#comment-13757380
]
Sushanth Sowmyan commented on HIVE-4441:
As of patch 841a84772d1d17e48d176b2cdf08c1a0e81dfa8f, that test now passes.
Marking as resolved again. Please update patch attached to this jira with a .5
version that has the fixes from these two commit ids.
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
>Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch,
> HIVE-4441-4.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756894#comment-13756894
]
Eugene Koifman commented on HIVE-4441:
--
I think this needs to be in the JavaDoc and at least a debug level log
statement needs to be added to indicate where the data is actually written.
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13756866#comment-13756866
]
Daniel Dai commented on HIVE-4441:
--
[~thejas]
DistributedFileSystem.getHomeDirectory() has annoying makeQualified():
{code}
return new Path("/user/" + dfs.ugi.getShortUserName()).makeQualified(this);
{code}
I don't find a hdfs method which can give us the simple form without "qualified"
[~ekoifman]
For s3 file system, if user specify "statusdir=s3://myoutput", user mean for
absolute path. However, "s3://myoutput" is a relative path as per hdfs
(isAbsolute()==false). But we cannot convert it into "s3://user//myoutput"
since s3://user does not belong to the user. So here we skip s3/asv filesystem.
e2e tests is included in HIVE-5078 (eg:Pig_9, which we check the location of
stdout/stderr/syslog file). Sorry for the confusion.
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742653#comment-13742653
]
Eugene Koifman commented on HIVE-4441:
--
HIVE-4601 includes a fix tom TempletonUtils#hadoopFsPath() respect the passed
in "user"
[~daijy] Are you sure it's a good idea to place this file in different places
on different file systems? Seems like it will lead to confusion.
Is it possible to create a test (e2e I presume) for this?
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4441) [HCatalog] WebHCat does not honor user home directory
[
https://issues.apache.org/jira/browse/HIVE-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741827#comment-13741827
]
Thejas M Nair commented on HIVE-4441:
-
In addUserHomeDirectoryIfApplicable, I think it will be better to use
DistributedFileSystem. getHomeDirectory() instead of ""/user/" + user + ".
Otherwise, looks good.
There seems to be an inconsistency in the username used in hadoopFsPath(). So
far the user param in it has been ignored, and loginuser is used instead. But I
think we can address that in a separate followup jira.
> [HCatalog] WebHCat does not honor user home directory
> -
>
> Key: HIVE-4441
> URL: https://issues.apache.org/jira/browse/HIVE-4441
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
>Reporter: Daniel Dai
> Attachments: HIVE-4441-1.patch, HIVE-4441-2.patch, HIVE-4441-3.patch
>
>
> If I submit a job as user "A" and I specify statusdir as a relative path, I
> would expect results to be stored in the folder relative to the user A's home
> folder.
> For example, if I run:
> {code}curl -s -d user.name=hdinsightuser -d execute="show+tables;" -d
> statusdir="pokes.output" 'http://localhost:50111/templeton/v1/hive'{code}
> I get the results under:
> {code}/user/hdp/pokes.output{code}
> And I expect them to be under:
> {code}/user/hdinsightuser/pokes.output{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
