[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Resolution: Fixed Fix Version/s: 2.2.1 Status: Resolved (was: Patch Available) I have committed the change to branch-2.2, branch-2 and trunk. [~sanjay.radia], thank you for the review. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Fix For: 2.2.1 > > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, > HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.6.patch Renamed the interface DoNoCheck to MustNotImplement. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, > HADOOP-10029.5.patch, HADOOP-10029.6.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.5.patch Updated patch. For some reason @SuppressWarnings for deprecation is not working for TestHarFileSystem. I removed explicitly declaring the deprecated AccessControlException in the interface to work around it. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, > HADOOP-10029.5.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.4.patch The javac warnings are due to use of deprecated methods. I have @SuppressWarnings annotation to suppress the warnings. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.4.patch, > HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HADOOP-10029: -- Attachment: HADOOP-10029.4.patch Updated patch that adds suppress warning for deprecation > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.4.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Status: Patch Available (was: Open) > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Fix For: 2.2.0 > > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Affects Version/s: 2.0.0-alpha > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Fix Version/s: (was: 2.2.0) > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Affects Versions: 2.0.0-alpha >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.3.patch bq. I would make ALL the copyFromXX and moveFromXX variants throw the exception rather than rely on the fact that FileSystem's default implementation calls one of copyFromXX that HarFileSystem implements and throws exception. There are many other methods that rely on this such as create(), createNonRecursive() etc. We will be adding all these implementations. At some point in time, we should make the internal method used in FileSystem implementation of xyz() as xyzInternal() to establish this pattern. bq. resolvePath(). Not sure what is correct here I am just restoring the previous behavior here (which was changed by HADOOP-10003). I will create a separate jira to discuss and address this. Other comments taken care of. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Fix For: 2.2.0 > > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.3.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.2.patch Updated patch with some more cleanup. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Fix For: 2.2.0 > > Attachments: HADOOP-10029.1.patch, HADOOP-10029.2.patch, > HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.1.patch Updated patch that adds tests along the lines of FilterFileSystem to catch or ignore FileSystem methods that should be overridden. > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Fix For: 2.2.0 > > Attachments: HADOOP-10029.1.patch, HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HADOOP-10029) Specifying har file to MR job fails in secure cluster
[ https://issues.apache.org/jira/browse/HADOOP-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HADOOP-10029: - Attachment: HADOOP-10029.patch Some more methods that should be overridden in HarFileSystem. This issue is mainly due to not overriding FileSystem#getChildFileSystems(). > Specifying har file to MR job fails in secure cluster > - > > Key: HADOOP-10029 > URL: https://issues.apache.org/jira/browse/HADOOP-10029 > Project: Hadoop Common > Issue Type: Bug > Components: fs >Reporter: Suresh Srinivas >Assignee: Suresh Srinivas > Fix For: 2.2.0 > > Attachments: HADOOP-10029.patch > > > This is an issue found by [~rramya]. See the exception stack trace in the > following comment. -- This message was sent by Atlassian JIRA (v6.1#6144)
