[jira] [Created] (HADOOP-14665) Support comments in auth_to_local mapping rules
Hari Sekhon created HADOOP-14665: Summary: Support comments in auth_to_local mapping rules Key: HADOOP-14665 URL: https://issues.apache.org/jira/browse/HADOOP-14665 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.7.3 Environment: HDP 2.6.0 + Kerberos Reporter: Hari Sekhon Request to add support for # hash prefixed comment lines in Hadoop's auth_to_local mappings rules so I can comment what rules I've added and why inline to the rules like with code (useful when supporting multi-directory mappings). It should be fairly simple to implement, just strip all lines from # to end, trim whitespace and the exclude all blank / whitespace lines, I do this in tools I write all the time. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14570) Distcp --dry-run switch to show what files would copy like rsync
Hari Sekhon created HADOOP-14570: Summary: Distcp --dry-run switch to show what files would copy like rsync Key: HADOOP-14570 URL: https://issues.apache.org/jira/browse/HADOOP-14570 Project: Hadoop Common Issue Type: New Feature Components: tools/distcp Affects Versions: 2.7.3 Environment: HDP 2.5.0, HDP 2.6.0 with Kerberos Reporter: Hari Sekhon Feature Request to add -n / --dry-run switches to print what files would be copied from which source to which destination paths without actually launching the maps to do the copying. This is useful for testing exclusion -filters and also to see the destination paths as the -update/-overwrite behaviour of not copying the top level source folder can trip up even those of us who know the behaviour difference so it's nice to be able to print as a first step without doing the operation. This is what linux admins have been doing forever with rsync. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14567) DistCP NullPointerException when -atomic is set but -tmp is not
Hari Sekhon created HADOOP-14567:
Summary: DistCP NullPointerException when -atomic is set but -tmp
is not
Key: HADOOP-14567
URL: https://issues.apache.org/jira/browse/HADOOP-14567
Project: Hadoop Common
Issue Type: Bug
Affects Versions: 2.7.3
Environment: HDP 2.5.0 kerberized cluster -> HDP 2.6.0 kerberized
cluster
Reporter: Hari Sekhon
Priority: Minor
When running distcp if using -atomic but not specifying -tmp then the following
NullPointerException is encountered - removing -atomic avoids this bug:
{code}
17/06/21 16:50:59 ERROR tools.DistCp: Exception encountered
java.lang.NullPointerException
at org.apache.hadoop.fs.Path.(Path.java:104)
at org.apache.hadoop.fs.Path.(Path.java:93)
at org.apache.hadoop.tools.DistCp.configureOutputFormat(DistCp.java:363)
at org.apache.hadoop.tools.DistCp.createJob(DistCp.java:247)
at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:176)
at org.apache.hadoop.tools.DistCp.execute(DistCp.java:155)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:128)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.tools.DistCp.main(DistCp.java:462)
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-11004) NFS gateway doesn't respect HDFS extended ACLs
Hari Sekhon created HADOOP-11004: Summary: NFS gateway doesn't respect HDFS extended ACLs Key: HADOOP-11004 URL: https://issues.apache.org/jira/browse/HADOOP-11004 Project: Hadoop Common Issue Type: Bug Components: nfs, security Affects Versions: 2.4.0 Environment: HDP 2.1 Reporter: Hari Sekhon I'm aware that the NFS gateway to HDFS doesn't work with secondary groups until Hadoop 2.5 (HADOOP-10701) but I've also found that when setting extended ACLs to allow the primary group of my regular user account I'm still unable to access that directory in HDFS via the NFS gateway's mount point, although I can via hadoop fs commands, indicating the NFS gateway isn't respecting with HDFS extended ACLs. Nor do the existence of extended ACLS show up via a plus sign after the rwx bits in the NFS directory listing as they do in hadoop fs listing or as regular Linux extended ACLs both do. -- This message was sent by Atlassian JIRA (v6.2#6252)
