[jira] [Created] (HADOOP-11900) Add failIfNoTests=false to hadoop-build-tools pom
Gera Shegalov created HADOOP-11900: -- Summary: Add failIfNoTests=false to hadoop-build-tools pom Key: HADOOP-11900 URL: https://issues.apache.org/jira/browse/HADOOP-11900 Project: Hadoop Common Issue Type: Bug Components: test Affects Versions: 2.8.0 Reporter: Gera Shegalov -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11903) test-patch should fail any new classes called Default-foo
Allen Wittenauer created HADOOP-11903: - Summary: test-patch should fail any new classes called Default-foo Key: HADOOP-11903 URL: https://issues.apache.org/jira/browse/HADOOP-11903 Project: Hadoop Common Issue Type: Test Reporter: Allen Wittenauer In the past, we've named things like DefaultResourceCalculator, DefaultContainerExecutor, and DefaultCodec that do nothing but cause problems down the road since they are effectively version and functionality locked forever. If these examples had been named what they truly were (e.g., MemoryResourceCalculator, SimpleContainerExecutor, and GZipCodec), the defaults could then be changed in the future in a compatible way. One way to enforce this is to prevent the creation of new classes called Default-anything. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11902) Prune old javadoc versions from the website.
Owen O'Malley created HADOOP-11902: -- Summary: Prune old javadoc versions from the website. Key: HADOOP-11902 URL: https://issues.apache.org/jira/browse/HADOOP-11902 Project: Hadoop Common Issue Type: Improvement Components: site Reporter: Owen O'Malley Assignee: Owen O'Malley We have a lot of old versions of javadoc on the website. We should prune the old versions and redirect the old urls to the current versions. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11901) BytesWritable supports only up to ~700MB (instead of 2G) due to integer overflow.
Reynold Xin created HADOOP-11901: Summary: BytesWritable supports only up to ~700MB (instead of 2G) due to integer overflow. Key: HADOOP-11901 URL: https://issues.apache.org/jira/browse/HADOOP-11901 Project: Hadoop Common Issue Type: Improvement Reporter: Reynold Xin -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HADOOP-11888) bootstrapStandby command broken in JDK1.8 with kerberos
[ https://issues.apache.org/jira/browse/HADOOP-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HADOOP-11888. -- Resolution: Duplicate The hostname must be canonicalized, not just resolved. This is a dup of HADOOP-11628 bootstrapStandby command broken in JDK1.8 with kerberos --- Key: HADOOP-11888 URL: https://issues.apache.org/jira/browse/HADOOP-11888 Project: Hadoop Common Issue Type: Bug Components: security Affects Versions: 2.6.0 Environment: Suse 11 Sp3 java = 1.8.0_40 Reporter: Bibin A Chundatt Assignee: surendra singh lilhore Priority: Blocker Attachments: HADOOP-11888.patch bootstrapStandby is failing incase of JDK1.8 with kerberos ./hdfs namenode -bootstrapStandby {code} Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.doSpnegoSequence(KerberosAuthenticator.java:335) at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:206) at org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:215) at org.apache.hadoop.hdfs.web.URLConnectionFactory.openConnection(URLConnectionFactory.java:162) at org.apache.hadoop.hdfs.server.namenode.TransferFsImage.doGetUrl(TransferFsImage.java:403) ... 16 more Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Invalid SPNEGO sequence, status code: 403 at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.readToken(KerberosAuthenticator.java:370) at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.access$300(KerberosAuthenticator.java:55) at org.apache.hadoop.security.authentication.client.KerberosAuthenticator$1.run(KerberosAuthenticator.java:320) at org.apache.hadoop.security.authentication.client.KerberosAuthenticator$1.run(KerberosAuthenticator.java:288) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.doSpnegoSequence(KerberosAuthenticator.java:288) ... 20 more {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11897) test-patch.sh plugins should abbreviate the path
Allen Wittenauer created HADOOP-11897: - Summary: test-patch.sh plugins should abbreviate the path Key: HADOOP-11897 URL: https://issues.apache.org/jira/browse/HADOOP-11897 Project: Hadoop Common Issue Type: Improvement Components: test Reporter: Allen Wittenauer The current output of checkstyle, shellcheck, and whitespace results in very long file name paths. It might be useful to abbreviate them in some way, maybe removing the entire path and leaving just the filename or last directory+filename. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11896) Redesign the releases page on the Hadoop site
Owen O'Malley created HADOOP-11896: -- Summary: Redesign the releases page on the Hadoop site Key: HADOOP-11896 URL: https://issues.apache.org/jira/browse/HADOOP-11896 Project: Hadoop Common Issue Type: Improvement Components: site Reporter: Owen O'Malley Assignee: Owen O'Malley Redesign the Hadoop site to: * Move the recent releases to the top of the page by reducing the huge table of contents. * Provide a direct link (via the mirror page) to each release tarball for the last few releases. * Provide the sha256 for each of the recent release tarballs. * Provide a direct link the GPG signature for the recent release tarballs. * Provide directions on how to verify the GPG signature. * Provide a link to the signatures in https://people.apache.org/keys/group/hadoop.asc -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11899) Remove dedicated checkstyle rules in hadoop-tools/hadoop-azure
Gera Shegalov created HADOOP-11899: -- Summary: Remove dedicated checkstyle rules in hadoop-tools/hadoop-azure Key: HADOOP-11899 URL: https://issues.apache.org/jira/browse/HADOOP-11899 Project: Hadoop Common Issue Type: Task Affects Versions: 2.7.0 Reporter: Gera Shegalov Priority: Minor HADOOP-11889 got rid of duplicate checkstyle rules. However, hadoop-tools/hadoop-azure had some unique rules such as 160-column line length. The purpose of this JIRA to discuss whether the dedicated checkstyle overrides are really required. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11898) add nfs3 and portmap starting command in hadoop-daemon.sh in branch-2
Brandon Li created HADOOP-11898: --- Summary: add nfs3 and portmap starting command in hadoop-daemon.sh in branch-2 Key: HADOOP-11898 URL: https://issues.apache.org/jira/browse/HADOOP-11898 Project: Hadoop Common Issue Type: Bug Components: bin, nfs Affects Versions: 2.7.0 Reporter: Brandon Li Assignee: Brandon Li Priority: Minor nfs3 and portmap should also be in the list: {noformat} case $command in namenode|secondarynamenode|datanode|journalnode|dfs|dfsadmin|fsck|balancer|zkfc) if [ -z $HADOOP_HDFS_HOME ]; then hdfsScript=$HADOOP_PREFIX/bin/hdfs else hdfsScript=$HADOOP_HDFS_HOME/bin/hdfs fi nohup nice -n $HADOOP_NICENESS $hdfsScript --config $HADOOP_CONF_DIR $command $@ $log 21 /dev/null ;; (*) nohup nice -n $HADOOP_NICENESS $hadoopScript --config $HADOOP_CONF_DIR $command $@ $log 21 /dev/null ;; {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Jenkins build is back to normal : Hadoop-Common-trunk #1482
See https://builds.apache.org/job/Hadoop-Common-trunk/1482/changes
[jira] [Resolved] (HADOOP-8392) Add YARN audit logging to log4j.properties
[ https://issues.apache.org/jira/browse/HADOOP-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved HADOOP-8392. - Resolution: Duplicate It sounds a YARN issue. There already exists a YARN jira: YARN-2255. So close this jira as duplicate of that one. Add YARN audit logging to log4j.properties -- Key: HADOOP-8392 URL: https://issues.apache.org/jira/browse/HADOOP-8392 Project: Hadoop Common Issue Type: Improvement Affects Versions: 2.0.0-alpha Reporter: Eli Collins MAPREDUCE-2655 added MR/NM audit logging but it's not hooked up into log4j.properties or the bin and env scripts like the other audit logs so you have to modify the deployed binary to change them. Let's add the relevant plumbing that the other audit loggers have, and update log4.properties with a sample configuration that's disabled by default, eg see [this comment|https://issues.apache.org/jira/browse/MAPREDUCE-2655?focusedCommentId=13084191page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13084191]. Also, looks like mapred.AuditLogger and its plumbing can be removed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)