[jira] [Created] (HADOOP-16076) SPNEGO+SSL Client Connections with HttpClient Broken
Larry McCay created HADOOP-16076: Summary: SPNEGO+SSL Client Connections with HttpClient Broken Key: HADOOP-16076 URL: https://issues.apache.org/jira/browse/HADOOP-16076 Project: Hadoop Common Issue Type: Bug Components: build, security Affects Versions: 3.2.0 Reporter: Larry McCay Assignee: Larry McCay Client connections with HttpClient to a SPNEGO secured endpoint with TLS enabled break due to a misrepresentation of the SPN to include HTTPS instead of just HTTP. The current use of HTTPClient 4.5.2 is affected by HTTPCLIENT-1712 and breaks SPNEGO with HTTPS endpoints since it include the httpS in the principal name. We need to migrate to at least 4.5.3 as we have tested with that version and observed it fixing the issue. Need to do some due diligence to determine the cleanest version to upgrade to but will provide a patch in a day or so. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16075) Upgrade checkstyle version to 8.16
Dinesh Chitlangia created HADOOP-16075: -- Summary: Upgrade checkstyle version to 8.16 Key: HADOOP-16075 URL: https://issues.apache.org/jira/browse/HADOOP-16075 Project: Hadoop Common Issue Type: Improvement Components: build Reporter: Dinesh Chitlangia Assignee: Dinesh Chitlangia Jira aims to upgrade checkstyle version from 8.8 to 8.16. It is a minor upgrade with some bug fixes in checkstyle and its a negligible risk change. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16074) WASB: Update container not found error code
Da Zhou created HADOOP-16074: Summary: WASB: Update container not found error code Key: HADOOP-16074 URL: https://issues.apache.org/jira/browse/HADOOP-16074 Project: Hadoop Common Issue Type: Bug Components: fs/azure Affects Versions: 3.2.0 Reporter: Da Zhou Assignee: Da Zhou Due to service error code change, container is not automatically created for WRITE operation in WASB. Fix: need to update the corresponding error code. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-16073) Use JDK1.7 StandardCharset
BELUGA BEHR created HADOOP-16073: Summary: Use JDK1.7 StandardCharset Key: HADOOP-16073 URL: https://issues.apache.org/jira/browse/HADOOP-16073 Project: Hadoop Common Issue Type: Improvement Components: streaming, tools Affects Versions: 3.2.0 Reporter: BELUGA BEHR Use Java 1.7 [StandardCharsets|https://docs.oracle.com/javase/7/docs/api/java/nio/charset/StandardCharsets.html]. Every JDK must now include support for several common charsets. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/ [Jan 24, 2019 3:32:03 AM] (xyao) HDDS-980. Adding getOMCertificate in SCMSecurityProtocol. Contributed by [Jan 24, 2019 9:31:43 AM] (sunilg) YARN-8961. [UI2] Flow Run End Time shows 'Invalid date'. Contributed by [Jan 24, 2019 9:53:43 AM] (wwei) YARN-9116. Capacity Scheduler: implements queue level maximum-allocation [Jan 24, 2019 10:32:58 AM] (elek) HDDS-993. Update hadoop version to 3.2.0. Contributed by Supratim Deka. [Jan 24, 2019 11:07:05 AM] (shashikant) HDDS-996. Incorrect data length gets updated in OM by client in case it [Jan 24, 2019 4:17:40 PM] (elek) HDDS-1002. ozonesecure compose incompatible with smoke test. Contributed [Jan 24, 2019 7:24:19 PM] (elek) HDDS-948. MultipartUpload: S3 API for Abort Multipart Upload. [Jan 24, 2019 11:43:21 PM] (eyang) YARN-8867. Added resource localization status to YARN service status [Jan 25, 2019 1:27:59 AM] (aajisaka) HADOOP-16065. -Ddynamodb should be -Ddynamo in AWS SDK testing document. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.balancer.TestBalancer hadoop.yarn.client.api.impl.TestAMRMClient cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-checkstyle-root.txt [17M] hadolint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-patch-hadolint.txt [8.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-patch-pylint.txt [88K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/whitespace-eol.txt [9.3M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/whitespace-tabs.txt [1.1M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-hdds_client.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-hdds_framework.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_client.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_common.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [20K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_s3gateway.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/diff-javadoc-javadoc-root.txt [752K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1027/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [328K]
Re: [DISCUSS] branch-2.7 EoL
> On 24 Jan 2019, at 10:14, Akira Ajisaka wrote: > > Hi folks, > > I thought it's time to release 2.7.8, however, I found that the JSON > license, which is category X, is bundled in branch-2.7 and 2.8 [1][2]. > > To fix the license issue, we need to upgrade AWK SDK version and the > upgrade requires the update of Jackson version. The Jackson upgrade is > very incompatible and it caused many troubles in downstream projects > [3]. However, the release must not contain any libraries licensed to > category X, we need to make the incompatible change in branch-2.8. > > In branch-2.7, the upgrade is much more harder because we need to > change the dependency from aws-sdk to aws-sdk-s3, this is also > incompatible [4]. > > It is more than 3 years since 2.7.0 was released and the maintenance > period is the longest in the history of Apache Hadoop, so I'm > thinking we need to decide when to stop the maintenance work. Probably > there are 3 options to handle this problem: > > 1) EoL 2.7.x. > 2) Release 2.7.8 without AWS SDK from binary tarball. (problem about POMs > open) + and declare this the last; warn people that if they want the AWS SDK then they need to add it. > 3) Upgrade AWS SDK version and release 2.7.8. (incompatible change) > > What do you think? > > [1]: https://www.apache.org/legal/resolved.html#json > [2]: https://issues.apache.org/jira/browse/HADOOP-16055 > [3]: https://issues.apache.org/jira/browse/HADOOP-12705 > [4]: https://issues.apache.org/jira/browse/HADOOP-12269 > > P.S. Thanks Steve Loughran for your detailed information about AWS SDK > and Jackson updates. let's just say its trouble -but that I don't want a transitive and optional module to be dictating that jackson version applications like HBase need to be recompiled for - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
