[jira] [Created] (HADOOP-17693) Dockerfile for building on Centos 8

2021-05-12 Thread Gautham Banasandra (Jira)
Gautham Banasandra created HADOOP-17693: --- Summary: Dockerfile for building on Centos 8 Key: HADOOP-17693 URL: https://issues.apache.org/jira/browse/HADOOP-17693 Project: Hadoop Common I

[GitHub] [hadoop-thirdparty] jojochuang opened a new pull request #14: HADOOP-17692. Update Hadoop-thirdparty release script

2021-05-12 Thread GitBox
jojochuang opened a new pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14 (1) Hard code a python dependency version to avoid image build error. (2) Remove npm which is not used for building hadoop-thirdparty to avoid image build error. (2) Migrate to Ubuntu 18

[GitHub] [hadoop-thirdparty] jojochuang commented on pull request #14: HADOOP-17692. Update Hadoop-thirdparty release script

2021-05-12 Thread GitBox
jojochuang commented on pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14#issuecomment-839651970 This change blocks the hadoop-thirdparty 1.1.0 release. Please review @aajisaka @ayushtkn @vinayakumarb -- This is an automated message from the Apache Git Service.

[jira] [Created] (HADOOP-17694) Unable to use OAuth authentication at storage account level if the default authn type is Custom

2021-05-12 Thread Arun Ravi M V (Jira)
Arun Ravi M V created HADOOP-17694: -- Summary: Unable to use OAuth authentication at storage account level if the default authn type is Custom Key: HADOOP-17694 URL: https://issues.apache.org/jira/browse/HADOOP-17

Re: [DISCUSS] hadoop-thirdparty 1.1.0 release

2021-05-12 Thread Wei-Chiu Chuang
Sorry for the delay in the release work. I'm almost ready to start a release vote. (Took several days to figure out all the Docker gimmicks, plus company holidays) The only missing piece is this PR: https://github.com/apache/hadoop-thirdparty/pull/14 I've dry-run the release activity with this ch

[jira] [Resolved] (HADOOP-17689) Avoid Potential NPE in org.apache.hadoop.fs

2021-05-12 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-17689. --- Fix Version/s: 3.4.0 Resolution: Fixed > Avoid Potential NPE in org.apache.h

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2021-05-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/505/ [May 11, 2021 3:38:15 AM] (noreply) HDFS-16007. Deserialization of ReplicaState should avoid throwing ArrayIndexOutOfBoundsException (#2982) [May 12, 2021 1:34:01 AM] (noreply) HADOOP-17686. Avoid pot

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2021-05-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/297/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc

Re: [DISCUSS] Hadoop 3.3.1 release

2021-05-12 Thread Wei-Chiu Chuang
Hello it's me again. While working on the hadoop-thirdparty release, I would like to make progress on the Hadoop 3.3.1 release in parallel as well. Looking at the jira dashboard, I think the only real blocker is HDFS-15790 https://github.com/apache/hadoop/pull/2767 I'll try to review the remainin

[jira] [Created] (HADOOP-17696) Update Hadoop-thirdparty LICENSEs and NOTICEs

2021-05-12 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-17696: Summary: Update Hadoop-thirdparty LICENSEs and NOTICEs Key: HADOOP-17696 URL: https://issues.apache.org/jira/browse/HADOOP-17696 Project: Hadoop Common

[GitHub] [hadoop-thirdparty] aajisaka commented on pull request #14: HADOOP-17692. Update Hadoop-thirdparty release script

2021-05-12 Thread GitBox
aajisaka commented on pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14#issuecomment-840239920 Thank you @jojochuang. Maybe we need to update the description to something like "Fix the docker image". In the future, I want to clean up the Dockerfile: - Upgr

[GitHub] [hadoop-thirdparty] aajisaka commented on a change in pull request #14: HADOOP-17692. Update Hadoop-thirdparty release script

2021-05-12 Thread GitBox
aajisaka commented on a change in pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14#discussion_r631520733 ## File path: dev-support/docker/Dockerfile ## @@ -93,20 +94,8 @@ RUN apt-get -q update \ && apt-get clean \ && rm -rf /var/lib/apt/lists

[jira] [Created] (HADOOP-17697) Fix license error in GitHub Action workflow files

2021-05-12 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17697: -- Summary: Fix license error in GitHub Action workflow files Key: HADOOP-17697 URL: https://issues.apache.org/jira/browse/HADOOP-17697 Project: Hadoop Common

[GitHub] [hadoop-thirdparty] jojochuang opened a new pull request #15: HADOOP-17696. Update Hadoop-thirdparty LICENSEs and NOTICEs.

2021-05-12 Thread GitBox
jojochuang opened a new pull request #15: URL: https://github.com/apache/hadoop-thirdparty/pull/15 Update the LICENSE and NOTICE files to reflect what's bundled in hadoop-thirdparty 1.1 and above. 1. Removed licenses and notices of the thirdparty dependency that shipped along with o

[GitHub] [hadoop-thirdparty] aajisaka opened a new pull request #16: HADOOP-17697. Fix license error in GitHub Actions workflow files.

2021-05-12 Thread GitBox
aajisaka opened a new pull request #16: URL: https://github.com/apache/hadoop-thirdparty/pull/16 JIRA: HADOOP-17697 - Added the license header - Create a job to check license -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop-thirdparty] jojochuang commented on a change in pull request #14: HADOOP-17692. Update Hadoop-thirdparty release script

2021-05-12 Thread GitBox
jojochuang commented on a change in pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14#discussion_r631526674 ## File path: dev-support/docker/Dockerfile ## @@ -93,20 +94,8 @@ RUN apt-get -q update \ && apt-get clean \ && rm -rf /var/lib/apt/lis

[GitHub] [hadoop-thirdparty] jojochuang commented on pull request #13: HADOOP-17679. Upgrade Protobuf to 3.12.4

2021-05-12 Thread GitBox
jojochuang commented on pull request #13: URL: https://github.com/apache/hadoop-thirdparty/pull/13#issuecomment-840250988 So at the end of the day, we probably don't need to use protobuf in the hadoop-thirdparty repository. See: https://github.com/apache/hadoop-thirdparty/pull/14#discussio

[GitHub] [hadoop-thirdparty] jojochuang commented on pull request #13: HADOOP-17679. Upgrade Protobuf to 3.12.4

2021-05-12 Thread GitBox
jojochuang commented on pull request #13: URL: https://github.com/apache/hadoop-thirdparty/pull/13#issuecomment-840251431 Instead, we should do this for the main hadoop repository, not the hadoop-thirdparty repo. https://github.com/apache/hadoop/blob/trunk/dev-support/docker/Dockerfile#L12

[GitHub] [hadoop-thirdparty] medb commented on pull request #13: HADOOP-17679. Upgrade Protobuf to 3.12.4

2021-05-12 Thread GitBox
medb commented on pull request #13: URL: https://github.com/apache/hadoop-thirdparty/pull/13#issuecomment-840254235 @jojochuang May you clarify, do you mean that we do not need to compile protoc in [`hadoop-thirdparty` Docker file](https://github.com/apache/hadoop-thirdparty/blob/trunk/dev

[GitHub] [hadoop-thirdparty] jojochuang commented on pull request #13: HADOOP-17679. Upgrade Protobuf to 3.12.4

2021-05-12 Thread GitBox
jojochuang commented on pull request #13: URL: https://github.com/apache/hadoop-thirdparty/pull/13#issuecomment-840256223 Yeah. We have a number of redundant steps in hadoop-thirdparty Dockerfile. It was copied from the main hadoop repo but we don't need many of the packages. -- This is

[GitHub] [hadoop-thirdparty] jojochuang commented on a change in pull request #14: HADOOP-17692. [thirdparty] Fix the docker image

2021-05-12 Thread GitBox
jojochuang commented on a change in pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14#discussion_r631539990 ## File path: dev-support/docker/Dockerfile ## @@ -93,20 +94,8 @@ RUN apt-get -q update \ && apt-get clean \ && rm -rf /var/lib/apt/lis

[jira] [Resolved] (HADOOP-16829) Über-jira: S3A Hadoop 3.3.1 features

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-16829. -- Fix Version/s: 3.3.1 Resolution: Fixed All items under the umbrella are comple

[GitHub] [hadoop-thirdparty] jojochuang merged pull request #15: HADOOP-17696. Update Hadoop-thirdparty LICENSEs and NOTICEs.

2021-05-12 Thread GitBox
jojochuang merged pull request #15: URL: https://github.com/apache/hadoop-thirdparty/pull/15 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this servic

[GitHub] [hadoop-thirdparty] jojochuang commented on pull request #15: HADOOP-17696. Update Hadoop-thirdparty LICENSEs and NOTICEs.

2021-05-12 Thread GitBox
jojochuang commented on pull request #15: URL: https://github.com/apache/hadoop-thirdparty/pull/15#issuecomment-840301789 Thanks @aajisaka @tasanuma ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Resolved] (HADOOP-17696) Update Hadoop-thirdparty LICENSEs and NOTICEs

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17696. -- Fix Version/s: thirdparty-1.1.0 Resolution: Fixed > Update Hadoop-thirdparty L

[GitHub] [hadoop-thirdparty] jojochuang merged pull request #14: HADOOP-17692. [thirdparty] Fix the docker image

2021-05-12 Thread GitBox
jojochuang merged pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this servic

[GitHub] [hadoop-thirdparty] jojochuang commented on pull request #14: HADOOP-17692. [thirdparty] Fix the docker image

2021-05-12 Thread GitBox
jojochuang commented on pull request #14: URL: https://github.com/apache/hadoop-thirdparty/pull/14#issuecomment-840305102 Thanks @aajisaka ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[jira] [Resolved] (HADOOP-17692) [thirdparty] Fix the docker image

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17692. -- Resolution: Fixed > [thirdparty] Fix the docker image > -

[GitHub] [hadoop-thirdparty] jojochuang merged pull request #16: HADOOP-17697. Fix license error in GitHub Actions workflow files.

2021-05-12 Thread GitBox
jojochuang merged pull request #16: URL: https://github.com/apache/hadoop-thirdparty/pull/16 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this servic

[jira] [Resolved] (HADOOP-17697) Fix license error in GitHub Actions workflow files

2021-05-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17697. -- Fix Version/s: thirdparty-1.1.0 Resolution: Fixed > Fix license error in GitHu

[GitHub] [hadoop-thirdparty] aajisaka commented on pull request #16: HADOOP-17697. Fix license error in GitHub Actions workflow files.

2021-05-12 Thread GitBox
aajisaka commented on pull request #16: URL: https://github.com/apache/hadoop-thirdparty/pull/16#issuecomment-840328780 Thank you @jojochuang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the