maybe even before moving the catalog away, we could make it optional On Fri, 28 Jan 2022 at 08:24, Akira Ajisaka <aajis...@apache.org> wrote:
> Thank you Masatake and Chao! > > On Fri, Jan 28, 2022 at 5:11 PM Chao Sun <sunc...@apache.org> wrote: > > > Thanks Masatake and Akira for discovering the issue. I used > > `dev-support/bin/create-release` which runs `mvn deploy -DskipTests > > -Pnative -Pdist ...` in a separate container and somehow it didn't hit > this > > issue. > > > > Let me cherry-pick https://issues.apache.org/jira/browse/YARN-10561 to > > branch-3.3.2 and start another RC then. > > > > Thanks, > > Chao > > > > On Fri, Jan 28, 2022 at 12:01 AM Masatake Iwasaki < > > iwasak...@oss.nttdata.co.jp> wrote: > > > >> Thanks, Akira. > >> > >> I confirmed that the issue is fixed in current branch-3.3 containing > >> YARN-10561. > >> > >> On 2022/01/28 14:25, Akira Ajisaka wrote: > >> > Hi Masatake, > >> > > >> > I faced the same error in a clean environment and > >> https://issues.apache.org/jira/browse/YARN-10561 < > >> https://issues.apache.org/jira/browse/YARN-10561> should fix this > issue. > >> I'll rebase the patch shortly. > >> > > >> > By the way, I'm afraid there is no active maintainer in > >> hadoop-yarn-applications-catalog module. The module is for a sample > >> application catalog, so I think we can move the module to a separate > >> repository. Of course, it should be discussed separately. > >> > > >> > Thanks and regards, > >> > Akira > >> > > >> > On Fri, Jan 28, 2022 at 1:39 PM Masatake Iwasaki < > >> iwasak...@oss.nttdata.co.jp <mailto:iwasak...@oss.nttdata.co.jp>> > wrote: > >> > > >> > Thanks for putting this up, Chao Sun. > >> > > >> > I got following error on building the RC3 source tarball. > >> > It is reproducible even in the container launched by > >> `./start-build-env.sh`. > >> > There seems to be no relevant diff between release-3.3.2-RC0 and > >> release-3.3.2-RC3 (and trunk) > >> > under hadoop-yarn-applications-catalog-webapp. > >> > > >> > I guess developers having caches of related artifacts under ~/.m2 > >> did not see this? > >> > > >> > ``` > >> > $ mvn clean install -DskipTests -Pnative -Pdist > >> > ... > >> > [INFO] Installing node version v8.11.3 > >> > [INFO] Downloading > >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz < > >> https://nodejs.org/dist/v8.11.3/node-v8.11.3-linux-x64.tar.gz> to > >> > /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz > >> > [INFO] No proxies configured > >> > [INFO] No proxy was configured, downloading directly > >> > [INFO] Unpacking > >> > /home/centos/.m2/repository/com/github/eirslett/node/8.11.3/node-8.11.3-linux-x64.tar.gz > >> into > >> > /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp > >> > [INFO] Copying node binary from > >> > /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/tmp/node-v8.11.3-linux-x64/bin/node > >> to > >> > /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/node > >> > [INFO] Installed node locally. > >> > [INFO] Installing Yarn version v1.7.0 > >> > [INFO] Downloading > >> > https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz > >> < > >> > https://github.com/yarnpkg/yarn/releases/download/v1.7.0/yarn-v1.7.0.tar.gz > > > >> to > >> > /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz > >> > [INFO] No proxies configured > >> > [INFO] No proxy was configured, downloading directly > >> > [INFO] Unpacking > >> > /home/centos/.m2/repository/com/github/eirslett/yarn/1.7.0/yarn-1.7.0.tar.gz > >> into > >> > /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target/node/yarn > >> > [INFO] Installed Yarn locally. > >> > [INFO] > >> > [INFO] --- frontend-maven-plugin:1.11.2:yarn (yarn install) @ > >> hadoop-yarn-applications-catalog-webapp --- > >> > [INFO] testFailureIgnore property is ignored in non test phases > >> > [INFO] Running 'yarn ' in > >> > /home/centos/srcs/hadoop-3.3.2-src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/target > >> > [INFO] yarn install v1.7.0 > >> > [INFO] info No lockfile found. > >> > [INFO] [1/4] Resolving packages... > >> > [INFO] [2/4] Fetching packages... > >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is > >> incompatible with this module. Expected version ">=10". > >> > [INFO] error safe-stable-stringify@2.3.1: The engine "node" is > >> incompatible with this module. Expected version ">=10".info Visit > >> https://yarnpkg.com/en/docs/cli/install < > >> https://yarnpkg.com/en/docs/cli/install> for documentation about this > >> command. > >> > [INFO] error Found incompatible module > >> > [INFO] > >> ------------------------------------------------------------------------ > >> > ``` > >> > > >> > Masatake Iwasaki > >> > > >> > > >> > On 2022/01/27 4:16, Chao Sun wrote: > >> > > Hi all, > >> > > > >> > > I've put together Hadoop 3.3.2 RC3 below: > >> > > > >> > > The RC is available at: > >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/ < > >> http://people.apache.org/~sunchao/hadoop-3.3.2-RC3/> > >> > > The RC tag is at: > >> > > > https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3 > >> <https://github.com/apache/hadoop/releases/tag/release-3.3.2-RC3> > >> > > The Maven artifacts are staged at: > >> > > > >> https://repository.apache.org/content/repositories/orgapachehadoop-1333 > < > >> https://repository.apache.org/content/repositories/orgapachehadoop-1333 > > > >> > > > >> > > You can find my public key at: > >> > > https://downloads.apache.org/hadoop/common/KEYS < > >> https://downloads.apache.org/hadoop/common/KEYS> > >> > > > >> > > The only delta between this and RC2 is the addition of the > >> following fix: > >> > > - HADOOP-18094. Disable S3A auditing by default. > >> > > > >> > > I've done the same tests as in RC2 and they look good: > >> > > - Ran all the unit tests > >> > > - Started a single node HDFS cluster and tested a few simple > >> commands > >> > > - Ran all the tests in Spark using the RC2 artifacts > >> > > > >> > > Please evaluate the RC and vote, thanks! > >> > > > >> > > Best, > >> > > Chao > >> > > > >> > > >> > > >> --------------------------------------------------------------------- > >> > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > >> <mailto:yarn-dev-unsubscr...@hadoop.apache.org> > >> > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >> <mailto:yarn-dev-h...@hadoop.apache.org> > >> > > >> > > >