Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
Many thanks to all of you! Now we have many +1s including 3 from PMCs, and no -1s. Would like to call it a done vote! I will work on the remaining steps to push forward the release. Wish you all a very nice weekend, --Yongjun On Fri, Jun 8, 2018 at 2:45 PM, John Zhuge wrote: > Thanks Xongjun for the excellent work to drive this release! > > > +1 (binding) > >- Verified checksums and signatures of tarballs >- Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.5 >- Verified cloud connectors: > - ADLS integration tests passed with 1 failure, not a blocker >- Deployed both binary and built source to a pseudo cluster, passed >the following sanity tests in insecure and SSL mode: > - HDFS basic and ACL > - WebHDFS CLI ls and REST LISTSTATUS > - DistCp basic > - MapReduce wordcount > - KMS and HttpFS basic and servlets > - Balancer start/stop > > > ADLS unit test failure: > > > [ERROR] Tests run: 43, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: > 68.889 s <<< FAILURE! - in org.apache.hadoop.fs.adl.live. > TestAdlFileSystemContractLive > > [ERROR] testMkdirsWithUmask(org.apache.hadoop.fs.adl.live. > TestAdlFileSystemContractLive) Time elapsed: 0.851 s <<< FAILURE! > > java.lang.AssertionError: expected:<461> but was:<456> > > > See https://issues.apache.org/jira/browse/HADOOP-14435. I don't think it > is a blocker. > > Thanks, > > On Fri, Jun 8, 2018 at 12:04 PM, Xiao Chen wrote: > >> Thanks for the effort on this Yongjun. >> >> +1 (binding) >> >>- Built from src >>- Deployed a pseudo distributed HDFS with KMS >>- Ran basic hdfs commands with encryption >>- Sanity checked webui and logs >> >> >> >> -Xiao >> >> On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula < >> brahmareddy.batt...@hotmail.com> wrote: >> >> > Thanks yongjun zhang for driving this release. >> > >> > +1 (binding). >> > >> > >> > ---Built from the source >> > ---Installed HA cluster >> > ---Execute the basic shell commands >> > ---Browsed the UI's >> > ---Ran sample jobs like pi,wordcount >> > >> > >> > >> > >> > From: Yongjun Zhang >> > Sent: Friday, June 8, 2018 1:04 PM >> > To: Allen Wittenauer >> > Cc: Hadoop Common; Hdfs-dev; mapreduce-...@hadoop.apache.org; >> > yarn-...@hadoop.apache.org >> > Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0) >> > >> > BTW, thanks Allen and Steve for discussing and suggestion about the site >> > build problem I hit earlier, I did the following step >> > >> > mvn install -DskipTests >> > >> > before doing the steps Nanda listed helped to solve the problems. >> > >> > --Yongjun >> > >> > >> > >> > >> > On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang >> wrote: >> > >> > > Thank you all very much for the testing, feedback and discussion! >> > > >> > > I was able to build outside docker, by following the steps Nanda >> > > described, I saw the same problem; then I tried 3.0.2 released a while >> > > back, it has the same issue. >> > > >> > > As Allen pointed out, it seems the steps to build site are not >> correct. I >> > > have not figured out the correct steps yet. >> > > >> > > At this point, I think this issue should not block the 3.0.3 issue. >> While >> > > at the same time we need to figure out the right steps to build the >> site. >> > > Would you please let me know if you think differently? >> > > >> > > We only have the site build issue reported so far. And we don't have >> > > enough PMC votes yet. So need some more PMCs to help. >> > > >> > > Thanks again, and best regards, >> > > >> > > --Yongjun >> > > >> > > >> > > On Thu, Jun 7, 2018 at 4:15 PM, Allen Wittenauer < >> > a...@effectivemachines.com >> > > > wrote: >> > > >> > >> > On Jun 7, 2018, at 11:47 AM, Steve Loughran < >> ste...@hortonworks.com> >> > >> wrote: >> > >> > >> > >> > Actually, Yongjun has been really good at helping me get set up >> for a >> > >> 2.7.7 release, including "things you need to do to get GPG working in >> > the >> > >> docker image” >> > >> >> > >> *shrugs* I use a different release script after some changes >> > >> broke the in-tree version for building on OS X and I couldn’t get the >> > fixes >> > >> committed upstream. So not sure what the problems are that you are >> > hitting. >> > >> >> > >> > On Jun 7, 2018, at 1:08 PM, Nandakumar Vadivelu < >> > >> nvadiv...@hortonworks.com> wrote: >> > >> > >> > >> > It will be helpful if we can get the correct steps, and also update >> > the >> > >> wiki. >> > >> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+ >> > >> Release+Validation >> > >> >> > >> Yup. Looking forward to seeing it. >> > >> >> - >> > >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org >> > >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org >> > >> >> > >> >> > > >> > >> > > > > -- > John >
Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
Thanks Xongjun for the excellent work to drive this release! +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.5 - Verified cloud connectors: - ADLS integration tests passed with 1 failure, not a blocker - Deployed both binary and built source to a pseudo cluster, passed the following sanity tests in insecure and SSL mode: - HDFS basic and ACL - WebHDFS CLI ls and REST LISTSTATUS - DistCp basic - MapReduce wordcount - KMS and HttpFS basic and servlets - Balancer start/stop ADLS unit test failure: [ERROR] Tests run: 43, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 68.889 s <<< FAILURE! - in org.apache.hadoop.fs.adl.live.TestAdlFileSystemContractLive [ERROR] testMkdirsWithUmask(org.apache.hadoop.fs.adl.live.TestAdlFileSystemContractLive) Time elapsed: 0.851 s <<< FAILURE! java.lang.AssertionError: expected:<461> but was:<456> See https://issues.apache.org/jira/browse/HADOOP-14435. I don't think it is a blocker. Thanks, On Fri, Jun 8, 2018 at 12:04 PM, Xiao Chen wrote: > Thanks for the effort on this Yongjun. > > +1 (binding) > >- Built from src >- Deployed a pseudo distributed HDFS with KMS >- Ran basic hdfs commands with encryption >- Sanity checked webui and logs > > > -Xiao > > On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula < > brahmareddy.batt...@hotmail.com> wrote: > > > Thanks yongjun zhang for driving this release. > > > > +1 (binding). > > > > > > ---Built from the source > > ---Installed HA cluster > > ---Execute the basic shell commands > > ---Browsed the UI's > > ---Ran sample jobs like pi,wordcount > > > > > > > > > > From: Yongjun Zhang > > Sent: Friday, June 8, 2018 1:04 PM > > To: Allen Wittenauer > > Cc: Hadoop Common; Hdfs-dev; mapreduce-...@hadoop.apache.org; > > yarn-...@hadoop.apache.org > > Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0) > > > > BTW, thanks Allen and Steve for discussing and suggestion about the site > > build problem I hit earlier, I did the following step > > > > mvn install -DskipTests > > > > before doing the steps Nanda listed helped to solve the problems. > > > > --Yongjun > > > > > > > > > > On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang > wrote: > > > > > Thank you all very much for the testing, feedback and discussion! > > > > > > I was able to build outside docker, by following the steps Nanda > > > described, I saw the same problem; then I tried 3.0.2 released a while > > > back, it has the same issue. > > > > > > As Allen pointed out, it seems the steps to build site are not > correct. I > > > have not figured out the correct steps yet. > > > > > > At this point, I think this issue should not block the 3.0.3 issue. > While > > > at the same time we need to figure out the right steps to build the > site. > > > Would you please let me know if you think differently? > > > > > > We only have the site build issue reported so far. And we don't have > > > enough PMC votes yet. So need some more PMCs to help. > > > > > > Thanks again, and best regards, > > > > > > --Yongjun > > > > > > > > > On Thu, Jun 7, 2018 at 4:15 PM, Allen Wittenauer < > > a...@effectivemachines.com > > > > wrote: > > > > > >> > On Jun 7, 2018, at 11:47 AM, Steve Loughran > > > >> wrote: > > >> > > > >> > Actually, Yongjun has been really good at helping me get set up for > a > > >> 2.7.7 release, including "things you need to do to get GPG working in > > the > > >> docker image” > > >> > > >> *shrugs* I use a different release script after some changes > > >> broke the in-tree version for building on OS X and I couldn’t get the > > fixes > > >> committed upstream. So not sure what the problems are that you are > > hitting. > > >> > > >> > On Jun 7, 2018, at 1:08 PM, Nandakumar Vadivelu < > > >> nvadiv...@hortonworks.com> wrote: > > >> > > > >> > It will be helpful if we can get the correct steps, and also update > > the > > >> wiki. > > >> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+ > > >> Release+Validation > > >> > > >> Yup. Looking forward to seeing it. > > >> - > > >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > >> > > >> > > > > > > -- John
[jira] [Created] (HADOOP-15525) s3a: clarify / improve support for mixed ACL buckets
Aaron Fabbri created HADOOP-15525:
-
Summary: s3a: clarify / improve support for mixed ACL buckets
Key: HADOOP-15525
URL: https://issues.apache.org/jira/browse/HADOOP-15525
Project: Hadoop Common
Issue Type: Bug
Components: fs/s3
Affects Versions: 3.0.0
Reporter: Aaron Fabbri
Scenario: customer wants to only give a Hadoop cluster access to a subtree of
an S3 bucket.
For example, assume Hadoop uses some IAM identity "hadoop", which they wish to
grant full permission to everything under the following path:
s3a://bucket/a/b/c/hadoop-dir
they don't want hadoop user to be able to read/list/delete anything outside of
the hadoop-dir "subdir"
Problems:
To implement the "directory structure on flat key space" emulation logic we use
to present a Hadoop FS on top of a blob store, we need to create / delete /
list ancestors of {{hadoop-dir}}.
I'd like us to either (1) document a workaround (example IAM ACLs) that gets
this basic functionality, and/or (2) make improvements to make this less
painful.
We've discussed some of these issues before but I didn't see a dedicated JIRA.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-11697) Use larger value for fs.s3a.connection.timeout.
[
https://issues.apache.org/jira/browse/HADOOP-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Fabbri resolved HADOOP-11697.
---
Resolution: Duplicate
Fix Version/s: 3.0.0
> Use larger value for fs.s3a.connection.timeout.
> ---
>
> Key: HADOOP-11697
> URL: https://issues.apache.org/jira/browse/HADOOP-11697
> Project: Hadoop Common
> Issue Type: Improvement
>Affects Versions: 2.6.0
>Reporter: Lei (Eddy) Xu
>Assignee: Lei (Eddy) Xu
>Priority: Minor
> Labels: s3
> Fix For: 3.0.0
>
> Attachments: HADOOP-11697.001.patch, HDFS-7908.000.patch
>
>
> The default value of {{fs.s3a.connection.timeout}} is {{5}} milliseconds.
> It causes many {{SocketTimeoutException}} when uploading large files using
> {{hadoop fs -put}}.
> Also, the units for {{fs.s3a.connection.timeout}} and
> {{fs.s3a.connection.estaablish.timeout}} are milliseconds. For s3
> connections, I think it is not necessary to have sub-seconds timeout value.
> Thus I suggest to change the time unit to seconds, to easy sys admin's job.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/492/ [Jun 7, 2018 2:55:49 PM] (stevel) HADOOP-15512. Clean up Shell from JDK7 workarounds. Contributed by Zsolt [Jun 7, 2018 3:30:06 PM] (weichiu) HDFS-13659. Add more test coverage for contentSummary for snapshottable [Jun 7, 2018 4:01:15 PM] (rohithsharmaks) YARN-8386. App log can not be viewed from Logs tab in secure cluster. [Jun 7, 2018 6:16:17 PM] (jhc) HDFS-13534. libhdfs++: Fix GCC7 build. Contributed by James Clampffer. [Jun 7, 2018 7:47:58 PM] (Bharat) HDDS-119:Skip Apache license header check for some ozone doc scripts. [Jun 7, 2018 8:02:57 PM] (jhc) HDFS-13615. libhdfs++ SaslProtocol hanging while accessing invalid lock. [Jun 7, 2018 8:34:52 PM] (inigoiri) HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by [Jun 7, 2018 9:11:20 PM] (arp) HDDS-147. Update Ozone site docs. Contributed by Arpit Agarwal. [Jun 7, 2018 9:35:22 PM] (aengineer) HDDS-127. Add CloseContainerEventHandler in SCM. Contributed by [Jun 7, 2018 11:10:15 PM] (inigoiri) YARN-8400. Fix typos in YARN Federation documentation page. Contributed [Jun 7, 2018 11:38:23 PM] (miklos.szegedi) YARN-6677. Preempt opportunistic containers when root container cgroup [Jun 8, 2018 12:09:34 AM] (rkanter) Disable mounting cgroups by default (miklos.szeg...@cloudera.com via [Jun 8, 2018 12:13:03 AM] (inigoiri) YARN-8359. Exclude containermanager.linux test classes on Windows. [Jun 8, 2018 6:00:26 AM] (jitendra) HADOOP-15482. Upgrade jackson-databind to version 2.9.5. Contributed by -1 overall The following subsystems voted -1: compile mvninstall pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.key.kms.server.TestKMS hadoop.cli.TestAclCLI hadoop.cli.TestAclCLIWithPosixAclInheritance hadoop.cli.TestCacheAdminCLI hadoop.cli.TestCryptoAdminCLI hadoop.cli.TestDeleteCLI hadoop.cli.TestErasureCodingCLI hadoop.cli.TestHDFSCLI hadoop.cli.TestXAttrCLI hadoop.fs.contract.hdfs.TestHDFSContractAppend hadoop.fs.contract.hdfs.TestHDFSContractConcat hadoop.fs.contract.hdfs.TestHDFSContractCreate hadoop.fs.contract.hdfs.TestHDFSContractDelete hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus hadoop.fs.contract.hdfs.TestHDFSContractMkdir hadoop.fs.contract.hdfs.TestHDFSContractOpen hadoop.fs.contract.hdfs.TestHDFSContractPathHandle hadoop.fs.contract.hdfs.TestHDFSContractRename hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory hadoop.fs.contract.hdfs.TestHDFSContractSeek hadoop.fs.contract.hdfs.TestHDFSContractSetTimes hadoop.fs.loadGenerator.TestLoadGenerator hadoop.fs.permission.TestStickyBit hadoop.fs.shell.TestHdfsTextCommand hadoop.fs.TestEnhancedByteBufferAccess hadoop.fs.TestFcHdfsCreateMkdir hadoop.fs.TestFcHdfsPermission hadoop.fs.TestFcHdfsSetUMask hadoop.fs.TestGlobPaths hadoop.fs.TestHDFSFileContextMainOperations hadoop.fs.TestHdfsNativeCodeLoader hadoop.fs.TestResolveHdfsSymlink hadoop.fs.TestSWebHdfsFileContextMainOperations hadoop.fs.TestSymlinkHdfsDisable hadoop.fs.TestSymlinkHdfsFileContext hadoop.fs.TestSymlinkHdfsFileSystem hadoop.fs.TestUnbuffer hadoop.fs.TestUrlStreamHandler hadoop.fs.TestWebHdfsFileContextMainOperations hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot hadoop.fs.viewfs.TestViewFileSystemHdfs hadoop.fs.viewfs.TestViewFileSystemLinkFallback hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash hadoop.fs.viewfs.TestViewFileSystemWithAcls hadoop.fs.viewfs.TestViewFileSystemWithTruncate hadoop.fs.viewfs.TestViewFileSystemWithXAttrs hadoop.fs.viewfs.TestViewFsAtHdfsRoot hadoop.fs.viewfs.TestViewFsDefaultValue hadoop.fs.viewfs.TestViewFsFileStatusHdfs hadoop.fs.viewfs.TestViewFsHdfs hadoop.fs.viewfs.TestViewFsWithAcls hadoop.fs.viewfs.TestViewFsWithXAttrs hadoop.hdfs.client.impl.TestBlockReaderLocal hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.client.impl.TestBlockReaderRemote hadoop.hdfs.client.impl.TestClientBlockVerification hadoop.hdfs.crypto.TestHdfsCryptoStreams hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer hadoop.hdfs.qjournal.client.TestEpochsAreUnique hadoop.hdfs.qjournal.client.TestQJMWithFaults hadoop.hdfs.qjournal.client.TestQuorumJournalManager hadoop.hdfs.qjournal.server.TestJournal hadoop.hdfs.qjournal.server.TestJournalNode
[jira] [Created] (HADOOP-15524) BytesWritable causes OOME when array size reaches Integer.MAX_VALUE
Joseph Smith created HADOOP-15524:
-
Summary: BytesWritable causes OOME when array size reaches
Integer.MAX_VALUE
Key: HADOOP-15524
URL: https://issues.apache.org/jira/browse/HADOOP-15524
Project: Hadoop Common
Issue Type: Bug
Components: io
Reporter: Joseph Smith
BytesWritable.setSize uses Integer.MAX_VALUE to initialize the internal array.
On my environment, this causes an OOME
{code:java}
Exception in thread "main" java.lang.OutOfMemoryError: Requested array size
exceeds VM limit
{code}
byte[Integer.MAX_VALUE-2] must be used to prevent this error.
Tested on OSX and CentOS 7 using Java version 1.8.0_131.
I noticed that java.util.ArrayList contains the following
{code:java}
/**
* The maximum size of array to allocate.
* Some VMs reserve some header words in an array.
* Attempts to allocate larger arrays may result in
* OutOfMemoryError: Requested array size exceeds VM limit
*/
private static final int MAX_ARRAY_SIZE = Integer.MAX_VALUE - 8;
{code}
BytesWritable.setSize should use something similar to prevent an OOME from
occurring.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
Thanks for the effort on this Yongjun. +1 (binding) - Built from src - Deployed a pseudo distributed HDFS with KMS - Ran basic hdfs commands with encryption - Sanity checked webui and logs -Xiao On Fri, Jun 8, 2018 at 10:34 AM, Brahma Reddy Battula < brahmareddy.batt...@hotmail.com> wrote: > Thanks yongjun zhang for driving this release. > > +1 (binding). > > > ---Built from the source > ---Installed HA cluster > ---Execute the basic shell commands > ---Browsed the UI's > ---Ran sample jobs like pi,wordcount > > > > > From: Yongjun Zhang > Sent: Friday, June 8, 2018 1:04 PM > To: Allen Wittenauer > Cc: Hadoop Common; Hdfs-dev; mapreduce-...@hadoop.apache.org; > yarn-...@hadoop.apache.org > Subject: Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0) > > BTW, thanks Allen and Steve for discussing and suggestion about the site > build problem I hit earlier, I did the following step > > mvn install -DskipTests > > before doing the steps Nanda listed helped to solve the problems. > > --Yongjun > > > > > On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote: > > > Thank you all very much for the testing, feedback and discussion! > > > > I was able to build outside docker, by following the steps Nanda > > described, I saw the same problem; then I tried 3.0.2 released a while > > back, it has the same issue. > > > > As Allen pointed out, it seems the steps to build site are not correct. I > > have not figured out the correct steps yet. > > > > At this point, I think this issue should not block the 3.0.3 issue. While > > at the same time we need to figure out the right steps to build the site. > > Would you please let me know if you think differently? > > > > We only have the site build issue reported so far. And we don't have > > enough PMC votes yet. So need some more PMCs to help. > > > > Thanks again, and best regards, > > > > --Yongjun > > > > > > On Thu, Jun 7, 2018 at 4:15 PM, Allen Wittenauer < > a...@effectivemachines.com > > > wrote: > > > >> > On Jun 7, 2018, at 11:47 AM, Steve Loughran > >> wrote: > >> > > >> > Actually, Yongjun has been really good at helping me get set up for a > >> 2.7.7 release, including "things you need to do to get GPG working in > the > >> docker image” > >> > >> *shrugs* I use a different release script after some changes > >> broke the in-tree version for building on OS X and I couldn’t get the > fixes > >> committed upstream. So not sure what the problems are that you are > hitting. > >> > >> > On Jun 7, 2018, at 1:08 PM, Nandakumar Vadivelu < > >> nvadiv...@hortonworks.com> wrote: > >> > > >> > It will be helpful if we can get the correct steps, and also update > the > >> wiki. > >> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+ > >> Release+Validation > >> > >> Yup. Looking forward to seeing it. > >> - > >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > >> > >> > > >
Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
Hello, PMC votes are needed for release, can I get some help from PMCs? Really appreciate it! --Yongjun On Thu, Jun 7, 2018 at 6:15 PM, Yongjun Zhang wrote: > Thank you all very much for the testing, feedback and discussion! > > I was able to build outside docker, by following the steps Nanda > described, I saw the same problem; then I tried 3.0.2 released a while > back, it has the same issue. > > As Allen pointed out, it seems the steps to build site are not correct. I > have not figured out the correct steps yet. > > At this point, I think this issue should not block the 3.0.3 issue. While > at the same time we need to figure out the right steps to build the site. > Would you please let me know if you think differently? > > We only have the site build issue reported so far. And we don't have > enough PMC votes yet. So need some more PMCs to help. > > Thanks again, and best regards, > > --Yongjun > > > On Thu, Jun 7, 2018 at 4:15 PM, Allen Wittenauer > wrote: > >> > On Jun 7, 2018, at 11:47 AM, Steve Loughran >> wrote: >> > >> > Actually, Yongjun has been really good at helping me get set up for a >> 2.7.7 release, including "things you need to do to get GPG working in the >> docker image” >> >> *shrugs* I use a different release script after some changes >> broke the in-tree version for building on OS X and I couldn’t get the fixes >> committed upstream. So not sure what the problems are that you are hitting. >> >> > On Jun 7, 2018, at 1:08 PM, Nandakumar Vadivelu < >> nvadiv...@hortonworks.com> wrote: >> > >> > It will be helpful if we can get the correct steps, and also update the >> wiki. >> > https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+ >> Release+Validation >> >> Yup. Looking forward to seeing it. >> - >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org >> >> >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/ [Jun 7, 2018 4:46:02 AM] (brahma) HDFS-12950. [oiv] ls will fail in secure cluster. Contributed by [Jun 7, 2018 4:55:56 AM] (rohithsharmaks) YARN-8399. NodeManager is giving 403 GSS exception post upgrade to 3.1 [Jun 7, 2018 2:55:49 PM] (stevel) HADOOP-15512. Clean up Shell from JDK7 workarounds. Contributed by Zsolt [Jun 7, 2018 3:30:06 PM] (weichiu) HDFS-13659. Add more test coverage for contentSummary for snapshottable [Jun 7, 2018 4:01:15 PM] (rohithsharmaks) YARN-8386. App log can not be viewed from Logs tab in secure cluster. [Jun 7, 2018 6:16:17 PM] (jhc) HDFS-13534. libhdfs++: Fix GCC7 build. Contributed by James Clampffer. [Jun 7, 2018 7:47:58 PM] (Bharat) HDDS-119:Skip Apache license header check for some ozone doc scripts. [Jun 7, 2018 8:02:57 PM] (jhc) HDFS-13615. libhdfs++ SaslProtocol hanging while accessing invalid lock. [Jun 7, 2018 8:34:52 PM] (inigoiri) HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by [Jun 7, 2018 9:11:20 PM] (arp) HDDS-147. Update Ozone site docs. Contributed by Arpit Agarwal. [Jun 7, 2018 9:35:22 PM] (aengineer) HDDS-127. Add CloseContainerEventHandler in SCM. Contributed by [Jun 7, 2018 11:10:15 PM] (inigoiri) YARN-8400. Fix typos in YARN Federation documentation page. Contributed [Jun 7, 2018 11:38:23 PM] (miklos.szegedi) YARN-6677. Preempt opportunistic containers when root container cgroup [Jun 8, 2018 12:09:34 AM] (rkanter) Disable mounting cgroups by default (miklos.szeg...@cloudera.com via [Jun 8, 2018 12:13:03 AM] (inigoiri) YARN-8359. Exclude containermanager.linux test classes on Windows. -1 overall The following subsystems voted -1: asflicense findbugs pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.reloadListener; locked 75% of time Unsynchronized access at AllocationFileLoaderService.java:75% of time Unsynchronized access at AllocationFileLoaderService.java:[line 117] Failed junit tests : hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.TestDFSStripedOutputStreamWithRandomECPolicy hadoop.hdfs.server.namenode.TestDecommissioningStatus hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.mapred.TestMRTimelineEventHandling cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/diff-compile-javac-root.txt [336K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/diff-checkstyle-root.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/805/artifact/out/xml.txt [4.0K] findbugs:
