Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/ [Oct 7, 2016 2:46:08 PM] (junping_du) YARN-5659. getPathFromYarnURL should use standard methods. Contributed [Oct 7, 2016 4:33:31 PM] (rkanter) HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally [Oct 7, 2016 4:48:40 PM] (brahma) HDFS-10969. Fix typos in hdfs-default.xml Contributed by Yiqun Lin [Oct 7, 2016 5:17:50 PM] (weichiu) HDFS-10933. Refactor TestFsck. Contributed by Takanobu Asanuma. [Oct 7, 2016 6:41:19 PM] (cnauroth) HADOOP-13692. hadoop-aws should declare explicit dependency on Jackson 2 [Oct 7, 2016 7:15:59 PM] (kihwal) HDFS-10979. Pass IIP for FSDirDeleteOp methods. Contributed by Daryn [Oct 7, 2016 8:46:27 PM] (xiao) HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, [Oct 7, 2016 9:47:06 PM] (rkanter) MAPREDUCE-6776. yarn.app.mapreduce.client.job.max-retries should have a [Oct 7, 2016 10:20:15 PM] (kihwal) HDFS-10980. Optimize check for existence of parent directory. [Oct 8, 2016 12:37:15 AM] (xiao) HDFS-10797. Disk usage summary of snapshots causes renamed blocks to get [Oct 8, 2016 5:44:54 AM] (jing9) HDFS-10968. BlockManager#isInNewRack should consider decommissioning -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.api.impl.TestNMClient hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.mapred.TestMRIntermediateDataEncryption compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-compile-root.txt [312K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-compile-root.txt [312K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-compile-root.txt [312K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [196K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/118/artifact/out/patch-un
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/
[Oct 7, 2016 11:51:40 AM] (stevel) HADOOP-12977 s3a to handle delete("/", true)
robustly. Contributed by
[Oct 7, 2016 2:46:08 PM] (junping_du) YARN-5659. getPathFromYarnURL should use
standard methods. Contributed
[Oct 7, 2016 4:33:31 PM] (rkanter) HADOOP-12611.
TestZKSignerSecretProvider#testMultipleInit occasionally
[Oct 7, 2016 4:48:40 PM] (brahma) HDFS-10969. Fix typos in hdfs-default.xml
Contributed by Yiqun Lin
[Oct 7, 2016 5:17:50 PM] (weichiu) HDFS-10933. Refactor TestFsck. Contributed
by Takanobu Asanuma.
[Oct 7, 2016 6:41:19 PM] (cnauroth) HADOOP-13692. hadoop-aws should declare
explicit dependency on Jackson 2
[Oct 7, 2016 7:15:59 PM] (kihwal) HDFS-10979. Pass IIP for FSDirDeleteOp
methods. Contributed by Daryn
[Oct 7, 2016 8:46:27 PM] (xiao) HADOOP-13627. Have an explicit
KerberosAuthException for UGI to throw,
[Oct 7, 2016 9:47:06 PM] (rkanter) MAPREDUCE-6776.
yarn.app.mapreduce.client.job.max-retries should have a
[Oct 7, 2016 10:20:15 PM] (kihwal) HDFS-10980. Optimize check for existence of
parent directory.
[Oct 8, 2016 12:37:15 AM] (xiao) HDFS-10797. Disk usage summary of snapshots
causes renamed blocks to get
[Oct 8, 2016 5:44:54 AM] (jing9) HDFS-10968. BlockManager#isInNewRack should
consider decommissioning
-1 overall
The following subsystems voted -1:
asflicense unit
The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace
The following subsystems are considered long running:
(runtime bigger than 1h 0m 0s)
unit
Specific tests:
Failed junit tests :
hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager
hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices
hadoop.yarn.server.TestMiniYarnClusterNodeUtilization
hadoop.yarn.server.TestContainerManagerSecurity
cc:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-compile-cc-root.txt
[4.0K]
javac:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-compile-javac-root.txt
[168K]
checkstyle:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-checkstyle-root.txt
[16M]
pylint:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-patch-pylint.txt
[16K]
shellcheck:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-patch-shellcheck.txt
[20K]
shelldocs:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-patch-shelldocs.txt
[16K]
whitespace:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/whitespace-eol.txt
[11M]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/whitespace-tabs.txt
[1.3M]
javadoc:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/diff-javadoc-javadoc-root.txt
[2.2M]
unit:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
[40K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
[12K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
[268K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
[124K]
asflicense:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/188/artifact/out/patch-asflicense-problems.txt
[4.0K]
Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
RE: [VOTE] HADOOP-12756 - Aliyun OSS Support branch merge
I'd like to conclude this vote. +1 bindings: Lei Xu, Kai Zheng, Gangumalla, Uma +1: Hao Cheng No 0 and -1 votes. The VOTE passed. I will merge the branch into trunk accordingly. Thanks for the time reviewing the work and casting your votes. Also thanks Steve for providing the review comments in HADOOP-12756 and Genmao Yu for addressing them, doing the complete "hadoop fs" tests. Regards, Kai -Original Message- From: Zheng, Kai [mailto:kai.zh...@intel.com] Sent: Wednesday, September 28, 2016 10:35 AM To: common-dev@hadoop.apache.org Subject: [VOTE] HADOOP-12756 - Aliyun OSS Support branch merge Hi all, I would like to propose a merge vote for HADOOP-12756 branch to trunk. This branch develops support for Aliyun OSS (another cloud storage) in Hadoop. The voting starts now and will run for 7 days till Oct 5, 2016 07:00 PM PDT. Aliyun OSS is widely used among China's cloud users, and currently it is not easy to access data in Aliyun OSS from Hadoop. The branch develops a new module hadoop-aliyun and provides support for accessing data in Aliyun OSS cloud storage, which will enable more use cases and bring better use experience for Hadoop users. Like the existing s3a support, AliyunOSSFileSystem a new implementation of FileSystem backed by Aliyun OSS is provided. During the implementation, the contributors refer to the s3a support, keeping the same coding style and project structure. . The updated architecture document is here. [https://issues.apache.org/jira/secure/attachment/12829541/Aliyun-OSS-integration-v2.pdf] . The merge patch that is a diff against trunk is posted here, which builds cleanly with manual testing results posted in HADOOP-13584. [https://issues.apache.org/jira/secure/attachment/12829738/HADOOP-13584.004.patch] . The user documentation is also provided as part of the module. HADOOP-12756 has a set of sub-tasks and they are ordered in the same sequence as they were committed to HADOOP-12756. Hopefully this will make it easier for reviewing. What I want to emphasize is: this is a fundamental implementation aiming at guaranteeing functionality and stability. The major functionality has been running in production environments for some while. There're definitely performance optimizations that we can do like the community have done for the existing s3a and azure supports. Merging this to trunk would serve as a very good beginning for the following optimizations aligning with the related efforts together. The new hadoop-aliyun modlue is made possible owing to many people. Thanks to the contributors Mingfei Shi, Genmao Yu and Ling Zhou; thanks to Cheng Hao, Steve Loughran, Chris Nauroth, Yi Liu, Lei (Eddy) Xu, Uma Maheswara Rao G and Allen Wittenauer for their kind reviewing and guidance. Also thanks Arpit Agarwal, Andrew Wang and Anu Engineer for the great process discussions to bring this up. Please kindly vote. Thanks in advance! Regards, Kai - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
+1 (non-binding) * Downloaded and verified signatures * Deployed a standalone cluster using the binaries * ran some jobs, like sleep, PI, etc * tested some basic ui operations. Regards, + Naga On Sat, Oct 8, 2016 at 12:03 AM, Junping Du wrote: > +1 binding, based on: > > - Download and build from source, check signatures > > - Deploy a single node cluster and run some simple jobs, like sleep, PI, > etc. > > Thanks Sangjin and Chris for working on 2.6.5 release! > > Thanks, > > Junping > > From: larry mccay > Sent: Saturday, October 08, 2016 3:43 AM > To: Karthik Kambatla > Cc: Yongjun Zhang; Sangjin Lee; Andrew Wang; Wangda Tan; Zhihai Xu; > Masatake Iwasaki; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org > Subject: Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1) > > +1 (non-binding) > > > * Downloaded and verified signatures > > * Built from source > > * Deployed a standalone cluster > > * Tested HDFS commands and job submit > > * Tested webhdfs through Apache Knox > > On Fri, Oct 7, 2016 at 10:35 PM, Karthik Kambatla > wrote: > > > Thanks for putting the RC together, Sangjin. > > > > +1 (binding) > > > > Built from source, deployed pseudo distributed cluster and ran some > example > > MR jobs. > > > > On Fri, Oct 7, 2016 at 6:01 PM, Yongjun Zhang > wrote: > > > > > Hi Sangjin, > > > > > > Thanks a lot for your work here. > > > > > > My +1 (binding). > > > > > > - Downloaded both binary and src tarballs > > > - Verified md5 checksum and signature for both > > > - Build from source tarball > > > - Deployed 2 pseudo clusters, one with the released tarball and the > other > > > with what I built from source, and did the following on both: > > > - Run basic HDFS operations, and distcp jobs > > > - Run pi job > > > - Examined HDFS webui, YARN webui. > > > > > > Best, > > > > > > --Yongjun > > > > > > > > > * verified basic HDFS operations and Pi job. > > > > > > * Did a sanity check for RM and NM UI. > > > > > > > > > On Fri, Oct 7, 2016 at 5:08 PM, Sangjin Lee wrote: > > > > > > > I'm casting my vote: +1 (binding) > > > > > > > > Regards, > > > > Sangjin > > > > > > > > On Fri, Oct 7, 2016 at 3:12 PM, Andrew Wang < > andrew.w...@cloudera.com> > > > > wrote: > > > > > > > > > Thanks to Chris and Sangjin for working on this release. > > > > > > > > > > +1 binding > > > > > > > > > > * Verified signatures > > > > > * Built from source tarball > > > > > * Started HDFS and did some basic ops > > > > > > > > > > Thanks, > > > > > Andrew > > > > > > > > > > On Fri, Oct 7, 2016 at 2:50 PM, Wangda Tan > > > wrote: > > > > > > > > > > > Thanks Sangjin for cutting this release! > > > > > > > > > > > > +1 (Binding) > > > > > > > > > > > > - Downloaded binary tar ball and setup a single node cluster. > > > > > > - Submit a few applications and which can successfully run. > > > > > > > > > > > > Thanks, > > > > > > Wangda > > > > > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 10:33 AM, Zhihai Xu < > zhihaixu2...@gmail.com > > > > > > > > wrote: > > > > > > > > > > > > > Thanks Sangjin for creating release 2.6.5 RC1. > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > * Downloaded and built from source > > > > > > > * Verified md5 checksums and signature > > > > > > > * Deployed a pseudo cluster > > > > > > > * verified basic HDFS operations and Pi job. > > > > > > > * Did a sanity check for RM and NM UI. > > > > > > > > > > > > > > Thanks > > > > > > > zhihai > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 8:16 AM, Sangjin Lee > > > > wrote: > > > > > > > > > > > > > > > Thanks Masatake! > > > > > > > > > > > > > > > > Today's the last day for this vote, and I'd like to ask you > to > > > try > > > > > out > > > > > > > the > > > > > > > > RC and vote on this today. So far there has been no binding > > vote. > > > > > > Thanks > > > > > > > > again. > > > > > > > > > > > > > > > > Regards, > > > > > > > > Sangjin > > > > > > > > > > > > > > > > On Fri, Oct 7, 2016 at 6:45 AM, Masatake Iwasaki < > > > > > > > > iwasak...@oss.nttdata.co.jp> wrote: > > > > > > > > > > > > > > > > > +1(non-binding) > > > > > > > > > > > > > > > > > > * verified signature and md5. > > > > > > > > > * built with -Pnative on CentOS6 and OpenJDK7. > > > > > > > > > * built documentation and skimmed the contents. > > > > > > > > > * built rpms by bigtop and ran smoke-tests of hdfs, yarn > and > > > > > > mapreduce > > > > > > > on > > > > > > > > > 3-node cluster. > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > Masatake Iwasaki > > > > > > > > > > > > > > > > > > On 10/3/16 09:12, Sangjin Lee wrote: > > > > > > > > > > > > > > > > > >> Hi folks, > > > > > > > > >> > > > > > > > > >> I have pushed a new release candidate (R1) for the Apache > > > Hadoop > > > > > > 2.6.5 > > > > > > > > >> release (the next maintenance release in the 2.6.x release > > > > line). > > > > > >
[jira] [Created] (HADOOP-13701) rebase trunk and fix unit test failure in "AbstractContractRootDirectoryTest"
Genmao Yu created HADOOP-13701: -- Summary: rebase trunk and fix unit test failure in "AbstractContractRootDirectoryTest" Key: HADOOP-13701 URL: https://issues.apache.org/jira/browse/HADOOP-13701 Project: Hadoop Common Issue Type: Sub-task Components: fs Affects Versions: HADOOP-12756 Reporter: Genmao Yu Assignee: Genmao Yu Fix For: HADOOP-12756 -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
