Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/ [Jul 11, 2018 6:56:32 AM] (sunilg) YARN-8512. ATSv2 entities are not published to HBase from second attempt [Jul 11, 2018 10:50:29 AM] (bibinchundatt) YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. [Jul 11, 2018 2:11:59 PM] (yqlin) HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu [Jul 11, 2018 2:53:08 PM] (aajisaka) HADOOP-15594. Exclude commons-lang3 from hadoop-client-minicluster. [Jul 11, 2018 5:02:08 PM] (weichiu) HDFS-13723. Occasional "Should be different group" error in [Jul 11, 2018 6:46:43 PM] (aajisaka) HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor [Jul 11, 2018 7:03:42 PM] (aengineer) Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event" [Jul 11, 2018 7:08:50 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and -1 overall The following subsystems voted -1: asflicense findbugs pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static test_libhdfs_threaded_hdfspp_test_shim_static Failed junit tests : hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.mapred.TestMRTimelineEventHandling cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-compile-javac-root.txt [360K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-checkstyle-root.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/xml.txt [4.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_client.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [52K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_client.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_common.txt [28K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_ozonefs.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/diff-javadoc-javadoc-root.txt [760K] CTEST: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [116K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/835/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [440K] https://builds.apache.org/job/hadoop-qbt-t
[jira] [Created] (HADOOP-15603) S3A to support configuring various AWS S3 client extended options
Steve Loughran created HADOOP-15603: --- Summary: S3A to support configuring various AWS S3 client extended options Key: HADOOP-15603 URL: https://issues.apache.org/jira/browse/HADOOP-15603 Project: Hadoop Common Issue Type: Sub-task Affects Versions: 3.1.0 Reporter: Steve Loughran There's a fair few options in the S3 client connection (IPv4 vs v6, use of accelerated S3...) which we don't configure from fs.s3a options. Add them, document them and where possible test them -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.7.7
Thanks for the work Steve! +1 (non-binding) checked out git tag release-2.7.7-RC0 built from source on Mac OS X 10.13.5, java version 8.0.171-oracle deployed on a 3 node cluster verified pi job (yarn), teragen, terasort and teravalidate Regards, Gabor Bota On Thu, Jul 12, 2018 at 3:19 AM Ajay Kumar wrote: > Thanks for working on this, Steve!! > > +1 non-binding > - Built from source on 1.8.0_111-b14, mac > - Verified checksum > - Built non secure local cluster > - Run yarn jobs like: pi,word count, DFSIO (read/write) > - Performed basic HDFS operations > - Basic sanity for NameNode and RM UI. > > Best, > Ajay > > On 7/11/18, 8:05 AM, "Steve Loughran" wrote: > > > > Hi > > I've got RC0 of Hadoop 2.7.7 up for people to download and play with > > http://people.apache.org/~stevel/hadoop-2.7.7/RC0/ > > Nexus artifacts 2.7.7 are up in staging > > https://repository.apache.org/content/repositories/orgapachehadoop-1135 > > Git (signed) tag release-2.7.7-RC0, checksum > c1aad84bd27cd79c3d1a7dd58202a8c3ee1ed3ac > > My current GPG key is 38237EE425050285077DB57AD22CF846DBB162A0 > you can download this direct (and it MUST be direct) from the ASF > HTTPS site > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > Please try the release and vote. The vote will run for 5 days. > > Thanks > > -Steve > > (I should add: this is my first ever attempt at a Hadoop release, > please be (a) rigorous and (b) forgiving. Credit to Wei-Chiu Chuang for his > advice). > > > - > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > >
Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/525/ [Jul 10, 2018 2:41:47 PM] (sunilg) YARN-8473. Containers being launched as app tears down can leave [Jul 10, 2018 3:52:57 PM] (mackrorysd) HADOOP-15541. [s3a] Shouldn't try to drain stream before aborting [Jul 10, 2018 5:36:17 PM] (gifuma) YARN-8502. Use path strings consistently for webservice endpoints in [Jul 10, 2018 7:17:44 PM] (aw) HDFS-13722. HDFS Native Client Fails Compilation on Ubuntu 18.04 [Jul 10, 2018 9:07:23 PM] (xyao) HDDS-208. ozone createVolume command ignores the first character of the [Jul 10, 2018 10:58:47 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and [Jul 11, 2018 6:56:32 AM] (sunilg) YARN-8512. ATSv2 entities are not published to HBase from second attempt [Jul 11, 2018 10:50:29 AM] (bibinchundatt) YARN-8491. TestServiceCLI#testEnableFastLaunch fail when umask is 077. [Jul 11, 2018 2:11:59 PM] (yqlin) HDFS-13726. RBF: Fix RBF configuration links. Contributed by Takanobu [Jul 11, 2018 2:53:08 PM] (aajisaka) HADOOP-15594. Exclude commons-lang3 from hadoop-client-minicluster. [Jul 11, 2018 5:02:08 PM] (weichiu) HDFS-13723. Occasional "Should be different group" error in [Jul 11, 2018 6:46:43 PM] (aajisaka) HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor [Jul 11, 2018 7:03:42 PM] (aengineer) Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event" [Jul 11, 2018 7:08:50 PM] (aengineer) HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event and [Jul 12, 2018 4:03:19 AM] (xiao) HDFS-12837. Intermittent failure in TestReencryptionWithKMS. -1 overall The following subsystems voted -1: compile mvninstall pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFileUtil hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.http.TestHttpServer hadoop.http.TestHttpServerLogs hadoop.io.nativeio.TestNativeIO hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.security.TestGroupsCaching hadoop.security.TestSecurityUtil hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestDiskCheckerWithDiskIo hadoop.util.TestNativeCodeLoader hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.mover.TestMover hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.server.namenode.ha.TestStandbyCheckpoints hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.snapshot.TestSnapshotFileLength hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs hadoop.hdfs.TestDFSShell hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy hadoop.hdfs.TestDFSStripedOutputStreamWithFailure hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.TestDFSUpgradeFromImage hadoop.hdfs.TestFetchImage hadoop.hdfs.TestHDFSFileSystemContract hadoop.hdfs.TestLeaseRecovery2 hadoop.hdfs.TestPread hadoop.hdfs.TestReadStripedFileWithDecodingDeletedData hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy hadoop.hdfs.TestSecureEncryptionZoneWithKMS hadoop.hdfs.TestTrashWithSecureEncryptionZones hadoop.hdfs.tools.TestDFSAdmin hadoop.hdfs.web.TestWebHDFS hadoop.hdfs.web.TestWebHdfsUrl hadoop.fs.http.server.TestHttpFSServerWebServer hadoop.yarn.logaggregation.filecontroller.ifile.TestLogAggregationIndexFileController hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch hadoop.yarn.server.nodemanager.containermanager.TestAuxServices hadoop.yarn.server.nodemanager.containermanager.TestContainerManager hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestContainer
