Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 Thanks, Mukul On 17/04/18, 8:59 AM, "Shashikant Banerjee" wrote: +1 On 4/17/18, 7:41 AM, "Arun Suresh" wrote: +1 Cheers -Arun On Mon, Apr 16, 2018 at 7:09 PM, Weiwei Yang wrote: > +1 > > -- > Weiwei > > On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , > wrote: > > dopt > HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code > merge. > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 On 4/17/18, 7:41 AM, "Arun Suresh" wrote: +1 Cheers -Arun On Mon, Apr 16, 2018 at 7:09 PM, Weiwei Yang wrote: > +1 > > -- > Weiwei > > On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , > wrote: > > dopt > HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code > merge. > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/439/ No changes -1 overall The following subsystems voted -1: compile mvninstall unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.fs.TestLocalFileSystem hadoop.fs.TestRawLocalFileSystemContract hadoop.fs.TestTrash hadoop.http.TestHttpServer hadoop.http.TestHttpServerLogs hadoop.io.nativeio.TestNativeIO hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal hadoop.security.TestSecurityUtil hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestNativeCodeLoader hadoop.util.TestNodeHealthScriptRunner hadoop.fs.TestResolveHdfsSymlink hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.crypto.TestHdfsCryptoStreams hadoop.hdfs.qjournal.client.TestQuorumJournalManager hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestBlockRecovery hadoop.hdfs.server.datanode.TestBlockScanner hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestHSync hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.mover.TestMover hadoop.hdfs.server.mover.TestStorageMover hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestHAAppend hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport hadoop.hdfs.server.namenode.TestAddBlock hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands hadoop.hdfs.server.namenode.TestCheckpoint hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate hadoop.hdfs.server.namenode.TestEditLogRace hadoop.hdfs.server.namenode.TestFileTruncate hadoop.hdfs.server.namenode.TestFsck hadoop.hdfs.server.namenode.TestFSImage hadoop.hdfs.server.namenode.TestFSImageWithSnapshot hadoop.hdfs.server.namenode.TestNamenodeCapacityReport hadoop.hdfs.server.namenode.TestNameNodeMXBean hadoop.hdfs.server.namenode.TestNestedEncryptionZones hadoop.hdfs.server.namenode.TestQuotaByStorageType hadoop.hdfs.server.namenode.TestReconstructStripedBlocks hadoop.hdfs.server.namenode.TestReencryptionHandler hadoop.hdfs.server.namenode.TestStartup hadoop.hdfs.TestDatanodeRegistration hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs hadoop.hdfs.TestDecommission hadoop.hdfs.TestDFSOutputStream hadoop.hdfs.TestDFSShell hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy
Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 Cheers -Arun On Mon, Apr 16, 2018 at 7:09 PM, Weiwei Yang wrote: > +1 > > -- > Weiwei > > On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , > wrote: > > dopt > HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code > merge. >
Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 -- Weiwei On 17 Apr 2018, 8:59 AM +0800, Jitendra Pandey , wrote: dopt HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code merge.
Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 On 4/16/18, 5:57 PM, "Jakob Homan" wrote: +1 On 16 April 2018 at 16:49, Anu Engineer wrote: > +1 > --Anu > > On 4/16/18, 4:49 PM, "Jitendra Pandey" wrote: > > Hi All, > >The community unanimously voted (https://s.apache.org/HDDSMergeResult) to adopt > HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code merge. > > Here is a quick summary of the code changes: > > - As decided in the JIRA HDFS-10419, the project has been renamed to Hadoop Distributed Data Store or HDDS. > - HDDS becomes a sub-project of Hadoop. > - Added a Maven profile that disables HDDS compilation by default. > - The releases of HDDS will be independent of Hadoop and will have no impact to current Hadoop release process. > - We have made HDDS a loadable module. > - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does not impact current users of HDFS. > > The vote will run for 7 days, I will start this vote with my +1. > > Thanks > Jitendra > > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 On 16 April 2018 at 16:49, Anu Engineer wrote: > +1 > --Anu > > On 4/16/18, 4:49 PM, "Jitendra Pandey" wrote: > > Hi All, > >The community unanimously voted (https://s.apache.org/HDDSMergeResult) > to adopt > HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code > merge. > > Here is a quick summary of the code changes: > > - As decided in the JIRA HDFS-10419, the project has been renamed to > Hadoop Distributed Data Store or HDDS. > - HDDS becomes a sub-project of Hadoop. > - Added a Maven profile that disables HDDS compilation by default. > - The releases of HDDS will be independent of Hadoop and will have no > impact to current Hadoop release process. > - We have made HDDS a loadable module. > - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does not > impact current users of HDFS. > > The vote will run for 7 days, I will start this vote with my +1. > > Thanks > Jitendra > > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[VOTE] Release Apache Hadoop 3.0.2 (RC1)
Hi, All I've created release candidate RC-1 for Apache Hadoop 3.0.2, to address missing source jars in the maven repository in RC-0. Thanks Ajay Kumar for spotting the error. Please note: this is an amendment for Apache Hadoop 3.0.1 release to fix shaded jars in apache maven repository. The codebase of 3.0.2 release is the same as 3.0.1. New bug fixes will be included in Apache Hadoop 3.0.3 instead. The release page is: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC1/ The git tag is release-3.0.2-RC1, and the latest commit is 5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee, which is the same as RC-0. The maven artifacts are available at: https://repository.apache.org/content/repositories/orgapachehadoop-1102/ Please try the release, especially, *verify the maven artifacts*, and vote. The vote will run 5 days, ending 4/21/2018. Here is my +1. Best, - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk
+1 --Anu On 4/16/18, 4:49 PM, "Jitendra Pandey" wrote: Hi All, The community unanimously voted (https://s.apache.org/HDDSMergeResult) to adopt HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code merge. Here is a quick summary of the code changes: - As decided in the JIRA HDFS-10419, the project has been renamed to Hadoop Distributed Data Store or HDDS. - HDDS becomes a sub-project of Hadoop. - Added a Maven profile that disables HDDS compilation by default. - The releases of HDDS will be independent of Hadoop and will have no impact to current Hadoop release process. - We have made HDDS a loadable module. - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does not impact current users of HDFS. The vote will run for 7 days, I will start this vote with my +1. Thanks Jitendra - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[VOTE] Merge HDDS (HDFS-7240) *code* into trunk
Hi All, The community unanimously voted (https://s.apache.org/HDDSMergeResult) to adopt HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code merge. Here is a quick summary of the code changes: - As decided in the JIRA HDFS-10419, the project has been renamed to Hadoop Distributed Data Store or HDDS. - HDDS becomes a sub-project of Hadoop. - Added a Maven profile that disables HDDS compilation by default. - The releases of HDDS will be independent of Hadoop and will have no impact to current Hadoop release process. - We have made HDDS a loadable module. - Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does not impact current users of HDFS. The vote will run for 7 days, I will start this vote with my +1. Thanks Jitendra
Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)
Thanks for working on this, Konstantin!! +1 (non binding) - Built from source on 1.8.0_111, mac - Verified checksum - Built non secure local cluster - Run yarn jobs like: pi,word count, DFSIO - Performed basic HDFS operations Ajay On 4/16/18, 7:07 AM, "Jason Lowe" wrote: Thanks for driving the release, Konstatin! +1 (binding) - Verified signatures and digests - Completed a native build from source - Deployed a single-node cluster - Ran some sample jobs Jason On Mon, Apr 9, 2018 at 6:14 PM, Konstantin Shvachko wrote: > Hi everybody, > > This is the next dot release of Apache Hadoop 2.7 line. The previous one 2.7.5 > was released on December 14, 2017. > Release 2.7.6 includes critical bug fixes and optimizations. See more > details in Release Note: > http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html > > The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/ > > Please give it a try and vote on this thread. The vote will run for 5 days > ending 04/16/2018. > > My up to date public key is available from: > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > Thanks, > --Konstantin - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13462) Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers
Lukas Majercak created HDFS-13462: - Summary: Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers Key: HDFS-13462 URL: https://issues.apache.org/jira/browse/HDFS-13462 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs, journal-node Reporter: Lukas Majercak Assignee: Lukas Majercak -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13461) mvn site:site -Phdds does not work
Xiaoyu Yao created HDFS-13461: - Summary: mvn site:site -Phdds does not work Key: HDFS-13461 URL: https://issues.apache.org/jira/browse/HDFS-13461 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Xiaoyu Yao {code}[*INFO*] *Reactor Summary:* [*INFO*] [*INFO*] Apache Hadoop Main . *FAILURE* [ 47.386 s] ... [*ERROR*] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:3.6:site *(default-cli)* on project hadoop-main: *failed to get report for org.apache.maven.plugins:maven-javadoc-plugin*: Failed to execute goal on project hadoop-hdds-server-scm: *Could not resolve dependencies for project org.apache.hadoop:hadoop-hdds-server-scm:jar:3.2.0-SNAPSHOT: Could not find artifact org.apache.hadoop:hadoop-hdds-container-service:jar:tests:3.2.0-SNAPSHOT in public (http://nexus-private.hortonworks.com/nexus/content/groups/public)* -> [Help 1] {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13460) Fix Ozone related doc links in hadoop-project/src/site/site.xml
Xiaoyu Yao created HDFS-13460: - Summary: Fix Ozone related doc links in hadoop-project/src/site/site.xml Key: HDFS-13460 URL: https://issues.apache.org/jira/browse/HDFS-13460 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Xiaoyu Yao Assignee: Xiaoyu Yao Because Hdds profile is off by default, the links in the generated site will be invalid without specifying maven profile -Phdds. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13459) Ozone: Clean-up of ozone related change from MiniDFSCluste
Nanda kumar created HDFS-13459: -- Summary: Ozone: Clean-up of ozone related change from MiniDFSCluste Key: HDFS-13459 URL: https://issues.apache.org/jira/browse/HDFS-13459 Project: Hadoop HDFS Issue Type: Sub-task Components: ozone Reporter: Nanda kumar Assignee: Nanda kumar After HDFS-13424 {{MiniOzoneCluster}} doesn't depend on {{MiniDFSCluste}}, ozone related changes made in MiniDFSCluste can be reverted. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/ No changes -1 overall The following subsystems voted -1: asflicense unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.util.TestBasicDiskValidator hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.server.namenode.TestReencryptionWithKMS hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes hadoop.fs.contract.router.web.TestRouterWebHDFSContractAppend hadoop.yarn.server.TestDiskFailures cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-compile-javac-root.txt [288K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-checkstyle-root.txt [17M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-patch-shelldocs.txt [12K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/xml.txt [4.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/diff-javadoc-javadoc-root.txt [760K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [184K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [304K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt [28K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [84K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/753/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.8.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)
Thanks for driving the release, Konstatin! +1 (binding) - Verified signatures and digests - Completed a native build from source - Deployed a single-node cluster - Ran some sample jobs Jason On Mon, Apr 9, 2018 at 6:14 PM, Konstantin Shvachko wrote: > Hi everybody, > > This is the next dot release of Apache Hadoop 2.7 line. The previous one 2.7.5 > was released on December 14, 2017. > Release 2.7.6 includes critical bug fixes and optimizations. See more > details in Release Note: > http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html > > The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/ > > Please give it a try and vote on this thread. The vote will run for 5 days > ending 04/16/2018. > > My up to date public key is available from: > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > Thanks, > --Konstantin - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13458) Ozone: Fix javadoc issues in HDFS-7240
Lokesh Jain created HDFS-13458: -- Summary: Ozone: Fix javadoc issues in HDFS-7240 Key: HDFS-13458 URL: https://issues.apache.org/jira/browse/HDFS-13458 Project: Hadoop HDFS Issue Type: Bug Reporter: Lokesh Jain -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13457) LocalFilesystem#rename(Path, Path, Options.Rename...) does not handle crc files
Andras Bokor created HDFS-13457: --- Summary: LocalFilesystem#rename(Path, Path, Options.Rename...) does not handle crc files Key: HDFS-13457 URL: https://issues.apache.org/jira/browse/HDFS-13457 Project: Hadoop HDFS Issue Type: Bug Reporter: Andras Bokor Assignee: Andras Bokor ChecksumFilesystem#rename(Path, Path, Options.Rename...) is missing and FilterFileSystem does not care with crc files. That causes abandoned crc files in case of rename. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13456) Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-4309324-SNAPSHOT)
Lokesh Jain created HDFS-13456: -- Summary: Ozone: Update ozone to latest ratis snapshot build (0.1.1-alpha-4309324-SNAPSHOT) Key: HDFS-13456 URL: https://issues.apache.org/jira/browse/HDFS-13456 Project: Hadoop HDFS Issue Type: Bug Reporter: Lokesh Jain Assignee: Lokesh Jain -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13455) Ozone: Add unit test to verify loading of HddsDatanodeService as part of datanode startup when ozone is enabled
Nanda kumar created HDFS-13455: -- Summary: Ozone: Add unit test to verify loading of HddsDatanodeService as part of datanode startup when ozone is enabled Key: HDFS-13455 URL: https://issues.apache.org/jira/browse/HDFS-13455 Project: Hadoop HDFS Issue Type: Sub-task Components: ozone Reporter: Nanda kumar Assignee: Nanda kumar When {{ozone}} is enabled and {{HddsDatanodeService}} plugin is configured, datanode should load {{HddsDatanodeService}} plugin and start Hdds services. We have to add unit test case inside {{hadoop/hadoop-ozone/integration-test}} using {{MiniDFSCluster}} to verify the following scenarios * HddsDatanodeService is loaded as part of datanode startup. * run Freon test against {{MiniDFSCluster}} and validate the data that has been written. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-13454) Ozone : Fix the test logic in TestKeySpaceManager#testDeleteKey
Shashikant Banerjee created HDFS-13454: -- Summary: Ozone : Fix the test logic in TestKeySpaceManager#testDeleteKey Key: HDFS-13454 URL: https://issues.apache.org/jira/browse/HDFS-13454 Project: Hadoop HDFS Issue Type: Sub-task Components: ozone Reporter: Shashikant Banerjee Assignee: Shashikant Banerjee Fix For: HDFS-7240 The test logic in TestKeySpaceManager#testDeleteKey seems to be wrong. The test validates the keyArgs instead of blockId to make sure the key gets deleted from SCM. Also, after the first exception validation , the subsequent statements in the junit never gets executed here. {code:java} keys.add(keyArgs.getResourceName()); exception.expect(IOException.class); exception.expectMessage("Specified block key does not exist"); cluster.getStorageContainerManager().getBlockLocations(keys); // Delete the key again to test deleting non-existing key. // These will never get executed. exception.expect(IOException.class); exception.expectMessage("KEY_NOT_FOUND"); storageHandler.deleteKey(keyArgs); Assert.assertEquals(1 + numKeyDeleteFails, ksmMetrics.getNumKeyDeletesFails());{code} The test needs to be modified to address all these. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
RE: [VOTE] Release Apache Hadoop 2.7.6 (RC0)
+1 (non-binding) - Verified the hashes - Succeeded "mvn clean package -Pdist,native -Dtar -DskipTests" - Verified hadoop cluster with 1 master and 5 slaves - Verified TeraGen/TeraSort - Verified some hdfs operations - Verified Web UI (NN, RM, JobHistory, Timeline) Thanks, -Takanobu -Original Message- From: Konstantin Shvachko [mailto:shv.had...@gmail.com] Sent: Tuesday, April 10, 2018 8:14 AM To: Hadoop Common ; hdfs-dev ; mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: [VOTE] Release Apache Hadoop 2.7.6 (RC0) Hi everybody, This is the next dot release of Apache Hadoop 2.7 line. The previous one 2.7.5 was released on December 14, 2017. Release 2.7.6 includes critical bug fixes and optimizations. See more details in Release Note: http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/ Please give it a try and vote on this thread. The vote will run for 5 days ending 04/16/2018. My up to date public key is available from: https://dist.apache.org/repos/dist/release/hadoop/common/KEYS Thanks, --Konstantin