date:20180417

RE: [VOTE] Merge HDDS (HDFS-7240) code into trunk

2018-04-17 Thread Brahma Reddy Battula

+1 (binding)




Brahma Reddy Battula


-Original Message-
From: Jitendra Pandey [mailto:jiten...@hortonworks.com] 
Sent: 17 April 2018 07:49
To: Hdfs-dev 
Subject: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk

Hi All,

   The community unanimously voted (https://s.apache.org/HDDSMergeResult) to 
adopt HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code 
merge.

Here is a quick summary of the code changes:

- As decided in the JIRA HDFS-10419, the project has been renamed to Hadoop 
Distributed Data Store or HDDS.
- HDDS becomes a sub-project of Hadoop.
- Added a Maven profile that disables HDDS compilation by default.
- The releases of HDDS will be independent of Hadoop and will have no impact to 
current Hadoop release process.
- We have made HDDS a loadable module.
- Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does not impact 
current users of HDFS.

The vote will run for 7 days, I will start this vote with my +1.

Thanks
Jitendra

B CB  [  
X  ܚX KK[XZ[
   Y] ][  X  ܚX PY  
 \X K ܙ B  ܈Y][ۘ[  [X[  K[XZ[
   Y] Z[Y  
 \X K ܙ B 

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13472) Compilation error in trunk in hadoop-aws

2018-04-17 Thread Mohammad Arshad (JIRA)

Mohammad Arshad created HDFS-13472:
--

 Summary: Compilation error in trunk in hadoop-aws 
 Key: HDFS-13472
 URL: https://issues.apache.org/jira/browse/HDFS-13472
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Mohammad Arshad


*Problem: *hadoop trunk compilation is failing
*Root Cause:*
compilation error is coming from 
{{org.apache.hadoop.fs.s3a.commit.staging.StagingTestBase}}. Compilation error 
is "The method getArgumentAt(int, Class) is undefined for 
the type InvocationOnMock".

StagingTestBase is using getArgumentAt(int, Class) method 
which is not available in mockito-all 1.8.5 version. getArgumentAt(int, 
Class)  method is available only from version 2.0.20-beta

*Expectations:*
Either mockito-all  version to be upgraded or test case to be written only with 
available functions in 1.8.5. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-04-17 Thread Apache Jenkins Server

For more details, see https://builds.apache.org/job/hadoop-trunk-win/440/

[Apr 16, 2018 5:15:37 PM] (xyao) HADOOP-15369. Avoid usage of 
${project.version} in parent poms.
[Apr 16, 2018 6:24:26 PM] (eyang) YARN-8060.  Added default readiness check for 
service components.   
[Apr 16, 2018 9:16:59 PM] (arp) HDFS-13439. Add test case for read block 
operation when it is moved.
[Apr 16, 2018 10:05:04 PM] (haibochen) YARN-8162. Remove Method 
DirectoryCollection#verifyDirUsingMkdir. (Yufei
[Apr 16, 2018 10:55:00 PM] (virajith) HDFS-13311. RBF: 
TestRouterAdminCLI#testCreateInvalidEntry fails on
[Apr 16, 2018 11:26:54 PM] (inigoiri) YARN-7773. YARN Federation used Mysql as 
state store throw exception,
[Apr 16, 2018 11:52:17 PM] (inigoiri) YARN-8165. Incorrect queue name logging 
in AbstractContainerAllocator.
[Apr 17, 2018 12:32:19 AM] (inigoiri) YARN-8164. Fix a potential NPE in 
AbstractSchedulerPlanFollower.
[Apr 17, 2018 3:23:22 AM] (yqlin) HDFS-13435. RBF: Improve the error loggings 
for printing the stack
[Apr 17, 2018 9:38:31 AM] (sunilg) YARN-8126. Support auto-spawning of admin 
configured services during




-1 overall


The following subsystems voted -1:
compile mvninstall unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit


Specific tests:

Failed junit tests :

   hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec 
   hadoop.fs.contract.rawlocal.TestRawlocalContractAppend 
   hadoop.fs.TestFileUtil 
   hadoop.fs.TestFsShellCopy 
   hadoop.fs.TestFsShellList 
   hadoop.fs.TestLocalFileSystem 
   hadoop.fs.TestRawLocalFileSystemContract 
   hadoop.fs.TestSymlinkLocalFSFileContext 
   hadoop.fs.TestTrash 
   hadoop.http.TestHttpServer 
   hadoop.http.TestHttpServerLogs 
   hadoop.io.nativeio.TestNativeIO 
   hadoop.ipc.TestSocketFactory 
   hadoop.metrics2.impl.TestStatsDMetrics 
   hadoop.metrics2.sink.TestRollingFileSystemSinkWithLocal 
   hadoop.security.TestSecurityUtil 
   hadoop.security.TestShellBasedUnixGroupsMapping 
   hadoop.security.token.TestDtUtilShell 
   hadoop.util.TestNativeCodeLoader 
   hadoop.util.TestNodeHealthScriptRunner 
   hadoop.fs.TestResolveHdfsSymlink 
   hadoop.hdfs.crypto.TestHdfsCryptoStreams 
   hadoop.hdfs.qjournal.client.TestQuorumJournalManager 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages 
   hadoop.hdfs.server.blockmanagement.TestOverReplicatedBlocks 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistLockedMemory 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistPolicy 
   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement 
   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestWriteToReplica 
   hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage 
   hadoop.hdfs.server.datanode.TestBlockRecovery 
   hadoop.hdfs.server.datanode.TestBlockScanner 
   hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics 
   hadoop.hdfs.server.datanode.TestDataNodeFaultInjector 
   hadoop.hdfs.server.datanode.TestDataNodeMetrics 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.datanode.TestHSync 
   hadoop.hdfs.server.datanode.web.TestDatanodeHttpXFrame 
   hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancer 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC 
   hadoop.hdfs.server.mover.TestStorageMover 
   hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA 
   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA 
   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics 
   
hadoop.hdfs.server.namenode.snapshot.TestINodeFileUnderConstructionWithSnapshot 
   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot 
   hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots 
   hadoop.hdfs.server.namenode.snapshot.TestSnapRootDescendantDiff 
   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDiffReport 
   hadoop.hdfs.server.namenode.TestAddBlock 
   hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands

[jira] [Created] (HDFS-13471) RBF: Add Browse the Filesystem button to the UI

2018-04-17 Thread JIRA

Íñigo Goiri created HDFS-13471:
--

 Summary: RBF: Add Browse the Filesystem button to the UI
 Key: HDFS-13471
 URL: https://issues.apache.org/jira/browse/HDFS-13471
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Íñigo Goiri


After HDFS-12512 added WebHDFS, we can add the support to browse the filesystem 
to the UI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13470) RBF: Add Browse the Filesystem button to the UI

2018-04-17 Thread JIRA

Íñigo Goiri created HDFS-13470:
--

 Summary: RBF: Add Browse the Filesystem button to the UI
 Key: HDFS-13470
 URL: https://issues.apache.org/jira/browse/HDFS-13470
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Íñigo Goiri


After HDFS-12512 added WebHDFS, we can add the support to browse the filesystem 
to the UI.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13469) RBF: Support InodeID in the Router

2018-04-17 Thread JIRA

Íñigo Goiri created HDFS-13469:
--

 Summary: RBF: Support InodeID in the Router
 Key: HDFS-13469
 URL: https://issues.apache.org/jira/browse/HDFS-13469
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Íñigo Goiri






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13468) Add erasure coding metrics into ReadStatistics

2018-04-17 Thread Lei (Eddy) Xu (JIRA)

Lei (Eddy) Xu created HDFS-13468:


 Summary: Add erasure coding metrics into ReadStatistics
 Key: HDFS-13468
 URL: https://issues.apache.org/jira/browse/HDFS-13468
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: erasure-coding
Affects Versions: 3.0.1, 3.1.0
Reporter: Lei (Eddy) Xu
Assignee: Lei (Eddy) Xu


Expose Erasure Coding related metrics for InputStream in ReadStatistics. 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13467) Validation of Encryption zones path should be done in Distcp class.

2018-04-17 Thread Rushabh S Shah (JIRA)

Rushabh S Shah created HDFS-13467:
-

 Summary: Validation of Encryption zones path should be done in 
Distcp class.
 Key: HDFS-13467
 URL: https://issues.apache.org/jira/browse/HDFS-13467
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Rushabh S Shah
Assignee: Rushabh S Shah


Currently validation of EZ paths are done in {{SimpleCopyListing}} class.
Distcp allows anyone to override {{CopyListing}} class and have their own 
version of CopyListing class but setting 
{{DistCpConstants.CONF_LABEL_PRESERVE_RAWXATTRS}} conf is done in 
{{SimpleCopyListing#validatePaths}} method.
If someone is overriding {{CopyListing}} class then they also need to include 
all this validation in their over-rid class.
Ideally validation of EZ path and setting of {{preserveRawXAttrs}} conf should 
be done at Distcp class level and not at CopyListing level.
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[RESULT] [VOTE] Release Apache Hadoop 2.7.6 (RC0)

2018-04-17 Thread Konstantin Shvachko

Hi everybody,

With 4 binding and 4 non-binding +1s and no -1s the vote for Apache Release
2.7.6 passes.
Thank you everybody for contributing to the release, testing, and voting.

Binding +1s
Zhe Zhang
Brahma Reddy Battula
Jason Lowe
Konstantin Shvachko

Non-binding +1s
Chen Liang
Erik Krogen
Takanobu Asanuma
Ajay Kumar



On Mon, Apr 9, 2018 at 4:14 PM, Konstantin Shvachko 
wrote:

> Hi everybody,
>
> This is the next dot release of Apache Hadoop 2.7 line. The previous one
> 2.7.5 was released on December 14, 2017.
> Release 2.7.6 includes critical bug fixes and optimizations. See more
> details in Release Note:
> http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html
>
> The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/
>
> Please give it a try and vote on this thread. The vote will run for 5
> days ending 04/16/2018.
>
> My up to date public key is available from:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Thanks,
> --Konstantin
>

Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

2018-04-17 Thread Konstantin Shvachko

My formal +1 for 2.7.6 RC0

Thanks,
--Konstantin

On Mon, Apr 9, 2018 at 4:14 PM, Konstantin Shvachko 
wrote:

> Hi everybody,
>
> This is the next dot release of Apache Hadoop 2.7 line. The previous one
> 2.7.5 was released on December 14, 2017.
> Release 2.7.6 includes critical bug fixes and optimizations. See more
> details in Release Note:
> http://home.apache.org/~shv/hadoop-2.7.6-RC0/releasenotes.html
>
> The RC0 is available at: http://home.apache.org/~shv/hadoop-2.7.6-RC0/
>
> Please give it a try and vote on this thread. The vote will run for 5
> days ending 04/16/2018.
>
> My up to date public key is available from:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Thanks,
> --Konstantin
>

[jira] [Created] (HDFS-13466) RBF: Add more router-related information to the UI

2018-04-17 Thread Wei Yan (JIRA)

Wei Yan created HDFS-13466:
--

 Summary: RBF: Add more router-related information to the UI
 Key: HDFS-13466
 URL: https://issues.apache.org/jira/browse/HDFS-13466
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Wei Yan
Assignee: Wei Yan


Currently in NameNode UI, the Summary part also includes information:
{noformat}
Security is off.
Safemode is off.
 files and directories, * blocks =  total filesystem object(s).
Heap Memory used  GB of  GB Heap Memory. Max Heap Memory is  GB.
Non Heap Memory used  MB of  MB Commited Non Heap Memory. Max Non Heap 
Memory is .
{noformat}
We could add similar information for router, for better visibility.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [VOTE] Merge HDDS (HDFS-7240) code into trunk

2018-04-17 Thread Arpit Agarwal

+1 (binding)


On 4/16/18, 4:49 PM, "Jitendra Pandey"  wrote:

Hi All,

   The community unanimously voted (https://s.apache.org/HDDSMergeResult) 
to adopt 
HDDS/Ozone as a sub-project of Hadoop, here is the formal vote for code 
merge.

Here is a quick summary of the code changes:

- As decided in the JIRA HDFS-10419, the project has been renamed to Hadoop 
Distributed Data Store or HDDS.
- HDDS becomes a sub-project of Hadoop.
- Added a Maven profile that disables HDDS compilation by default.
- The releases of HDDS will be independent of Hadoop and will have no 
impact to current Hadoop release process.
- We have made HDDS a loadable module.
- Cleaned up changes in HDFS/Hadoop Common to make sure HDDS does not 
impact current users of HDFS.

The vote will run for 7 days, I will start this vote with my +1.

Thanks
Jitendra


-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org




-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13465) Overlapping lease recoveries cause NPE in NN

2018-04-17 Thread Daryn Sharp (JIRA)

Daryn Sharp created HDFS-13465:
--

 Summary: Overlapping lease recoveries cause NPE in NN
 Key: HDFS-13465
 URL: https://issues.apache.org/jira/browse/HDFS-13465
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: namenode
Affects Versions: 2.8.0
Reporter: Daryn Sharp


Overlapping lease recoveries for the same file will NPE in the DatanodeManager 
while creating LeaseRecoveryCommands, possibly losing other recovery commands.
 * client1 calls recoverLease, file is added to DN1's recovery queue
 * client2 calls recoverLease, file is added to DN2's recovery queue
 * one DN heartbeats, gets the block recovery command and it completes the 
synchronization before the other DN heartbeats; ie. file is closed.
 * other DN heartbeats, takes block from recovery queue, assumes it's still 
under construction, gets a NPE calling getExpectedLocations

{code:java}
//check lease recovery
BlockInfo[] blocks = nodeinfo.getLeaseRecoveryCommand(Integer.MAX_VALUE);
if (blocks != null) {
  BlockRecoveryCommand brCommand = new BlockRecoveryCommand(
  blocks.length);
  for (BlockInfo b : blocks) {
BlockUnderConstructionFeature uc = b.getUnderConstructionFeature();
assert uc != null;
final DatanodeStorageInfo[] storages = uc.getExpectedStorageLocations();
{code}
This is "ok" to the NN state if only 1 block was queued.  All recoveries are 
lost if multiple blocks were queued.  Recovery will not occur until the client 
explicitly retries or the lease monitor recovers the lease.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-04-17 Thread Apache Jenkins Server

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/

[Apr 16, 2018 5:15:37 PM] (xyao) HADOOP-15369. Avoid usage of 
${project.version} in parent poms.
[Apr 16, 2018 6:24:26 PM] (eyang) YARN-8060.  Added default readiness check for 
service components.   
[Apr 16, 2018 9:16:59 PM] (arp) HDFS-13439. Add test case for read block 
operation when it is moved.
[Apr 16, 2018 10:05:04 PM] (haibochen) YARN-8162. Remove Method 
DirectoryCollection#verifyDirUsingMkdir. (Yufei
[Apr 16, 2018 10:55:00 PM] (virajith) HDFS-13311. RBF: 
TestRouterAdminCLI#testCreateInvalidEntry fails on
[Apr 16, 2018 11:26:54 PM] (inigoiri) YARN-7773. YARN Federation used Mysql as 
state store throw exception,
[Apr 16, 2018 11:52:17 PM] (inigoiri) YARN-8165. Incorrect queue name logging 
in AbstractContainerAllocator.
[Apr 17, 2018 12:32:19 AM] (inigoiri) YARN-8164. Fix a potential NPE in 
AbstractSchedulerPlanFollower.




-1 overall


The following subsystems voted -1:
asflicense unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.util.TestBasicDiskValidator 
   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.yarn.sls.TestReservationSystemInvariants 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-compile-javac-root.txt
  [288K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-checkstyle-root.txt
  [17M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-patch-pylint.txt
  [24K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-patch-shelldocs.txt
  [12K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/whitespace-eol.txt
  [9.4M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/whitespace-tabs.txt
  [1.1M]

   xml:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/xml.txt
  [4.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/diff-javadoc-javadoc-root.txt
  [760K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [184K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [296K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-applications_hadoop-yarn-applications-distributedshell.txt
  [8.0K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [84K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt
  [12K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/754/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.8.0-SNAPSHOT   http://yetus.apache.org

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Resolved] (HDFS-13172) Impelement task Manager to handle create and delete multiLevel nodes is SnapshotSkipList

2018-04-17 Thread Shashikant Banerjee (JIRA)


 [ 
https://issues.apache.org/jira/browse/HDFS-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shashikant Banerjee resolved HDFS-13172.

Resolution: Won't Do

Inline deletion of multilevel nodes in snapshotSkipList is quite fast. 
Moreover, async deletion of multilevel nodes from snapshotSkipList containing 
snapshotDiffs leads to complicated scenarios

of maintaining quota consistency semantics in HDFS. It won't be done for now. 

> Impelement task Manager to handle create and delete multiLevel nodes is 
> SnapshotSkipList
> 
>
> Key: HDFS-13172
> URL: https://issues.apache.org/jira/browse/HDFS-13172
> Project: Hadoop HDFS
>  Issue Type: Improvement
>  Components: snapshots
>Reporter: Shashikant Banerjee
>Assignee: Shashikant Banerjee
>Priority: Major
>
> This Jira proposes to add a Taskmanager in SnapshotManager. The TaskManager 
> will maintain a TaskQueue. Each task in the task queue will handle creation 
> of multiple levels of a node or or balancing of the list in case of deletion 
> of  a node in the SnapshotSkipList.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

RE: [VOTE] Release Apache Hadoop 3.0.2 (RC1)

2018-04-17 Thread Takanobu Asanuma

Thanks for working on this, Lei.

+1 (non-binding)
   - Verified the hashes
   - Succeeded "mvn clean package -Pdist,native -Dtar -DskipTests"
   - Started a hadoop cluster with 1 master and 5 slaves
   - Verified TeraGen/TeraSort
   - Verified some erasure coding operations
   - Verified WebUI (NN, RM, JobHistory, Timeline)
   - Seems the shaded jars (hadoop-client-runtime, hadoop-client-api, 
hadoop-client-minicluster) have the correct sizes in orgapachehadoop-1102

-Takanobu

-Original Message-
From: Lei Xu [mailto:l...@apache.org] 
Sent: Tuesday, April 17, 2018 9:00 AM
To: Hadoop Common ; Hdfs-dev 
; mapreduce-...@hadoop.apache.org; 
yarn-...@hadoop.apache.org
Subject: [VOTE] Release Apache Hadoop 3.0.2 (RC1)

Hi, All

I've created release candidate RC-1 for Apache Hadoop 3.0.2, to address missing 
source jars in the maven repository in RC-0.

Thanks Ajay Kumar for spotting the error.

Please note: this is an amendment for Apache Hadoop 3.0.1 release to fix shaded 
jars in apache maven repository. The codebase of 3.0.2 release is the same as 
3.0.1.  New bug fixes will be included in Apache Hadoop 3.0.3 instead.

The release page is:
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release

New RC is available at: http://home.apache.org/~lei/hadoop-3.0.2-RC1/

The git tag is release-3.0.2-RC1, and the latest commit is 
5c141f7c0f24c12cb8704a6ccc1ff8ec991f41ee, which is the same as RC-0.

The maven artifacts are available at:
https://repository.apache.org/content/repositories/orgapachehadoop-1102/

Please try the release, especially, *verify the maven artifacts*, and vote.

The vote will run 5 days, ending 4/21/2018.

Here is my +1.

Best,

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org


-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13464) Fix javadoc in FsVolumeList#handleVolumeFailures

2018-04-17 Thread Shashikant Banerjee (JIRA)

Shashikant Banerjee created HDFS-13464:
--

 Summary: Fix javadoc in FsVolumeList#handleVolumeFailures
 Key: HDFS-13464
 URL: https://issues.apache.org/jira/browse/HDFS-13464
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Shashikant Banerjee
Assignee: Shashikant Banerjee






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-13463) Fix javadoc in FsDatasetImpl#checkAndUpdate

2018-04-17 Thread Shashikant Banerjee (JIRA)

Shashikant Banerjee created HDFS-13463:
--

 Summary: Fix javadoc in FsDatasetImpl#checkAndUpdate
 Key: HDFS-13463
 URL: https://issues.apache.org/jira/browse/HDFS-13463
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: datanode
Reporter: Shashikant Banerjee
Assignee: Shashikant Banerjee






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

RE: [VOTE] Merge HDDS (HDFS-7240) code into trunk

[jira] [Created] (HDFS-13472) Compilation error in trunk in hadoop-aws

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

[jira] [Created] (HDFS-13471) RBF: Add Browse the Filesystem button to the UI

[jira] [Created] (HDFS-13470) RBF: Add Browse the Filesystem button to the UI

[jira] [Created] (HDFS-13469) RBF: Support InodeID in the Router

[jira] [Created] (HDFS-13468) Add erasure coding metrics into ReadStatistics

[jira] [Created] (HDFS-13467) Validation of Encryption zones path should be done in Distcp class.

[RESULT] [VOTE] Release Apache Hadoop 2.7.6 (RC0)

Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

[jira] [Created] (HDFS-13466) RBF: Add more router-related information to the UI

Re: [VOTE] Merge HDDS (HDFS-7240) code into trunk

[jira] [Created] (HDFS-13465) Overlapping lease recoveries cause NPE in NN

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

[jira] [Resolved] (HDFS-13172) Impelement task Manager to handle create and delete multiLevel nodes is SnapshotSkipList

RE: [VOTE] Release Apache Hadoop 3.0.2 (RC1)

[jira] [Created] (HDFS-13464) Fix javadoc in FsVolumeList#handleVolumeFailures

[jira] [Created] (HDFS-13463) Fix javadoc in FsDatasetImpl#checkAndUpdate

18 matches

Site Navigation

Mail list logo

Footer information