[jira] [Created] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

Arpit Agarwal created HDFS-8157: --- Summary: Writes to RAM DISK reserve locked memory for block files Key: HDFS-8157 URL: https://issues.apache.org/jira/browse/HDFS-8157 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-8152) Refactoring of lazy persist storage cases

Arpit Agarwal created HDFS-8152: --- Summary: Refactoring of lazy persist storage cases Key: HDFS-8152 URL: https://issues.apache.org/jira/browse/HDFS-8152 Project: Hadoop HDFS Issue Type: Improve

[jira] [Created] (HDFS-8072) Reserved RBW space is not released if client terminates while writing block

Arpit Agarwal created HDFS-8072: --- Summary: Reserved RBW space is not released if client terminates while writing block Key: HDFS-8072 URL: https://issues.apache.org/jira/browse/HDFS-8072 Project: Hadoop

[jira] [Created] (HDFS-7924) NameNode goes into infinite lease recovery

Arpit Agarwal created HDFS-7924: --- Summary: NameNode goes into infinite lease recovery Key: HDFS-7924 URL: https://issues.apache.org/jira/browse/HDFS-7924 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7896) HDFS Slow disk detection

Arpit Agarwal created HDFS-7896: --- Summary: HDFS Slow disk detection Key: HDFS-7896 URL: https://issues.apache.org/jira/browse/HDFS-7896 Project: Hadoop HDFS Issue Type: New Feature Co

[jira] [Created] (HDFS-7757) Misleading error messages in FSImage.java

Arpit Agarwal created HDFS-7757: --- Summary: Misleading error messages in FSImage.java Key: HDFS-7757 URL: https://issues.apache.org/jira/browse/HDFS-7757 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7734) Class cast exception in NameNode#main

Arpit Agarwal created HDFS-7734: --- Summary: Class cast exception in NameNode#main Key: HDFS-7734 URL: https://issues.apache.org/jira/browse/HDFS-7734 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7733) NFS: readdir/readdirplus return null directory attribute on failure

Arpit Agarwal created HDFS-7733: --- Summary: NFS: readdir/readdirplus return null directory attribute on failure Key: HDFS-7733 URL: https://issues.apache.org/jira/browse/HDFS-7733 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5183) Combine ReplicaPlacementPolicy with VolumeChoosingPolicy together to have a global view in choosing DN storage for replica.

[ https://issues.apache.org/jira/browse/HDFS-5183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5183. - Resolution: Implemented Hadoop Flags: (was: Incompatible change) Resolving this as Implemen

[jira] [Resolved] (HDFS-5423) Verify initializations of LocatedBlock/RecoveringBlock

[ https://issues.apache.org/jira/browse/HDFS-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5423. - Resolution: Invalid Resolving as Invalid. I don't believe any work is remaining here. > Verify ini

[jira] [Resolved] (HDFS-5264) Consider renaming StorageID

[ https://issues.apache.org/jira/browse/HDFS-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5264. - Resolution: Won't Fix Punting - it will cause unnecessary code churn. > Consider renaming StorageI

[jira] [Resolved] (HDFS-5178) DataTransferProtocol changes for supporting mutiple storages per DN

[ https://issues.apache.org/jira/browse/HDFS-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5178. - Resolution: Duplicate Also resolving this as a duplicate of HDFS-6702. [~djp], my apologies once a

[jira] [Resolved] (HDFS-4989) Balancer needs to consider storage type in balancing

[ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-4989. - Resolution: Duplicate Resolving a duplicate of HDFS-6685 since that one is fixed. I am sorry about

[jira] [Created] (HDFS-7649) Multihoming docs should emphasize using hostnames in configurations

Arpit Agarwal created HDFS-7649: --- Summary: Multihoming docs should emphasize using hostnames in configurations Key: HDFS-7649 URL: https://issues.apache.org/jira/browse/HDFS-7649 Project: Hadoop HDFS

[jira] [Created] (HDFS-7643) Test case to ensure lazy persist files cannot be truncated

Arpit Agarwal created HDFS-7643: --- Summary: Test case to ensure lazy persist files cannot be truncated Key: HDFS-7643 URL: https://issues.apache.org/jira/browse/HDFS-7643 Project: Hadoop HDFS Is

[jira] [Resolved] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7591. - Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.7.0 Thanks for the cl

[jira] [Reopened] (HDFS-7591) hdfs classpath command should support same options as hadoop classpath.

[ https://issues.apache.org/jira/browse/HDFS-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-7591: - Reopening for branch-2 commit. > hdfs classpath command should support same options as hadoop classpat

[jira] [Resolved] (HDFS-7593) Data Not replicate in ssd drive

[ https://issues.apache.org/jira/browse/HDFS-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7593. - Resolution: Invalid [~vivekraghuwanshi], I am resolving this as as 'Invalid' due to lack of detail.

[jira] [Created] (HDFS-7596) NameNode should prune dead storages from storageMap

Arpit Agarwal created HDFS-7596: --- Summary: NameNode should prune dead storages from storageMap Key: HDFS-7596 URL: https://issues.apache.org/jira/browse/HDFS-7596 Project: Hadoop HDFS Issue Typ

[jira] [Created] (HDFS-7514) TestTextCommand fails on Windows

Arpit Agarwal created HDFS-7514: --- Summary: TestTextCommand fails on Windows Key: HDFS-7514 URL: https://issues.apache.org/jira/browse/HDFS-7514 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Created] (HDFS-7503) Namenode restart after large deletions can cause slow processReport (due to logging)

Arpit Agarwal created HDFS-7503: --- Summary: Namenode restart after large deletions can cause slow processReport (due to logging) Key: HDFS-7503 URL: https://issues.apache.org/jira/browse/HDFS-7503 Projec

[jira] [Created] (HDFS-7192) DN should ignore lazyPersist hint if the writer is not local

Arpit Agarwal created HDFS-7192: --- Summary: DN should ignore lazyPersist hint if the writer is not local Key: HDFS-7192 URL: https://issues.apache.org/jira/browse/HDFS-7192 Project: Hadoop HDFS

[jira] [Created] (HDFS-7178) Additional unit test for replica write with full disk

Arpit Agarwal created HDFS-7178: --- Summary: Additional unit test for replica write with full disk Key: HDFS-7178 URL: https://issues.apache.org/jira/browse/HDFS-7178 Project: Hadoop HDFS Issue T

[jira] [Resolved] (HDFS-7171) Fix Jenkins failures in HDFS-6581 branch

[ https://issues.apache.org/jira/browse/HDFS-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7171. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks for the quick

[jira] [Reopened] (HDFS-7153) Add storagePolicy to NN edit log during file creation

[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-7153: - Reopen for Jenkins run. > Add storagePolicy to NN edit log during file creation >

[jira] [Created] (HDFS-7171) Fix Jenkins failures in HDFS-6581 branch

Arpit Agarwal created HDFS-7171: --- Summary: Fix Jenkins failures in HDFS-6581 branch Key: HDFS-7171 URL: https://issues.apache.org/jira/browse/HDFS-7171 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7129) Metrics to track usage of memory for writes

[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7129. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the feat

[jira] [Resolved] (HDFS-7159) Use block storage policy to set lazy persist preference

[ https://issues.apache.org/jira/browse/HDFS-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7159. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks a lot for revi

[jira] [Created] (HDFS-7170) DFSOutputStream should query policies from NameNode

Arpit Agarwal created HDFS-7170: --- Summary: DFSOutputStream should query policies from NameNode Key: HDFS-7170 URL: https://issues.apache.org/jira/browse/HDFS-7170 Project: Hadoop HDFS Issue Typ

[jira] [Resolved] (HDFS-7153) Add storagePolicy to NN edit log during file creation

[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7153. - Resolution: Fixed Fix Version/s: HDFS-6581 Target Version/s: (was: 2.6.0)

[jira] [Created] (HDFS-7164) Feature documentation for HDFS-6581

Arpit Agarwal created HDFS-7164: --- Summary: Feature documentation for HDFS-6581 Key: HDFS-7164 URL: https://issues.apache.org/jira/browse/HDFS-7164 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7160) Fix incorrect layout version caused by bad merge

[ https://issues.apache.org/jira/browse/HDFS-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7160. - Resolution: Invalid Deprecated by HDFS-7159 which reverts the layout version change altogether. >

[jira] [Created] (HDFS-7160) Fix incorrect layout version caused by bad merge

Arpit Agarwal created HDFS-7160: --- Summary: Fix incorrect layout version caused by bad merge Key: HDFS-7160 URL: https://issues.apache.org/jira/browse/HDFS-7160 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-7159) Use block storage policy to set lazy persist preference

Arpit Agarwal created HDFS-7159: --- Summary: Use block storage policy to set lazy persist preference Key: HDFS-7159 URL: https://issues.apache.org/jira/browse/HDFS-7159 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-7155) Bugfix in createLocatedFileStatus caused by bad merge

[ https://issues.apache.org/jira/browse/HDFS-7155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7155. - Resolution: Fixed Fix Version/s: HDFS-6581 Thanks for the quick review Chris. Committed to t

[jira] [Created] (HDFS-7155) Bugfix in createLocatedFileStatus called by bad merge

Arpit Agarwal created HDFS-7155: --- Summary: Bugfix in createLocatedFileStatus called by bad merge Key: HDFS-7155 URL: https://issues.apache.org/jira/browse/HDFS-7155 Project: Hadoop HDFS Issue T

[jira] [Created] (HDFS-7153) Add storagePolicy to NN edit log during file creation

Arpit Agarwal created HDFS-7153: --- Summary: Add storagePolicy to NN edit log during file creation Key: HDFS-7153 URL: https://issues.apache.org/jira/browse/HDFS-7153 Project: Hadoop HDFS Issue T

[jira] [Resolved] (HDFS-7144) Fix findbugs warnings in RamDiskReplicaTracker

[ https://issues.apache.org/jira/browse/HDFS-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7144. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 thanks a lot for h

[jira] [Resolved] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6932. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 Committed to the

[jira] [Resolved] (HDFS-7143) Fix findbugs warnings in HDFS-6581 branch

[ https://issues.apache.org/jira/browse/HDFS-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7143. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks a lot for fixi

[jira] [Resolved] (HDFS-7089) Fix findbugs warnings in the HDFS-6581 branch

[ https://issues.apache.org/jira/browse/HDFS-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7089. - Resolution: Duplicate Fix Version/s: HDFS-6581 > Fix findbugs warnings in the HDFS-6581 bran

[jira] [Resolved] (HDFS-7141) Integrate HDFS-6581 memory usage with HDFS-4949

[ https://issues.apache.org/jira/browse/HDFS-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7141. - Resolution: Duplicate > Integrate HDFS-6581 memory usage with HDFS-4949 > -

[jira] [Resolved] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6990. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the feat

[jira] [Created] (HDFS-7129) Metrics to track usage of memory for writes

Arpit Agarwal created HDFS-7129: --- Summary: Metrics to track usage of memory for writes Key: HDFS-7129 URL: https://issues.apache.org/jira/browse/HDFS-7129 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Created] (HDFS-7112) LazyWriter should use either async IO or one thread per physical disk

Arpit Agarwal created HDFS-7112: --- Summary: LazyWriter should use either async IO or one thread per physical disk Key: HDFS-7112 URL: https://issues.apache.org/jira/browse/HDFS-7112 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7071) Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag

[ https://issues.apache.org/jira/browse/HDFS-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7071. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Jitendra, comm

[jira] [Resolved] (HDFS-7108) Fix failures in SimulatedFsDataset introduced by HDFS-7100

[ https://issues.apache.org/jira/browse/HDFS-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7108. - Resolution: Fixed Fix Version/s: HDFS-6581 Thanks Chris! I committed pre-Jenkins since this

[jira] [Resolved] (HDFS-7100) Make eviction scheme pluggable

[ https://issues.apache.org/jira/browse/HDFS-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7100. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the feat

[jira] [Created] (HDFS-7108) Fix failures in SimulatedFsDataset introduced by HDFS-7100

Arpit Agarwal created HDFS-7108: --- Summary: Fix failures in SimulatedFsDataset introduced by HDFS-7100 Key: HDFS-7108 URL: https://issues.apache.org/jira/browse/HDFS-7108 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-7100) Make eviction scheme pluggable

Arpit Agarwal created HDFS-7100: --- Summary: Make eviction scheme pluggable Key: HDFS-7100 URL: https://issues.apache.org/jira/browse/HDFS-7100 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7091) Add forwarding constructor for INodeFile for existing callers

[ https://issues.apache.org/jira/browse/HDFS-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7091. - Resolution: Fixed Release Note: Thanks Nicholas! Revised title and committed to the feature b

[jira] [Created] (HDFS-7093) Allow unprivileged users to set storage policy on a directory

Arpit Agarwal created HDFS-7093: --- Summary: Allow unprivileged users to set storage policy on a directory Key: HDFS-7093 URL: https://issues.apache.org/jira/browse/HDFS-7093 Project: Hadoop HDFS

[jira] [Created] (HDFS-7091) Prepare branch for merging with HDFS-6584

Arpit Agarwal created HDFS-7091: --- Summary: Prepare branch for merging with HDFS-6584 Key: HDFS-7091 URL: https://issues.apache.org/jira/browse/HDFS-7091 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Created] (HDFS-7090) Use unbuffered writes when persisting in-memory replicas

Arpit Agarwal created HDFS-7090: --- Summary: Use unbuffered writes when persisting in-memory replicas Key: HDFS-7090 URL: https://issues.apache.org/jira/browse/HDFS-7090 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-7089) Fix findbugs and release audit warnings in the branch

Arpit Agarwal created HDFS-7089: --- Summary: Fix findbugs and release audit warnings in the branch Key: HDFS-7089 URL: https://issues.apache.org/jira/browse/HDFS-7089 Project: Hadoop HDFS Issue T

[jira] [Resolved] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7084. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1, committed to the

[jira] [Resolved] (HDFS-7080) Fix finalize and upgrade unit test failures

[ https://issues.apache.org/jira/browse/HDFS-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7080. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the feat

[jira] [Created] (HDFS-7080) Fix finalize and upgrade unit test failures

Arpit Agarwal created HDFS-7080: --- Summary: Fix finalize and upgrade unit test failures Key: HDFS-7080 URL: https://issues.apache.org/jira/browse/HDFS-7080 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-7079) Few more unit test fixes for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7079. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Jitendra! Comm

[jira] [Created] (HDFS-7079) Few more unit test fixes for HDFS-6581

Arpit Agarwal created HDFS-7079: --- Summary: Few more unit test fixes for HDFS-6581 Key: HDFS-7079 URL: https://issues.apache.org/jira/browse/HDFS-7079 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-7064) Fix test failures

[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7064. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 committed to the f

[jira] [Resolved] (HDFS-7066) LazyWriter#evictBlocks misses a null check for replicaState

[ https://issues.apache.org/jira/browse/HDFS-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7066. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1 I committed this t

[jira] [Created] (HDFS-7064) Fix test failures

Arpit Agarwal created HDFS-7064: --- Summary: Fix test failures Key: HDFS-7064 URL: https://issues.apache.org/jira/browse/HDFS-7064 Project: Hadoop HDFS Issue Type: Sub-task Components:

[jira] [Resolved] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6978. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~jnp]! Commit

[jira] [Resolved] (HDFS-7043) Can namenode recover from a edit log file?

[ https://issues.apache.org/jira/browse/HDFS-7043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7043. - Resolution: Invalid If you have lost the Filesystem Image then the filesystem is unrecoverable, so

[jira] [Resolved] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6991. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks for the review

[jira] [Resolved] (HDFS-6977) Delete all copies when a block is deleted from the block space

[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6977. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~jnp]. Commit

[jira] [Resolved] (HDFS-6988) Make RAM disk eviction thresholds configurable

[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6988. - Resolution: Duplicate Fix Version/s: HDFS-6581 Assignee: Arpit Agarwal The fix for

[jira] [Resolved] (HDFS-6862) Add missing timeout annotations to tests

[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6862. - Resolution: Later > Add missing timeout annotations to tests >

[jira] [Reopened] (HDFS-6862) Add missing timeout annotations to tests

[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-6862: - > Add missing timeout annotations to tests > > >

[jira] [Resolved] (HDFS-6930) Improve replica eviction from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6930. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Colin and Xiao

[jira] [Reopened] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-6991: - > Notify NN of evicted block before deleting it from RAM disk > ---

[jira] [Resolved] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6991. - Resolution: Duplicate I'll include the fix in HDFS-6930 since the same code is modified by both pa

[jira] [Resolved] (HDFS-6950) Add Additional unit tests for HDFS-6581

[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6950. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Committed to the feat

[jira] [Created] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

Arpit Agarwal created HDFS-6991: --- Summary: Notify NN of evicted block before deleting it from RAM disk Key: HDFS-6991 URL: https://issues.apache.org/jira/browse/HDFS-6991 Project: Hadoop HDFS

[jira] [Created] (HDFS-6988) Make RAM disk eviction thresholds configurable

Arpit Agarwal created HDFS-6988: --- Summary: Make RAM disk eviction thresholds configurable Key: HDFS-6988 URL: https://issues.apache.org/jira/browse/HDFS-6988 Project: Hadoop HDFS Issue Type: Su

[jira] [Created] (HDFS-6981) DN upgrade with layout version change should not use trash

Arpit Agarwal created HDFS-6981: --- Summary: DN upgrade with layout version change should not use trash Key: HDFS-6981 URL: https://issues.apache.org/jira/browse/HDFS-6981 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-6978) Directory scanner should correctly reconcile blocks on RAM disk

Arpit Agarwal created HDFS-6978: --- Summary: Directory scanner should correctly reconcile blocks on RAM disk Key: HDFS-6978 URL: https://issues.apache.org/jira/browse/HDFS-6978 Project: Hadoop HDFS

[jira] [Created] (HDFS-6977) Delete lazyPersist files when a block is deleted from RAM disk

Arpit Agarwal created HDFS-6977: --- Summary: Delete lazyPersist files when a block is deleted from RAM disk Key: HDFS-6977 URL: https://issues.apache.org/jira/browse/HDFS-6977 Project: Hadoop HDFS

[jira] [Created] (HDFS-6975) Consider removing heavyweight synchronization for FsDatasetImpl operations

Arpit Agarwal created HDFS-6975: --- Summary: Consider removing heavyweight synchronization for FsDatasetImpl operations Key: HDFS-6975 URL: https://issues.apache.org/jira/browse/HDFS-6975 Project: Hadoop

[jira] [Resolved] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

[ https://issues.apache.org/jira/browse/HDFS-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6960. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks Jitendra! Com

[jira] [Resolved] (HDFS-6931) Move lazily persisted replicas to finalized directory on DN startup

[ https://issues.apache.org/jira/browse/HDFS-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6931. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to the feature branch.

[jira] [Resolved] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6928. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed Thanks [~xyao] and [

[jira] [Created] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

Arpit Agarwal created HDFS-6960: --- Summary: Bugfix in LazyWriter, fix test case and some refactoring Key: HDFS-6960 URL: https://issues.apache.org/jira/browse/HDFS-6960 Project: Hadoop HDFS Issu

[jira] [Resolved] (HDFS-6929) NN periodically unlinks lazy persist files with missing replicas from namespace

[ https://issues.apache.org/jira/browse/HDFS-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6929. - Resolution: Fixed Hadoop Flags: Reviewed Committed to the feature branch. Thanks [~jnp]. >

[jira] [Reopened] (HDFS-6854) Enhance CLI to support memory storage.

[ https://issues.apache.org/jira/browse/HDFS-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-6854: - > Enhance CLI to support memory storage. > -- > >

[jira] [Resolved] (HDFS-6854) Enhance CLI to support memory storage.

[ https://issues.apache.org/jira/browse/HDFS-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6854. - Resolution: Duplicate > Enhance CLI to support memory storage. > -

[jira] [Resolved] (HDFS-6854) Enhance CLI to support memory storage.

[ https://issues.apache.org/jira/browse/HDFS-6854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6854. - Resolution: Fixed Hadoop Flags: Reviewed Dup'ed against HDFS-6928. [~tassapola], I marked yo

[jira] [Resolved] (HDFS-6924) Add new RAM_DISK storage type

[ https://issues.apache.org/jira/browse/HDFS-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6924. - Resolution: Fixed > Add new RAM_DISK storage type > - > >

[jira] [Resolved] (HDFS-6925) DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received

[ https://issues.apache.org/jira/browse/HDFS-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6925. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to the feature branch.

[jira] [Resolved] (HDFS-6927) Add unit tests

[ https://issues.apache.org/jira/browse/HDFS-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6927. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to feature branch. > Ad

[jira] [Resolved] (HDFS-6926) DN support for saving replicas to persistent storage and evicting in-memory replicas

[ https://issues.apache.org/jira/browse/HDFS-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6926. - Resolution: Fixed Hadoop Flags: Reviewed Thanks Jitendra! Committed to feature branch. > DN

[jira] [Resolved] (HDFS-6922) Add LazyPersist flag to INodeFile, save it in FsImage and edit logs

[ https://issues.apache.org/jira/browse/HDFS-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6922. - Resolution: Fixed Thanks for the code reviews all. [~vinayrpet] if you think is an unaddressed is

[jira] [Resolved] (HDFS-6923) Propagate LazyPersist flag to DNs via DataTransferProtocol

[ https://issues.apache.org/jira/browse/HDFS-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6923. - Resolution: Fixed Thanks for the code review [~jnp]. Committed to the branch. > Propagate LazyPer

[jira] [Created] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

Arpit Agarwal created HDFS-6955: --- Summary: DN should reserve disk space for a full block when creating tmp files Key: HDFS-6955 URL: https://issues.apache.org/jira/browse/HDFS-6955 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-6936) The HttpFSFileSystem should also return the isLazyPersist flag in the FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6936. - Resolution: Duplicate Fix Version/s: HDFS-6581 Fixed by HDFS-6921. > The HttpFSFileSystem

[jira] [Resolved] (HDFS-6921) Add LazyPersist flag to FileStatus

[ https://issues.apache.org/jira/browse/HDFS-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-6921. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed [~vinayrpet], correc

[jira] [Created] (HDFS-6936) he HttpFSFileSystem should also return the isLazyPersist flag in the FileStatus

Arpit Agarwal created HDFS-6936: --- Summary: he HttpFSFileSystem should also return the isLazyPersist flag in the FileStatus Key: HDFS-6936 URL: https://issues.apache.org/jira/browse/HDFS-6936 Project: Ha

[jira] [Created] (HDFS-6934) Move checksum computation off the hot path when writing to RAM disk

Arpit Agarwal created HDFS-6934: --- Summary: Move checksum computation off the hot path when writing to RAM disk Key: HDFS-6934 URL: https://issues.apache.org/jira/browse/HDFS-6934 Project: Hadoop HDFS

[jira] [Created] (HDFS-6933) Skip checksum verification when reading from memory

Arpit Agarwal created HDFS-6933: --- Summary: Skip checksum verification when reading from memory Key: HDFS-6933 URL: https://issues.apache.org/jira/browse/HDFS-6933 Project: Hadoop HDFS Issue Typ

<    1   2   3   4   5   6   >