[jira] [Updated] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

2019-09-22 Thread Rakesh R (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14818: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [~

[jira] [Updated] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-09-15 Thread Rakesh R (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13762: Target Version/s: 3.3.0 Status: Open (was: Patch Available) > Support non-volatile storage c

[jira] [Comment Edited] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

2019-09-11 Thread Rakesh R (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928209#comment-16928209 ] Rakesh R edited comment on HDFS-14818 at 9/12/19 5:22 AM: -- Thank

[jira] [Commented] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

2019-09-11 Thread Rakesh R (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928209#comment-16928209 ] Rakesh R commented on HDFS-14818: - Thanks [~PhiloHe] for the patch. Overall looks good to

[jira] [Commented] (HDFS-14740) HDFS read cache persistence support

2019-08-28 Thread Rakesh R (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918242#comment-16918242 ] Rakesh R commented on HDFS-14740: - Thanks [~Rui Mo] for the contribution. Overall the ide

[jira] [Commented] (HDFS-14745) Backport HDFS persistent memory read cache support to branch-3.1

2019-08-23 Thread Rakesh R (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914096#comment-16914096 ] Rakesh R commented on HDFS-14745: - [~PhiloHe] thanks for taking this ahead. Could you re

[jira] [Assigned] (HDFS-14740) HDFS read cache persistence support

2019-08-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reassigned HDFS-14740: --- Assignee: Rui Mo (was: Feilong He) > HDFS read cache persistence support >

[jira] [Updated] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

2019-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14700: Issue Type: Sub-task (was: Bug) Parent: HDFS-13762 > Clean up pmem cache before setting pmem cache

[jira] [Updated] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

2019-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14700: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) > Clean u

[jira] [Commented] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

2019-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903708#comment-16903708 ] Rakesh R commented on HDFS-14700: - Committed the changes to trunk. > Clean up pmem cache

[jira] [Commented] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

2019-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903693#comment-16903693 ] Rakesh R commented on HDFS-14700: - Thanks [~PhiloHe] for reporting this issue. +1 patch l

[jira] [Updated] (HDFS-14700) Clean up pmem cache before setting pmem cache capacity

2019-08-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14700: Summary: Clean up pmem cache before setting pmem cache capacity (was: Clean up pmem cache left before prio

[jira] [Updated] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-07-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13762: Release Note: Non-volatile storage class memory (SCM, also known as persistent memory) is supported in HDFS

[jira] [Updated] (HDFS-14357) Update documentation for HDFS cache on SCM support

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14357: Resolution: Fixed Status: Resolved (was: Patch Available) > Update documentation for HDFS cache on

[jira] [Updated] (HDFS-14357) Update documentation for HDFS cache on SCM support

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14357: Summary: Update documentation for HDFS cache on SCM support (was: Update the relevant docs for HDFS cache

[jira] [Commented] (HDFS-14357) Update the relevant docs for HDFS cache on SCM support

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884905#comment-16884905 ] Rakesh R commented on HDFS-14357: - Thanks [~PhiloHe] for the contribution. +1 patch lo

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884897#comment-16884897 ] Rakesh R commented on HDFS-14458: - Attached the patch by removing the {{WARN}} log messag

[jira] [Updated] (HDFS-14458) Report pmem stats to namenode

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14458: Attachment: HDFS-14458-committedpatch.patch > Report pmem stats to namenode > -

[jira] [Updated] (HDFS-14458) Report pmem stats to namenode

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14458: Resolution: Fixed Status: Resolved (was: Patch Available) > Report pmem stats to namenode > --

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

2019-07-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884893#comment-16884893 ] Rakesh R commented on HDFS-14458: - Thanks [~PhiloHe] for the patch. I am thinking to not

[jira] [Commented] (HDFS-14357) Update the relevant docs for HDFS cache on SCM support

2019-07-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883688#comment-16883688 ] Rakesh R commented on HDFS-14357: - Thanks [~PhiloHe] for the patch. Please take care bel

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

2019-07-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883663#comment-16883663 ] Rakesh R commented on HDFS-14458: - Thanks [~PhiloHe] for the updates. Please take care be

[jira] [Commented] (HDFS-14458) Report pmem stats to namenode

2019-07-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882301#comment-16882301 ] Rakesh R commented on HDFS-14458: - Thanks [~PhiloHe] for taking this ahead. Added few com

[jira] [Created] (HDDS-1688) Deadlock in ratis client

2019-06-14 Thread Rakesh R (JIRA)
Rakesh R created HDDS-1688: -- Summary: Deadlock in ratis client Key: HDDS-1688 URL: https://issues.apache.org/jira/browse/HDDS-1688 Project: Hadoop Distributed Data Store Issue Type: Bug Affects

[jira] [Created] (HDDS-1687) Datanode process shutdown due to OOME

2019-06-14 Thread Rakesh R (JIRA)
Rakesh R created HDDS-1687: -- Summary: Datanode process shutdown due to OOME Key: HDDS-1687 URL: https://issues.apache.org/jira/browse/HDDS-1687 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Updated] (HDDS-1594) NullPointerException at the ratis client while running Freon benchmark

2019-05-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDDS-1594: --- Attachment: NPE-logs.tar.gz > NullPointerException at the ratis client while running Freon benchmark > ---

[jira] [Created] (HDDS-1594) NullPointerException at the ratis client while running Freon benchmark

2019-05-27 Thread Rakesh R (JIRA)
Rakesh R created HDDS-1594: -- Summary: NullPointerException at the ratis client while running Freon benchmark Key: HDDS-1594 URL: https://issues.apache.org/jira/browse/HDDS-1594 Project: Hadoop Distributed Da

[jira] [Updated] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

2019-05-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14402: Labels: SCM (was: ) > Use FileChannel.transferTo() method for transferring block to SCM cache > --

[jira] [Updated] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

2019-05-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14402: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I have co

[jira] [Commented] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

2019-05-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848372#comment-16848372 ] Rakesh R commented on HDFS-14402: - Thank you [~PhiloHe] for the patch. The performance re

[jira] [Commented] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

2019-05-24 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847482#comment-16847482 ] Rakesh R commented on HDFS-14402: - bq. Upon making checksum configurable, I am thinking m

[jira] [Updated] (HDFS-14402) Use FileChannel.transferTo() method for transferring block to SCM cache

2019-05-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14402: Summary: Use FileChannel.transferTo() method for transferring block to SCM cache (was: Improve the impleme

[jira] [Commented] (HDFS-14402) Improve the implementation for HDFS cache on SCM

2019-05-13 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16839033#comment-16839033 ] Rakesh R commented on HDFS-14402: - Thanks [~PhiloHe] for taking this jira ahead. Please g

[jira] [Updated] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-05-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14401: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I have co

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-05-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835285#comment-16835285 ] Rakesh R commented on HDFS-14401: - Thanks [~PhiloHe] for the continuous efforts on this.

[jira] [Comment Edited] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-05-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834579#comment-16834579 ] Rakesh R edited comment on HDFS-14401 at 5/7/19 9:44 AM: - Apart f

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-05-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16834579#comment-16834579 ] Rakesh R commented on HDFS-14401: - Apart from the following comments, latest patch looks

[jira] [Comment Edited] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-04-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830376#comment-16830376 ] Rakesh R edited comment on HDFS-14401 at 4/30/19 3:09 PM: -- Overa

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-04-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16830376#comment-16830376 ] Rakesh R commented on HDFS-14401: - Overall the patch looks good and I think its nearing c

[jira] [Comment Edited] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-04-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826642#comment-16826642 ] Rakesh R edited comment on HDFS-14401 at 4/26/19 5:12 AM: -- Thank

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-04-25 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826642#comment-16826642 ] Rakesh R commented on HDFS-14401: - Thanks [~PhiloHe] for the good progress. Adding few co

[jira] [Commented] (HDFS-14401) Refine the implementation for HDFS cache on SCM

2019-04-10 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16814292#comment-16814292 ] Rakesh R commented on HDFS-14401: - Volume management at the datanode uses java Files APIs

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806058#comment-16806058 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the continuous efforts in shapin

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16804220#comment-16804220 ] Rakesh R commented on HDFS-14355: - [~PhiloHe], HDFS-14393 sub-task has been resolved, ple

[jira] [Updated] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I have co

[jira] [Commented] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16804173#comment-16804173 ] Rakesh R commented on HDFS-14393: - Thank you [~umamaheswararao] and [~PhiloHe] for the fe

[jira] [Updated] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Summary: Refactor FsDatasetCache for SCM cache implementation (was: Move stats related methods to Mappable

[jira] [Updated] (HDFS-14393) Refactor FsDatasetCache for SCM cache implementation

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Description: This jira sub-task is to make FsDatasetCache more cleaner to plugin DRAM and PMem implementati

[jira] [Commented] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803830#comment-16803830 ] Rakesh R commented on HDFS-14393: - Thanks [~umamaheswararao] for the reviews. Thanks [~P

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Attachment: HDFS-14393-003.patch > Move stats related methods to MappableBlockLoader >

[jira] [Comment Edited] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803612#comment-16803612 ] Rakesh R edited comment on HDFS-14355 at 3/28/19 6:12 AM: -- Addin

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803612#comment-16803612 ] Rakesh R commented on HDFS-14355: - Adding review comments, please take care. # How about

[jira] [Comment Edited] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803554#comment-16803554 ] Rakesh R edited comment on HDFS-14393 at 3/28/19 3:05 AM: -- Thank

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Attachment: HDFS-14393-002.patch > Move stats related methods to MappableBlockLoader >

[jira] [Commented] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803554#comment-16803554 ] Rakesh R commented on HDFS-14393: - Thanks [~umamaheswararao] for the review comments. I h

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803307#comment-16803307 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the updates. I have created HDFS

[jira] [Commented] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803306#comment-16803306 ] Rakesh R commented on HDFS-14393: - [~umamaheswararao], [~PhiloHe] I have attached the pat

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Status: Patch Available (was: Open) > Move stats related methods to MappableBlockLoader >

[jira] [Updated] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14393: Attachment: HDFS-14393-001.patch > Move stats related methods to MappableBlockLoader >

[jira] [Created] (HDFS-14393) Move stats related methods to MappableBlockLoader

2019-03-27 Thread Rakesh R (JIRA)
Rakesh R created HDFS-14393: --- Summary: Move stats related methods to MappableBlockLoader Key: HDFS-14393 URL: https://issues.apache.org/jira/browse/HDFS-14393 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797940#comment-16797940 ] Rakesh R commented on HDFS-14355: - {quote} FileMappableBlockLoader: Actually this class i

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794924#comment-16794924 ] Rakesh R commented on HDFS-14355: - {quote}This property specifies the cache capactiy for

[jira] [Comment Edited] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794827#comment-16794827 ] Rakesh R edited comment on HDFS-14355 at 3/18/19 8:31 AM: -- Thank

[jira] [Commented] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-18 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16794827#comment-16794827 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the good progress. Adding second

[jira] [Reopened] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R reopened HDFS-14355: - > Implement HDFS cache on SCM by using pure java mapped byte buffer > ---

[jira] [Resolved] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R resolved HDFS-14355. - Resolution: Unresolved > Implement HDFS cache on SCM by using pure java mapped byte buffer >

[jira] [Updated] (HDFS-14355) Implement HDFS cache on SCM by using pure java mapped byte buffer

2019-03-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Status: Patch Available (was: Reopened) > Implement HDFS cache on SCM by using pure java mapped byte buffe

[jira] [Commented] (HDFS-14355) Implement SCM cache using pure java mapped byte buffer

2019-03-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792605#comment-16792605 ] Rakesh R commented on HDFS-14355: - Thanks [~PhiloHe] for the incremental patch. Following

[jira] [Comment Edited] (HDFS-14355) Implement SCM cache using pure java mapped byte buffer

2019-03-14 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792605#comment-16792605 ] Rakesh R edited comment on HDFS-14355 at 3/14/19 12:11 PM: --- Tha

[jira] [Updated] (HDFS-14355) Implement SCM cache using pure java mapped byte buffer

2019-03-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Summary: Implement SCM cache using pure java mapped byte buffer (was: Implement SCM cache by using pure ja

[jira] [Updated] (HDFS-14355) Implement SCM cache by using pure java mapped byte buffer

2019-03-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Description: This task is to implement the caching to persistent memory using pure {{java.nio.MappedByteBuf

[jira] [Updated] (HDFS-14355) Implement SCM cache by using pure java mapped byte buffer

2019-03-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14355: Summary: Implement SCM cache by using pure java mapped byte buffer (was: Implement SCM cache by using mapp

[jira] [Commented] (HDFS-14354) Refactor MappableBlock to align with the implementation of SCM cache

2019-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16789632#comment-16789632 ] Rakesh R commented on HDFS-14354: - Good work, [~PhiloHe]. I've submitted patch to get QA

[jira] [Updated] (HDFS-14354) Refactor MappableBlock to align with the implementation of SCM cache

2019-03-11 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-14354: Status: Patch Available (was: Open) > Refactor MappableBlock to align with the implementation of SCM cache

[jira] [Comment Edited] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-02-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760449#comment-16760449 ] Rakesh R edited comment on HDFS-13762 at 2/5/19 4:46 AM: - Thanks

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-02-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16760449#comment-16760449 ] Rakesh R commented on HDFS-13762: - Thanks [~PhiloHe] for the continuous efforts! {quote}

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-01-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16733867#comment-16733867 ] Rakesh R commented on HDFS-13762: - [~zhouwei], [~Sammi], Great proposal, thanks for your

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-09-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623449#comment-16623449 ] Rakesh R commented on HDFS-10285: - I've updated release notes and resolved this jira. Tha

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-09-21 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Resolution: Fixed Release Note: StoragePolicySatisfier(SPS) allows users to track and satisfy the sto

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in HDFS

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Fix Version/s: HDFS-10285 > Storage Policy Satisfier in HDFS > > >

[jira] [Updated] (HDFS-12995) [SPS] : Merge work for HDFS-10285 branch

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12995: Fix Version/s: 3.2.0 HDFS-10285 > [SPS] : Merge work for HDFS-10285 branch > ---

[jira] [Updated] (HDFS-13808) [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWrite() and #getFileInfo() function

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13808: Fix Version/s: 3.2.0 HDFS-10285 > [SPS]: Remove unwanted FSNamesystem #isFileOpenedForWr

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10885: Fix Version/s: 3.2.0 > [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier > is o

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11670: Fix Version/s: 3.2.0 > [SPS]: Add CLI command for satisfy storage policy operations > -

[jira] [Updated] (HDFS-10794) [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the block storage movement work

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10794: Fix Version/s: 3.2.0 > [SPS]: Provide storage policy satisfy worker at DN for co-ordinating the > block st

[jira] [Updated] (HDFS-11029) [SPS]:Provide retry mechanism for the blocks which were failed while moving its storage at DNs

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11029: Fix Version/s: 3.2.0 > [SPS]:Provide retry mechanism for the blocks which were failed while moving > its s

[jira] [Updated] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11243: Fix Version/s: 3.2.0 > [SPS]: Add a protocol command from NN to DN for dropping the SPS work and > queues

[jira] [Updated] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11762: Fix Version/s: 3.2.0 > [SPS] : Empty files should be ignored in StoragePolicySatisfier. >

[jira] [Updated] (HDFS-12982) [SPS]: Reduce the locking and cleanup the Namesystem access

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12982: Fix Version/s: 3.2.0 > [SPS]: Reduce the locking and cleanup the Namesystem access > --

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Fix Version/s: 3.2.0 > [SPS]: Fix review comments of StoragePolicySatisfier feature > -

[jira] [Updated] (HDFS-13033) [SPS]: Implement a mechanism to do file block movements for external SPS

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13033: Fix Version/s: 3.2.0 > [SPS]: Implement a mechanism to do file block movements for external SPS > -

[jira] [Updated] (HDFS-11186) [SPS]: Daemon thread of SPS should start only in Active NN

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11186: Fix Version/s: 3.2.0 > [SPS]: Daemon thread of SPS should start only in Active NN > ---

[jira] [Updated] (HDFS-13166) [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly getLiveDatanodeStorageReport() calls

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13166: Fix Version/s: 3.2.0 > [SPS]: Implement caching mechanism to keep LIVE datanodes to minimize costly > getL

[jira] [Updated] (HDFS-11289) [SPS]: Make SPS movement monitor timeouts configurable

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11289: Fix Version/s: 3.2.0 > [SPS]: Make SPS movement monitor timeouts configurable > ---

[jira] [Updated] (HDFS-12556) [SPS] : Block movement analysis should be done in read lock.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12556: Fix Version/s: 3.2.0 > [SPS] : Block movement analysis should be done in read lock. > -

[jira] [Updated] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11572: Fix Version/s: 3.2.0 > [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file > -

[jira] [Updated] (HDFS-13057) [SPS]: Revisit configurations to make SPS service modes internal/external/none

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13057: Fix Version/s: 3.2.0 > [SPS]: Revisit configurations to make SPS service modes internal/external/none > ---

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Fix Version/s: 3.2.0 > [SPS]: Add block movement tracker to track the completion of block movement > futur

[jira] [Updated] (HDFS-13075) [SPS]: Provide External Context implementation.

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13075: Fix Version/s: 3.2.0 > [SPS]: Provide External Context implementation. > --

[jira] [Updated] (HDFS-11338) [SPS]: Fix timeout issue in unit tests caused by longger NN down time

2018-08-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-11338: Fix Version/s: 3.2.0 > [SPS]: Fix timeout issue in unit tests caused by longger NN down time >

  1   2   3   4   5   6   7   8   9   10   >