[jira] [Created] (HDFS-11749) Ongoing file write fails when its pipeline DataNode is pulled out for maintenance

2017-05-03 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11749: - Summary: Ongoing file write fails when its pipeline DataNode is pulled out for maintenance Key: HDFS-11749 URL: https://issues.apache.org/jira/browse/HDFS-11749

[jira] [Updated] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11644: -- Attachment: HDFS-11644.02.patch Based on suggestion from [~ste...@apache.org] and Stack,

[jira] [Comment Edited] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989626#comment-15989626 ] Manoj Govindassamy edited comment on HDFS-11718 at 4/29/17 12:19 AM: ---

[jira] [Commented] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989626#comment-15989626 ] Manoj Govindassamy commented on HDFS-11718: --- [~andrew.wang], I believe this fix

[jira] [Updated] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11644: -- Priority: Major (was: Blocker) > DFSStripedOutputStream should not implement Syncable >

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15989508#comment-15989508 ] Manoj Govindassamy commented on HDFS-11644: --- Downgraded the priority from blocke

[jira] [Updated] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11718: -- Description: This is a clone bug of HDFS-11644 to provide a quick fix while a proper fix

[jira] [Updated] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11718: -- Attachment: HDFS-11718.01.patch Thanks for the review [~eddyxu]. Attached v02 patch to m

[jira] [Created] (HDFS-11720) LeaseManager#getINodeWithLeases() should support skipping leases of deleted files with snapshot feature

2017-04-28 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11720: - Summary: LeaseManager#getINodeWithLeases() should support skipping leases of deleted files with snapshot feature Key: HDFS-11720 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11718: -- Attachment: HDFS-11644.01.patch Attaching v01 patch. [~eddyxu], can you please take a lo

[jira] [Updated] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11718: -- Status: Patch Available (was: Open) > DFSStripedOutputStream hsync/hflush should not th

[jira] [Updated] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11718: -- Description: This is a clone bug of HDFS-11644 to provide a quick fix while a proper fix

[jira] [Created] (HDFS-11718) DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException

2017-04-28 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11718: - Summary: DFSStripedOutputStream hsync/hflush should not throw UnsupportedOperationException Key: HDFS-11718 URL: https://issues.apache.org/jira/browse/HDFS-11718

[jira] [Updated] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-21 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11644: -- Attachment: HDFS-11644.01.patch Attaching the quick-fix v01 patch while I work on the fi

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979577#comment-15979577 ] Manoj Govindassamy commented on HDFS-11402: --- Above unit test failures not relate

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.08.patch Thanks for the quick review [~andrew.wang]. Attached v08

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.07.patch Thanks for the review comments [~andrew.wang]. Attached

[jira] [Comment Edited] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977906#comment-15977906 ] Manoj Govindassamy edited comment on HDFS-10999 at 4/21/17 1:20 AM:

[jira] [Commented] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977906#comment-15977906 ] Manoj Govindassamy commented on HDFS-10999: --- Did you get a chance to complete th

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.06.patch Thanks for the review [~jojochuang]. Attached v06 patch

[jira] [Comment Edited] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975800#comment-15975800 ] Manoj Govindassamy edited comment on HDFS-11402 at 4/20/17 12:23 AM: ---

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.05.patch Thanks for the review [~jojochuang] and [~andrew.wang].

[jira] [Assigned] (HDFS-11672) Fix some misleading log messages related to EC block groups

2017-04-18 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11672: - Assignee: Manoj Govindassamy > Fix some misleading log messages related to EC blo

[jira] [Comment Edited] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2017-04-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969629#comment-15969629 ] Manoj Govindassamy edited comment on HDFS-11225 at 4/14/17 10:49 PM: ---

[jira] [Comment Edited] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2017-04-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969629#comment-15969629 ] Manoj Govindassamy edited comment on HDFS-11225 at 4/14/17 10:35 PM: ---

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2017-04-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969629#comment-15969629 ] Manoj Govindassamy commented on HDFS-11225: --- *Problem:* * In order to get the ch

[jira] [Commented] (HDFS-11225) NameNode crashed because deleteSnapshot held FSNamesystem lock too long

2017-04-13 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15968302#comment-15968302 ] Manoj Govindassamy commented on HDFS-11225: --- I ran bunch of tests with various d

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966871#comment-15966871 ] Manoj Govindassamy commented on HDFS-11644: --- [~andrew.wang], [~ste...@apache.org

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966788#comment-15966788 ] Manoj Govindassamy commented on HDFS-11402: --- Above unit test failure is not rela

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Attachment: HDFS-10999.02.patch Thanks for the review [~tasanuma0829]. Separated the MBe

[jira] [Assigned] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11644: - Assignee: Manoj Govindassamy > DFSStripedOutputStream should not implement Syncab

[jira] [Commented] (HDFS-11644) DFSStripedOutputStream should not implement Syncable

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966566#comment-15966566 ] Manoj Govindassamy commented on HDFS-11644: --- [~andrew.wang], sure, will work thi

[jira] [Commented] (HDFS-8196) Erasure Coding related information on NameNode UI

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966327#comment-15966327 ] Manoj Govindassamy commented on HDFS-8196: -- [~lewuathe], posted a patch in HDFS-10

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.04.patch Attaching v04 patch with checkstyle issues (other than m

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15961666#comment-15961666 ] Manoj Govindassamy commented on HDFS-11402: --- Above unit test failures are not re

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.03.patch Thanks for the review [~yzhangal]. Attached v03 patch wi

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Status: Patch Available (was: In Progress) > Introduce separate stats for Replicated an

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Attachment: HDFS-10999.01.patch Based on previous discussions, attaching v01 patch to ad

[jira] [Updated] (HDFS-10999) Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats

2017-04-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10999: -- Summary: Introduce separate stats for Replicated and Erasure Coded Blocks apart from the

[jira] [Work started] (HDFS-10999) Use more generic "low redundancy" blocks instead of "under replicated" blocks

2017-04-04 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10999 started by Manoj Govindassamy. - > Use more generic "low redundancy" blocks instead of "under replicated

[jira] [Commented] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947477#comment-15947477 ] Manoj Govindassamy commented on HDFS-10971: --- Thanks for the review and commit he

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-28 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10971: -- Attachment: HDFS-10971.02.patch Thanks for the review [~jojochuang] and [~andrew.wang].

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10971: -- Status: Patch Available (was: In Progress) > Distcp should not copy replication factor

[jira] [Updated] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10971: -- Attachment: HDFS-10971.01.patch [~zhz] bq. For the initial 3.0 release I prefer a simple

[jira] [Work started] (HDFS-10971) Distcp should not copy replication factor if source file is erasure coded

2017-03-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10971 started by Manoj Govindassamy. - > Distcp should not copy replication factor if source file is erasure c

[jira] [Updated] (HDFS-11584) Fix flaky test TestErasureCodeBenchmarkThroughput.testECReadWrite - failed creating new block streams

2017-03-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11584: -- Attachment: TestECCodeBenchmark.fail.log > Fix flaky test TestErasureCodeBenchmarkThroug

[jira] [Created] (HDFS-11584) Fix flaky test TestErasureCodeBenchmarkThroughput.testECReadWrite - failed creating new block streams

2017-03-27 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11584: - Summary: Fix flaky test TestErasureCodeBenchmarkThroughput.testECReadWrite - failed creating new block streams Key: HDFS-11584 URL: https://issues.apache.org/jira/brows

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-20 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15933920#comment-15933920 ] Manoj Govindassamy commented on HDFS-10530: --- Filed HDFS-11552 and HDFS-11552 to

[jira] [Created] (HDFS-11553) Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks

2017-03-20 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11553: - Summary: Erasure Coding: Missing parity blocks in the block group are warned as corrupt blocks Key: HDFS-11553 URL: https://issues.apache.org/jira/browse/HDFS-11553

[jira] [Created] (HDFS-11552) Erasure Coding: Support Parity Blocks placement onto same nodes hosting Data Blocks when DataNodes are insufficient

2017-03-20 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-11552: - Summary: Erasure Coding: Support Parity Blocks placement onto same nodes hosting Data Blocks when DataNodes are insufficient Key: HDFS-11552 URL: https://issues.apache.o

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929217#comment-15929217 ] Manoj Govindassamy commented on HDFS-10530: --- Thanks for the review and commit he

[jira] [Updated] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-16 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10530: -- Attachment: HDFS-10530.5.patch Thanks for the detailed review comments [~tasanuma0829] a

[jira] [Updated] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10530: -- Attachment: HDFS-10530.4.patch Attached v4 patch with latest trunk rebase, and test case

[jira] [Assigned] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-10530: - Assignee: Manoj Govindassamy (was: Rui Gao) Sure, taking up this bug based on pr

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924823#comment-15924823 ] Manoj Govindassamy commented on HDFS-11505: --- Thanks for the review and commit he

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-14 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Release Note: By default, none of the built-in erasure coding policies are enabled. User

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-13 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15923325#comment-15923325 ] Manoj Govindassamy commented on HDFS-11505: --- Above unit test errors are not rela

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-13 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.04.patch Thanks [~andrew.wang] and [~tasanuma0829] for the review

[jira] [Comment Edited] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905908#comment-15905908 ] Manoj Govindassamy edited comment on HDFS-11505 at 3/11/17 12:09 AM: ---

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.03.patch Attaching v03 patch to address the test failures. > Do

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905906#comment-15905906 ] Manoj Govindassamy commented on HDFS-10530: --- bq. isPlacementPolicySatisfied sho

[jira] [Comment Edited] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905864#comment-15905864 ] Manoj Govindassamy edited comment on HDFS-10530 at 3/10/17 11:26 PM: ---

[jira] [Commented] (HDFS-10530) BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy

2017-03-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905864#comment-15905864 ] Manoj Govindassamy commented on HDFS-10530: --- [~demongaorui], [~andrew.wang], [~z

[jira] [Commented] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-03-10 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905825#comment-15905825 ] Manoj Govindassamy commented on HDFS-11340: --- Thanks a lot for the reviews and co

[jira] [Updated] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11340: -- Attachment: HDFS-11340-branch-2.01.patch [~eddyxu], Attached branch2 patch corresponding

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904114#comment-15904114 ] Manoj Govindassamy commented on HDFS-11505: --- Above test failures are from the pa

[jira] [Updated] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11506: -- Status: Patch Available (was: Open) > Move ErasureCodingPolicyManager#getSystemDefaultP

[jira] [Updated] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11506: -- Attachment: HDFS-11506.03.patch Attached v03 patch after the rebase and needed fixes. [~

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903712#comment-15903712 ] Manoj Govindassamy commented on HDFS-11402: --- [~yzhangal], Any review comments on

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Status: Patch Available (was: Open) > Do not enable any erasure coding policies by defa

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.02.patch Attached v02 patch to fix the typo and default policy re

[jira] [Commented] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903583#comment-15903583 ] Manoj Govindassamy commented on HDFS-11486: --- [~jojochuang], Thanks for working

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903564#comment-15903564 ] Manoj Govindassamy commented on HDFS-11499: --- Thanks for digging through the test

[jira] [Comment Edited] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903359#comment-15903359 ] Manoj Govindassamy edited comment on HDFS-11486 at 3/9/17 4:49 PM: -

[jira] [Commented] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-09 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903359#comment-15903359 ] Manoj Govindassamy commented on HDFS-11486: --- [~jojochuang], the decommission fil

[jira] [Updated] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11506: -- Attachment: HDFS-11506.02.patch Thanks for the review [~drankye]. As you suggested, {{St

[jira] [Commented] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901943#comment-15901943 ] Manoj Govindassamy commented on HDFS-11505: --- There were a lot of test failures a

[jira] [Comment Edited] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901943#comment-15901943 ] Manoj Govindassamy edited comment on HDFS-11505 at 3/8/17 8:46 PM: -

[jira] [Updated] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-08 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10983: -- Attachment: HDFS-10983.04.patch [~andrew.wang], Unit test failures from the previous run

[jira] [Commented] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900613#comment-15900613 ] Manoj Govindassamy commented on HDFS-11506: --- Thanks for the quick review [~andre

[jira] [Updated] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11505: -- Attachment: HDFS-11505.01.patch [~andrew.wang], Attached a patch which goes on top of HD

[jira] [Updated] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11506: -- Attachment: HDFS-11506.01.patch Attached v01 patch to address the following. * Moved Era

[jira] [Updated] (HDFS-11340) DataNode reconfigure for disks doesn't remove the failed volumes

2017-03-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11340: -- Attachment: HDFS-11340.05.patch Thanks for the review, [~cnauroth]. Attaching v05 patch

[jira] [Updated] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10983: -- Attachment: HDFS-10983.03.patch [~andrew.wang], Removed the explicit replication field

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898651#comment-15898651 ] Manoj Govindassamy commented on HDFS-11499: --- [~linyiqun], Thanks for the revie

[jira] [Commented] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898592#comment-15898592 ] Manoj Govindassamy commented on HDFS-10983: --- Thanks for the review [~andrew.wang

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11499: -- Attachment: HDFS-11499.03.patch [~lukmajercak], Attached v03 patch to have the same test

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898537#comment-15898537 ] Manoj Govindassamy commented on HDFS-11499: --- [~lukmajercak], Are you referring t

[jira] [Updated] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11499: -- Attachment: HDFS-11499.02.patch [~lukmajercak], [~jojochuang], [~linyiqun], Attached v02

[jira] [Assigned] (HDFS-11505) Do not enable any erasure coding policies by default

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11505: - Assignee: Manoj Govindassamy (was: Andrew Wang) > Do not enable any erasure codi

[jira] [Assigned] (HDFS-11506) Move ErasureCodingPolicyManager#getSystemDefaultPolicy to test code

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-11506: - Assignee: Manoj Govindassamy (was: Andrew Wang) > Move ErasureCodingPolicyManage

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898222#comment-15898222 ] Manoj Govindassamy commented on HDFS-11499: --- yes [~lukmajercak], we need to addi

[jira] [Commented] (HDFS-11499) Decommissioning stuck because of failing recovery

2017-03-06 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898100#comment-15898100 ] Manoj Govindassamy commented on HDFS-11499: --- Sure [~jojochuang]. I can give you

[jira] [Updated] (HDFS-10983) OIV tool should make an EC file explicit

2017-03-03 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10983: -- Attachment: HDFS-10983.02.patch Thanks for the review [~andrew.wang]. Sure, will not in

[jira] [Assigned] (HDFS-9388) Refactor decommission related code to support maintenance state for datanodes

2017-03-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy reassigned HDFS-9388: Assignee: Manoj Govindassamy [~mingma], How about renaming {{DecommissionManager}}

[jira] [Commented] (HDFS-11412) Maintenance minimum replication config value allowable range should be [0, DefaultReplication]

2017-03-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892809#comment-15892809 ] Manoj Govindassamy commented on HDFS-11412: --- Thanks for the quick review and com

[jira] [Updated] (HDFS-11412) Maintenance minimum replication config value allowable range should be [0, DefaultReplication]

2017-03-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11412: -- Attachment: HDFS-11412-branch-2.01.patch [~mingma], attached branch2 patch for the one c

[jira] [Commented] (HDFS-11412) Maintenance minimum replication config value allowable range should be [0, DefaultReplication]

2017-03-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891625#comment-15891625 ] Manoj Govindassamy commented on HDFS-11412: --- Thanks for the review and commit [~

[jira] [Comment Edited] (HDFS-11412) Maintenance minimum replication config value allowable range should be {0 - DefaultReplication}

2017-03-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891363#comment-15891363 ] Manoj Govindassamy edited comment on HDFS-11412 at 3/2/17 12:34 AM:

[jira] [Updated] (HDFS-11412) Maintenance minimum replication config value allowable range should be {0 - DefaultReplication}

2017-03-01 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11412: -- Attachment: HDFS-11412.02.patch [~mingma], bq. Maybe we can modify getMinReplicationToB

<    1   2   3   4   5   6   7   8   9   >