[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701256#comment-15701256 ] Akira Ajisaka commented on HDFS-11180: -- Agreed. Using separate readwrite lock makes t

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180.01.patch 01: Use ReentrantReadWriteLock. > Intermittent deadlock in NameNo

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701317#comment-15701317 ] Hadoop QA commented on HDFS-11178: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701339#comment-15701339 ] Akira Ajisaka commented on HDFS-11180: -- Rethinking this, 01 patch is no-op. Calling s

[jira] [Comment Edited] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701339#comment-15701339 ] Akira Ajisaka edited comment on HDFS-11180 at 11/28/16 8:53 AM:

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701354#comment-15701354 ] Abhishek Modi commented on HDFS-11180: -- Thanks Akira for quick response. I am not muc

[jira] [Commented] (HDFS-4538) allow use of legacy blockreader

2016-11-28 Thread 5feixiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701626#comment-15701626 ] 5feixiang commented on HDFS-4538: - How to get short-circuit read bytes and time? > allow

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701679#comment-15701679 ] SammiChen commented on HDFS-10994: -- Thanks Kai very much for reviewing the patch and comm

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v1.patch Initial patch! > Add ability to unset and change directory EC policy > --

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Status: Patch Available (was: Open) > Add ability to unset and change directory EC policy > -

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15701787#comment-15701787 ] SammiChen commented on HDFS-11072: -- Thanks [~andrew.wang] and [~rakeshr] for your discuss

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-10885: Attachment: HDFS-10885-HDFS-10285.08.patch Hi, [~rakeshr], the patch is updated. After discussed offline wit

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702006#comment-15702006 ] Hadoop QA commented on HDFS-11072: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702046#comment-15702046 ] Hadoop QA commented on HDFS-10885: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v2.patch 1. fix style issues 2. add more test case 3. solve failed test case > Add

[jira] [Updated] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Attachment: HDFS-11072-v2.patch 1. fix style issues 2. add more test case 3. solve failed test case > Add

[jira] [Commented] (HDFS-11112) Journal Nodes should refuse to format non-empty directories

2016-11-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702231#comment-15702231 ] Wei-Chiu Chuang commented on HDFS-2: I see, [~arpitagarwal]. In that case the

[jira] [Updated] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11181: --- Attachment: HDFS-11181.001.patch Upload a patch to fix the typo. > Fuse wrapper has a typo >

[jira] [Created] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11181: -- Summary: Fuse wrapper has a typo Key: HDFS-11181 URL: https://issues.apache.org/jira/browse/HDFS-11181 Project: Hadoop HDFS Issue Type: Bug Com

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702354#comment-15702354 ] Kihwal Lee commented on HDFS-11180: --- bq. NameNode holds a lock of FSEditLog and requires

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180.02.patch Thanks Abhishek and Kihwal for the comments. 02 patch: 00 patch +

[jira] [Comment Edited] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702380#comment-15702380 ] Akira Ajisaka edited comment on HDFS-11180 at 11/28/16 4:24 PM:

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2016-11-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702434#comment-15702434 ] Daryn Sharp commented on HDFS-8674: --- I'll update this patch. > Improve performance of po

[jira] [Updated] (HDFS-4389) Non-HA DFSClients do not attempt reconnects

2016-11-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4389: -- Target Version/s: 2.9.0, 3.0.0-alpha2 (was: 2.8.0, 3.0.0-alpha2) > Non-HA DFSClients do not attempt reco

[jira] [Updated] (HDFS-4493) webhdfs fails after SPNEGO token expires

2016-11-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-4493: -- Target Version/s: 2.9.0, 3.0.0-alpha2 (was: 2.8.0, 3.0.0-alpha2) > webhdfs fails after SPNEGO token expi

[jira] [Commented] (HDFS-11150) [SPS]: Provide persistence when satisfying storage policy.

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702487#comment-15702487 ] Rakesh R commented on HDFS-11150: - Thank you [~yuanbo] for the patch. Just few comments,

[jira] [Commented] (HDFS-11146) Excess replicas will not be deleted until all storages's FBR received after failover

2016-11-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702527#comment-15702527 ] Brahma Reddy Battula commented on HDFS-11146: - Test failures are unrelated,[~k

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-11-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702541#comment-15702541 ] Brahma Reddy Battula commented on HDFS-9483: [~surendrasingh] thanks for updati

[jira] [Comment Edited] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-11-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702541#comment-15702541 ] Brahma Reddy Battula edited comment on HDFS-9483 at 11/28/16 5:19 PM: ---

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702577#comment-15702577 ] Hadoop QA commented on HDFS-9483: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702598#comment-15702598 ] Hadoop QA commented on HDFS-11072: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11171) add metric to report client shortcircuit reads

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11171: - Status: Open (was: Patch Available) > add metric to report client shortcircuit reads > --

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.03.patch Fix issues flagged by Jenkins. > Support for parallel checking of

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702726#comment-15702726 ] Rakesh R commented on HDFS-10885: - Thanks [~zhouwei] for the good work. I'm +1 for the lat

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.04.patch v04 patch adds a test case for disk check hang. > Support for par

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702884#comment-15702884 ] Andrew Wang commented on HDFS-10994: Nice work here Sammi! Do we also need a follow on

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702928#comment-15702928 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Assignee: Akira Ajisaka Target Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2, 2.6.6

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Priority: Blocker (was: Major) > Intermittent deadlock in NameNode when failover happens. > -

[jira] [Commented] (HDFS-10206) getBlockLocations might not sort datanodes properly by distance

2016-11-28 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15702984#comment-15702984 ] Ming Ma commented on HDFS-10206: * NetworkTopology can be used by HDFS, YARN and MAPREDUCE

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703055#comment-15703055 ] Hadoop QA commented on HDFS-11149: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6984: -- Target Version/s: 3.0.0-alpha2 (was: ) Setting target version for tracking. > In Hadoop 3, make FileSta

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.05.patch v05 patch fixes checkstyle issues. > Support for parallel checkin

[jira] [Commented] (HDFS-11156) Webhdfs rest api GET_BLOCK_LOCATIONS output doesn't comply with FileSystem API

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703132#comment-15703132 ] Mingliang Liu commented on HDFS-11156: -- The patch looks good to me overall. +1 I hav

[jira] [Updated] (HDFS-5517) Lower the default maximum number of blocks per file

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5517: -- Attachment: HDFS-5517.002.patch I did the trival rebase for this change, patch attached. > Lower the def

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703169#comment-15703169 ] Wei-Chiu Chuang commented on HDFS-11179: [~tasanuma0829] thanks for filing the bug

[jira] [Created] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11182: Summary: Update DataNode to use DatasetVolumeChecker Key: HDFS-11182 URL: https://issues.apache.org/jira/browse/HDFS-11182 Project: Hadoop HDFS Issue Type: S

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703262#comment-15703262 ] Akira Ajisaka commented on HDFS-11180: -- Cancelling patch because we need to create un

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703280#comment-15703280 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11152) Start erasure coding policy ID number from 1 instead of 0 to void potential unexpected errors

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703291#comment-15703291 ] Andrew Wang commented on HDFS-11152: Hi Sammi, thanks for the patch. Looks good overal

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703372#comment-15703372 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Attachment: HDFS-10930.07.patch Thanks [~arpitagarwal] for the review. I've updated the patch based on t

[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703397#comment-15703397 ] Hadoop QA commented on HDFS-5517: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes > ---

[jira] [Updated] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11180: - Attachment: HDFS-11180.03.patch 03 patch: * Added a regression test * Updated FSEditLog and some m

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.06.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes > ---

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.06.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes > ---

[jira] [Commented] (HDFS-8678) Bring back the feature to view chunks of files in the HDFS file browser

2016-11-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703425#comment-15703425 ] Allen Wittenauer commented on HDFS-8678: We should probably move the block informat

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.06.patch > Support for parallel checking of FsVolumes > ---

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: (was: HDFS-11149.06.patch) > Support for parallel checking of FsVolumes >

[jira] [Updated] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-11179: -- Target Version/s: 3.0.0-alpha2 (was: 2.8.0, 3.0.0-alpha2) > LightWeightHashSet can't remove blocks corr

[jira] [Commented] (HDFS-11179) LightWeightHashSet can't remove blocks correctly which have a large number blockId

2016-11-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703429#comment-15703429 ] Junping Du commented on HDFS-11179: --- Agree with [~jojochuang]. Especially, this EC staff

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703492#comment-15703492 ] Mingliang Liu commented on HDFS-11178: -- Is {{MiniDFSCluster#triggerBlockReports()}} b

[jira] [Updated] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11106: --- Attachment: HDFS-11106.HDFS-8707.000.patch First pass, added a few comments but otherwise didn

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703661#comment-15703661 ] Hadoop QA commented on HDFS-11149: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703701#comment-15703701 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703763#comment-15703763 ] Hadoop QA commented on HDFS-10930: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11178) TestAddStripedBlockInFBR#testAddBlockInFullBlockReport fails frequently in trunk

2016-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703765#comment-15703765 ] Yiqun Lin commented on HDFS-11178: -- Thanks [~liuml07] for taking a look. {quote} Is MiniD

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.07.patch v07 patch adds a new test case (testCheckingClosedVolume). > Supp

[jira] [Commented] (HDFS-11181) Fuse wrapper has a typo

2016-11-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703778#comment-15703778 ] Yiqun Lin commented on HDFS-11181: -- +1 for the fix, you forget to click the "submit patch

[jira] [Updated] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11106: --- Status: Patch Available (was: Open) > libhdfs++: Some refactoring to better organize files >

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703804#comment-15703804 ] ASF GitHub Bot commented on HDFS-11182: --- GitHub user arp7 opened a pull request:

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Status: Patch Available (was: Open) > Update DataNode to use DatasetVolumeChecker > -

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Attachment: HDFS-11182.01.patch v01 patch for Jenkins run. > Update DataNode to use DatasetVolume

[jira] [Commented] (HDFS-11180) Intermittent deadlock in NameNode when failover happens.

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703810#comment-15703810 ] Hadoop QA commented on HDFS-11180: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10930) Refactor: Wrap Datanode IO related operations

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703819#comment-15703819 ] Arpit Agarwal commented on HDFS-10930: -- +1 for the v07 patch pending Jenkins. Thanks

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Attachment: (was: HDFS-11182.01.patch) > Update DataNode to use DatasetVolumeChecker > ---

[jira] [Updated] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11182: - Status: Open (was: Patch Available) > Update DataNode to use DatasetVolumeChecker > -

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-11-28 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703882#comment-15703882 ] Jingcheng Du commented on HDFS-9668: Hi [~arpitagarwal], would you mind reviewing the p

[jira] [Commented] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703890#comment-15703890 ] Mingliang Liu commented on HDFS-11094: -- Hi [~ebadger], thanks for updating the patch.

[jira] [Created] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2016-11-28 Thread SammiChen (JIRA)
SammiChen created HDFS-11183: Summary: Document XOR policy XOR-2-1-64k support in HDFS Key: HDFS-11183 URL: https://issues.apache.org/jira/browse/HDFS-11183 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-10994) Support an XOR policy XOR-2-1-64k in HDFS

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703898#comment-15703898 ] SammiChen commented on HDFS-10994: -- Thanks Andrew for the remider! I created JIRA HDFS-11

[jira] [Issue Comment Deleted] (HDFS-11072) Add ability to unset and change directory EC policy

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11072: - Comment: was deleted (was: 1. fix style issues 2. add more test case 3. solve failed test case) > Add abi

[jira] [Comment Edited] (HDFS-11094) Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter

2016-11-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703890#comment-15703890 ] Mingliang Liu edited comment on HDFS-11094 at 11/29/16 2:18 AM:

[jira] [Updated] (HDFS-10860) Switch HttpFS to from Tomcat to Jetty

2016-11-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Summary: Switch HttpFS to from Tomcat to Jetty (was: Switch HttpFS to use Jetty) > Switch HttpFS to fr

[jira] [Updated] (HDFS-10860) Switch HttpFS to use Jetty

2016-11-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Hadoop Flags: Incompatible change > Switch HttpFS to use Jetty > -- > >

[jira] [Work started] (HDFS-10860) Switch HttpFS to from Tomcat to Jetty

2016-11-28 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10860 started by John Zhuge. - > Switch HttpFS to from Tomcat to Jetty > - > >

[jira] [Updated] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2016-11-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11183: --- Affects Version/s: 3.0.0-alpha2 Target Version/s: 3.0.0-alpha2 Thanks for filing this Sammi, sett

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.08.patch The v08 patch adds throttling and a few more unit tests. This is

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703964#comment-15703964 ] Hadoop QA commented on HDFS-11106: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11183) Document XOR policy XOR-2-1-64k support in HDFS

2016-11-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703966#comment-15703966 ] SammiChen commented on HDFS-11183: -- Thanks Andrew, I will fill the affects and targets ve

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703974#comment-15703974 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11149: - Attachment: HDFS-11149.09.patch > Support for parallel checking of FsVolumes > ---

[jira] [Commented] (HDFS-11182) Update DataNode to use DatasetVolumeChecker

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15704052#comment-15704052 ] Hadoop QA commented on HDFS-11182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-11-28 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-10885: Attachment: HDFS-10885-HDFS-10285.09.patch Thanks [~rakeshr] for the suggestions! The failures reported are

[jira] [Commented] (HDFS-11149) Support for parallel checking of FsVolumes

2016-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15704110#comment-15704110 ] Hadoop QA commented on HDFS-11149: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-11-28 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Patch Available (was: Open) > Datanode support to read from external stores. >

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2016-11-28 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Attachment: HDFS-10675-HDFS-9806.003.patch Updated patch to fix failing test cases, and

  1   2   >