[jira] [Updated] (HDFS-4185) Add a metric for number of active leases

2015-05-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4185: --- Attachment: HDFS-4185-007.patch > Add a metric for number of active leases > --

[jira] [Commented] (HDFS-4185) Add a metric for number of active leases

2015-05-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547076#comment-14547076 ] Rakesh R commented on HDFS-4185: Thanks again [~raviprak] for the advice. IIUC, your sugges

[jira] [Commented] (HDFS-4185) Add a metric for number of active leases

2015-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547137#comment-14547137 ] Hadoop QA commented on HDFS-4185: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547142#comment-14547142 ] Hudson commented on HDFS-8157: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #199 (See [htt

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547144#comment-14547144 ] Hudson commented on HDFS-8157: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #930 (See [https://b

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547166#comment-14547166 ] Kai Sasaki commented on HDFS-8367: -- I checked. Some of these tests fails some time and not

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547184#comment-14547184 ] Hudson commented on HDFS-8157: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2128 (See [https://

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547186#comment-14547186 ] Hudson commented on HDFS-8157: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #188 (See [htt

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547201#comment-14547201 ] Hudson commented on HDFS-8157: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #198 (See

[jira] [Commented] (HDFS-8157) Writes to RAM DISK reserve locked memory for block files

2015-05-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547204#comment-14547204 ] Hudson commented on HDFS-8157: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2146 (See [htt

[jira] [Updated] (HDFS-4185) Add a metric for number of active leases

2015-05-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-4185: --- Attachment: HDFS-4185-008.patch > Add a metric for number of active leases > --

[jira] [Commented] (HDFS-8416) Short circuit remote reads from shared storage

2015-05-17 Thread Ahmed Mahran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547266#comment-14547266 ] Ahmed Mahran commented on HDFS-8416: A high level implementation suggestion: - Add an

[jira] [Commented] (HDFS-4185) Add a metric for number of active leases

2015-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547293#comment-14547293 ] Hadoop QA commented on HDFS-4185: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS

2015-05-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547432#comment-14547432 ] Yi Liu commented on HDFS-8412: -- +1, thanks Uma. > Fix the test failures in HTTPFS > -

[jira] [Updated] (HDFS-8379) Fix issues like NPE in TestRecoverStripedFile

2015-05-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8379: - Resolution: Duplicate Status: Resolved (was: Patch Available) > Fix issues like NPE in TestRecoverStripedF

[jira] [Assigned] (HDFS-7345) Local Repairable Codes (LRC)

2015-05-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7345: Assignee: Yi Liu > Local Repairable Codes (LRC) > > > Key: HDFS

[jira] [Assigned] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

2015-05-17 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned HDFS-8407: -- Assignee: Masatake Iwasaki (was: surendra singh lilhore) > libhdfs hdfsListDirectory()

[jira] [Commented] (HDFS-8407) libhdfs hdfsListDirectory() API has different behavior than documentation

2015-05-17 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547483#comment-14547483 ] Masatake Iwasaki commented on HDFS-8407: Thanks, [~surendrasingh]. I assigned this

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547493#comment-14547493 ] Yi Liu commented on HDFS-8399: -- Please check the latest branch after merge, it should not exis

[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8382: Status: Patch Available (was: In Progress) > Remove chunkSize parameter from initialize method of raw erasur

[jira] [Commented] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547503#comment-14547503 ] Hadoop QA commented on HDFS-8382: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547504#comment-14547504 ] Kai Zheng commented on HDFS-8367: - Sounds good to me. +1 and will commit it shortly. Thanks

[jira] [Updated] (HDFS-8131) Implement a space balanced block placement policy

2015-05-17 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shaohui updated HDFS-8131: -- Attachment: HDFS-8131.005.patch Update for [~kihwal]'s review. Thanks > Implement a space balanced block

[jira] [Updated] (HDFS-8382) Remove chunkSize parameter from initialize method of raw erasure coder

2015-05-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8382: Attachment: HDFS-8382-HDFS-7285-v2.patch Rebased. > Remove chunkSize parameter from initialize method of raw

[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2015-05-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7101: - Description: {code} String lastLine = null; int errCode = -1; try { while ((line = input.readLine

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-05-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Description: Ian Brooks reported the following stack trace: {code} 2014-06-03 13:05:03,915 WARN [DataStreamer for

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547518#comment-14547518 ] Kai Zheng commented on HDFS-8367: - The patch doesn't apply now and needs a non-trivial reba

[jira] [Updated] (HDFS-8352) Erasure Coding: test webhdfs read write stripe file

2015-05-17 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8352: Attachment: HDFS-8352-HDFS-7285.001.patch > Erasure Coding: test webhdfs read write stripe file > ---

[jira] [Updated] (HDFS-8352) Erasure Coding: test webhdfs read write stripe file

2015-05-17 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8352: Attachment: (was: HDFS-8352-HDFS-7285.001.patch) > Erasure Coding: test webhdfs read write stripe file >

[jira] [Created] (HDFS-8417) Erasure Coding: Pread failed to read data starting from last incomplete stripe

2015-05-17 Thread Walter Su (JIRA)
Walter Su created HDFS-8417: --- Summary: Erasure Coding: Pread failed to read data starting from last incomplete stripe Key: HDFS-8417 URL: https://issues.apache.org/jira/browse/HDFS-8417 Project: Hadoop HDFS

[jira] [Created] (HDFS-8418) Fix the isNeededReplication calculation for Striped block in NN

2015-05-17 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8418: Summary: Fix the isNeededReplication calculation for Striped block in NN Key: HDFS-8418 URL: https://issues.apache.org/jira/browse/HDFS-8418 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-8418) Fix the isNeededReplication calculation for Striped block in NN

2015-05-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-8418: - Description: Currently when calculating {{isNeededReplication}} for striped block, we use BlockCollection#getPrefe

[jira] [Commented] (HDFS-7582) Enforce maximum number of ACL entries separately per access and default.

2015-05-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547548#comment-14547548 ] Vinayakumar B commented on HDFS-7582: - [~cnauroth], thanks for looking it again. bq. N

[jira] [Commented] (HDFS-8418) Fix the isNeededReplication calculation for Striped block in NN

2015-05-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547551#comment-14547551 ] Yi Liu commented on HDFS-8418: -- It will cause some unexpected behavior, for example: schedule

[jira] [Commented] (HDFS-8199) Erasure Coding: System test of creating ECZone and EC files.

2015-05-17 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547560#comment-14547560 ] Walter Su commented on HDFS-8199: - Sorry. Mistake. normal files: 13m11s ec files: 45m33s >

[jira] [Updated] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8367: - Attachment: HDFS-8367-HDFS-7285-06.patch > BlockInfoStriped can also receive schema at its creation > -

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547578#comment-14547578 ] Kai Sasaki commented on HDFS-8367: -- [~drankye] Thank you for check. I rebased from HDFS-72

[jira] [Updated] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8367: - Attachment: (was: HDFS-8367-HDFS-7285-06.patch) > BlockInfoStriped can also receive schema at its creat

[jira] [Updated] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

2015-05-17 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8367: - Attachment: HDFS-8367-HDFS-7285-06.patch > BlockInfoStriped can also receive schema at its creation > -

[jira] [Commented] (HDFS-8399) Erasure Coding: BlockManager is unnecessarily computing recovery work for the deleted blocks

2015-05-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14547596#comment-14547596 ] Rakesh R commented on HDFS-8399: Yes, this issue has been resolved after the branch merge.

[jira] [Updated] (HDFS-8375) Add cellSize as an XAttr to ECZone

2015-05-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8375: Attachment: HDFS-8375-HDFS-7285-02.patch Attached patch with {{schema}} to {{ecSchema}} in {{HdfsFile

[jira] [Updated] (HDFS-8375) Add cellSize as an XAttr to ECZone

2015-05-17 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8375: Target Version/s: HDFS-7285 Status: Patch Available (was: Open) > Add cellSize as an X