[jira] [Commented] (HDFS-9714) Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist

2016-01-27 Thread Jake Low (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120312#comment-15120312 ] Jake Low commented on HDFS-9714: Along similar lines, when trying to {{rename2}} with {{src}} being a file

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120515#comment-15120515 ] GAO Rui commented on HDFS-9494: --- Thanks for your comments [~jingzhao]. bq. In DFSStripedOutputStream, we

[jira] [Updated] (HDFS-9712) libhdfs++: Reimplement Status object as a normal struct

2016-01-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9712: -- Attachment: HDFS-9712.HDFS-8707.000.patch > libhdfs++: Reimplement Status object as a normal

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9677: Priority: Minor (was: Major) > Rename generationStampV1/generationStampV2 to >

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9677: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Target Version/s:

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120452#comment-15120452 ] Mingliang Liu commented on HDFS-9677: - Thanks for the commit, [~jingzhao]! > Rename

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120503#comment-15120503 ] Hudson commented on HDFS-9677: -- FAILURE: Integrated in Hadoop-trunk-Commit #9195 (See

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120527#comment-15120527 ] Hadoop QA commented on HDFS-9711: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9714) Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist

2016-01-27 Thread Jake Low (JIRA)
Jake Low created HDFS-9714: -- Summary: Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist Key: HDFS-9714 URL: https://issues.apache.org/jira/browse/HDFS-9714 Project:

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS Update (write-in-place)

2016-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120280#comment-15120280 ] Konstantin Shvachko commented on HDFS-9607: --- > Even though HDFS files stores bytes, from a users

[jira] [Updated] (HDFS-9714) Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist

2016-01-27 Thread Jake Low (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jake Low updated HDFS-9714: --- Description: It looks like [HDFS-7509|https://issues.apache.org/jira/browse/HDFS-7509] broke the semantics of

[jira] [Commented] (HDFS-9714) Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist

2016-01-27 Thread Jake Low (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120512#comment-15120512 ] Jake Low commented on HDFS-9714: I've just tested 2.6.3 and 2.5.2; this issue exists there as well. I was

[jira] [Commented] (HDFS-9686) Remove useless boxing/unboxing code (Hadoop HDFS)

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120539#comment-15120539 ] Hadoop QA commented on HDFS-9686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120540#comment-15120540 ] GAO Rui commented on HDFS-9494: --- BTW. will it reduce the resource cost to make

[jira] [Updated] (HDFS-9714) Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist

2016-01-27 Thread Jake Low (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jake Low updated HDFS-9714: --- Description: It looks like [HDFS-7509|https://issues.apache.org/jira/browse/HDFS-7509] broke the semantics of

[jira] [Updated] (HDFS-9714) Rename throws AccessControlException (not FileNotFoundException) when src doesn't exist

2016-01-27 Thread Jake Low (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jake Low updated HDFS-9714: --- Description: It looks like [HDFS-7509|https://issues.apache.org/jira/browse/HDFS-7509] broke the semantics of

[jira] [Updated] (HDFS-9712) libhdfs++: Reimplement Status object as a normal struct

2016-01-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9712: -- Status: Patch Available (was: Open) > libhdfs++: Reimplement Status object as a normal struct >

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-01-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Attachment: HDFS-9715.00.patch Add a patch to check the existence of StorageUUID in

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-01-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Status: Patch Available (was: Open) > Check storage ID uniqueness on datanode startup >

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120533#comment-15120533 ] Hudson commented on HDFS-9677: -- FAILURE: Integrated in Hadoop-trunk-Commit #9196 (See

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120338#comment-15120338 ] Jing Zhao commented on HDFS-9494: - Thanks [~demongaorui]. The 07 patch looks good to me. Some minor

[jira] [Created] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-01-27 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-9715: --- Summary: Check storage ID uniqueness on datanode startup Key: HDFS-9715 URL: https://issues.apache.org/jira/browse/HDFS-9715 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6183) TestWebHDFS may fail with "Namenode is in startup mode"

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120569#comment-15120569 ] Mingliang Liu commented on HDFS-6183: - Still happens intermittently in recent builds, e.g.

[jira] [Updated] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9677: Attachment: HDFS-9677-branch-2.000.patch Thanks for your review [~jingzhao]. Attached the patch for

[jira] [Created] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-01-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9716: --- Summary: o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk Key: HDFS-9716 URL: https://issues.apache.org/jira/browse/HDFS-9716 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120586#comment-15120586 ] Mingliang Liu commented on HDFS-9708: - {{hadoop.hdfs.TestRecoverStripedFile}} is flaky and tracked by

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8999: -- Attachment: h8999_20160121c_branch-2.patch Thanks Jing for reviewing the branch-2 patch!

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120843#comment-15120843 ] Xiaobing Zhou commented on HDFS-9701: - Thanks [~xiaochen] for the work. Could you explain why the

[jira] [Updated] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9494: -- Status: In Progress (was: Patch Available) > Parallel optimization of DFSStripedOutputStream#flushAllInternals(

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120633#comment-15120633 ] Jing Zhao commented on HDFS-9494: - I think we can still keep flushAllExecutorCompletionService as a class

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2016-01-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120662#comment-15120662 ] Hudson commented on HDFS-8578: -- FAILURE: Integrated in Hadoop-trunk-Commit #9198 (See

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120664#comment-15120664 ] Hudson commented on HDFS-9654: -- FAILURE: Integrated in Hadoop-trunk-Commit #9198 (See

[jira] [Created] (HDFS-9717) NameNode can not update the status of bad block

2016-01-27 Thread tangshangwen (JIRA)
tangshangwen created HDFS-9717: -- Summary: NameNode can not update the status of bad block Key: HDFS-9717 URL: https://issues.apache.org/jira/browse/HDFS-9717 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9654: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2016-01-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8578: -- Attachment: h8578_20160128.patch HDFS-9654 is now committed (thanks [~vinayrpet] and

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120792#comment-15120792 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120834#comment-15120834 ] GAO Rui commented on HDFS-9494: --- Oh, I see. I am agree with you. I have upload an new 08 patch to address

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120837#comment-15120837 ] Rakesh R commented on HDFS-7955: oops, my previous patch was wrong. I've attached another one. Due to

[jira] [Updated] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8999: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-8430) Erasure coding: compute file checksum for stripe files

2016-01-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120749#comment-15120749 ] Kai Zheng commented on HDFS-8430: - Some patch attached on HDFS-9694. Am working on the recovery case, as

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120859#comment-15120859 ] Xiao Chen commented on HDFS-9701: - Thanks [~xiaobingo] for looking at this. We actually have multiple locks

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120875#comment-15120875 ] Kai Zheng commented on HDFS-7955: - Thanks for the discussions. I have two questions. * Considering in most

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120593#comment-15120593 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120606#comment-15120606 ] Hadoop QA commented on HDFS-9715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-01-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9694: Attachment: HDFS-9694-v1.patch Uploaded a patch. [~szetszwo], could you help take a quick look at it? As the

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120863#comment-15120863 ] Hadoop QA commented on HDFS-9494: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9677) Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp

2016-01-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120373#comment-15120373 ] Jing Zhao commented on HDFS-9677: - Thanks for the work Mingliang! Thanks for the review, [~vinayrpet]! The

[jira] [Commented] (HDFS-8999) Namenode need not wait for {{blockReceived}} for the last block before completing a file.

2016-01-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120384#comment-15120384 ] Jing Zhao commented on HDFS-8999: - Thanks for posting the branch-2 patch, Nicholas! The branch-2 patch

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120496#comment-15120496 ] Hadoop QA commented on HDFS-9708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9712) libhdfs++: Reimplement Status object as a normal struct

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120511#comment-15120511 ] Hadoop QA commented on HDFS-9712: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120575#comment-15120575 ] Xiao Chen commented on HDFS-9701: - Failed tests seem unrelated and are known to be flaky (e.g. HDFS-9466)

[jira] [Updated] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9494: -- Attachment: HDFS-9494-origin-trunk.07.patch > Parallel optimization of DFSStripedOutputStream#flushAllInternals(

[jira] [Updated] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-01-27 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9494: -- Status: In Progress (was: Patch Available) > Parallel optimization of DFSStripedOutputStream#flushAllInternals(

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

2016-01-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119738#comment-15119738 ] Junping Du commented on HDFS-7694: -- I have cherry-pick it to branch-2.6. > FSDataInputStream should

[jira] [Updated] (HDFS-7694) FSDataInputStream should support "unbuffer"

2016-01-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7694: - Fix Version/s: 2.6.4 > FSDataInputStream should support "unbuffer" >

[jira] [Updated] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9701: Attachment: HDFS-9701.05.patch > DN may deadlock when hot-swapping under load >

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119761#comment-15119761 ] Xiao Chen commented on HDFS-9701: - Ah Good catch [~vinayrpet]! And thanks for reviewing. I added the second

[jira] [Commented] (HDFS-9705) Refine the behaviour of getFileChecksum when length = 0

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119711#comment-15119711 ] Hadoop QA commented on HDFS-9705: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119714#comment-15119714 ] Yongjun Zhang commented on HDFS-9706: - Hi [~xiaochen], Thanks for working on this. Couple of

[jira] [Commented] (HDFS-9713) DataXceiver#copyBlock should return if block is pinned

2016-01-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120939#comment-15120939 ] Kai Zheng commented on HDFS-9713: - Good catch Uma. I thought you're right. > DataXceiver#copyBlock should

[jira] [Created] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-01-27 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9719: --- Summary: Refactoring ErasureCodingWorker into smaller reusable constructs Key: HDFS-9719 URL: https://issues.apache.org/jira/browse/HDFS-9719 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9406) FSImage corruption after taking snapshot

2016-01-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Status: Patch Available (was: Open) > FSImage corruption after taking snapshot >

[jira] [Updated] (HDFS-9406) FSImage corruption after taking snapshot

2016-01-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Attachment: HDFS-9406.001.patch > FSImage corruption after taking snapshot >

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120935#comment-15120935 ] Hadoop QA commented on HDFS-7955: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2016-01-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-9657: Attachment: HDFS-9657-001.patch > Schedule EC tasks at proper time to reduce the impact of recovery traffic >

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-01-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120958#comment-15120958 ] Kai Zheng commented on HDFS-9694: - Am working on datanode failure error handling case where data of

[jira] [Updated] (HDFS-9718) NameNode#initializeGenericKeys don't unset the property while it is not assign on special nnId

2016-01-27 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-9718: --- Attachment: HDFS-9718.001.patch > NameNode#initializeGenericKeys don't unset the property while it is not >

[jira] [Updated] (HDFS-9717) NameNode can not update the status of bad block

2016-01-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-9717: - Component/s: namenode > NameNode can not update the status of bad block >

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119890#comment-15119890 ] Yongjun Zhang commented on HDFS-9706: - Thanks Xiao for the new rev. One further suggestion is, we can

[jira] [Updated] (HDFS-9686) Remove useless boxing/unboxing code (Hadoop HDFS)

2016-01-27 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated HDFS-9686: - Attachment: (was: HDFS-9686.patch.0) > Remove useless boxing/unboxing code (Hadoop HDFS) >

[jira] [Updated] (HDFS-9686) Remove useless boxing/unboxing code (Hadoop HDFS)

2016-01-27 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated HDFS-9686: - Attachment: HDFS-9686.0.patch Fixed style. > Remove useless boxing/unboxing code (Hadoop HDFS) >

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Attachment: HDFS-9706.02.patch > Log more details in debug logs in BlockReceiver's constructor >

[jira] [Commented] (HDFS-9684) DataNode stopped sending heartbeat after getting OutOfMemoryError form DataTransfer thread.

2016-01-27 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119871#comment-15119871 ] Surendra Singh Lilhore commented on HDFS-9684: -- Yes, DN should have some healthcheck to

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119862#comment-15119862 ] Xiao Chen commented on HDFS-9706: - Thanks Yongjun for the comments. I agree with your suggestions. Patch 2

[jira] [Commented] (HDFS-8960) DFS client says "no more good datanodes being available to try" on a single drive failure

2016-01-27 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119793#comment-15119793 ] Ruslan Dautkhanov commented on HDFS-8960: - We seems getting the same problem on a Hive job too:

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Attachment: HDFS-9706.02.patch > Log more details in debug logs in BlockReceiver's constructor >

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Attachment: (was: HDFS-9706.02.patch) > Log more details in debug logs in BlockReceiver's constructor >

[jira] [Updated] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9706: Attachment: HDFS-9706.03.patch Thanks Yongjun for the advice, makes sense to me. Attaching patch 3 per

[jira] [Updated] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7955: --- Attachment: HDFS-7955-002.patch > Improve naming of classes, methods, and variables related to block >

[jira] [Commented] (HDFS-9330) Support reconfiguring dfs.datanode.duplicate.replica.deletion without DN restart

2016-01-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120005#comment-15120005 ] Xiaobing Zhou commented on HDFS-9330: - Thanks [~arpitagarwal] for quite detailed reviews. I posted V004

[jira] [Updated] (HDFS-9330) Support reconfiguring dfs.datanode.duplicate.replica.deletion without DN restart

2016-01-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Attachment: HDFS-9330-HDFS-9000.004.patch > Support reconfiguring

[jira] [Commented] (HDFS-9654) Code refactoring for HDFS-8578

2016-01-27 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119965#comment-15119965 ] Chris Trezzo commented on HDFS-9654: Sounds good! +1 on the patch. Thanks [~szetszwo]. > Code

[jira] [Updated] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7955: --- Component/s: erasure-coding > Improve naming of classes, methods, and variables related to block >

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120011#comment-15120011 ] Yongjun Zhang commented on HDFS-9706: - Thanks Xiao for the new rev. +1 pending jenkins. > Log more

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119989#comment-15119989 ] Rakesh R commented on HDFS-7955: Thank you [~zhz], [~andrew.wang], [~szetszwo] for the review comments so

[jira] [Updated] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7955: --- Status: Patch Available (was: In Progress) > Improve naming of classes, methods, and variables related to

[jira] [Commented] (HDFS-9610) test_libhdfs_threaded_hdfs_static generates a lot of noise on stderr which looks like a failure even though it isn't

2016-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120033#comment-15120033 ] Colin Patrick McCabe commented on HDFS-9610: The cmakebuilder maven plugin always puts stderr

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2016-01-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120032#comment-15120032 ] Xiaobing Zhou commented on HDFS-6808: - Thanks [~arpitagarwal] for the point. I think the inconsistency

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120034#comment-15120034 ] Hadoop QA commented on HDFS-9701: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120069#comment-15120069 ] Hadoop QA commented on HDFS-7955: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120091#comment-15120091 ] Hadoop QA commented on HDFS-9706: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120097#comment-15120097 ] Xiao Chen commented on HDFS-9706: - Thanks Yongjun! Failed tests look unrelated, and as mentioned earlier,

[jira] [Issue Comment Deleted] (HDFS-7035) Make adding a new data directory to the DataNode an atomic operation and improve error handling

2016-01-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7035: Comment: was deleted (was: -There is probably one more bug. The behavior of {{ReconfigurableBase}}

[jira] [Commented] (HDFS-7035) Make adding a new data directory to the DataNode an atomic operation and improve error handling

2016-01-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120051#comment-15120051 ] Arpit Agarwal commented on HDFS-7035: - bq. If it is a concern in HDFS-9330, can we suggest

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2016-01-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120054#comment-15120054 ] Arpit Agarwal commented on HDFS-6808: - Hi Xiaobing, we can continue the discussion on HDFS-7035 since

[jira] [Commented] (HDFS-9706) Log more details in debug logs in BlockReceiver's constructor

2016-01-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120109#comment-15120109 ] Hadoop QA commented on HDFS-9706: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-01-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9555: - Target Version/s: 2.6.5 (was: 2.6.4) > LazyPersistFileScrubber should still sleep if there are errors in

[jira] [Commented] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2016-01-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120147#comment-15120147 ] Junping Du commented on HDFS-9555: -- Move all non-critical pending issues out of 2.6.4 into 2.6.5. >

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-01-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120164#comment-15120164 ] Zhe Zhang commented on HDFS-7955: - Thanks Rakesh! Not sure why Jenkins couldn't apply the patch on trunk, I

[jira] [Created] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-01-27 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-9711: --- Summary: Integrate CSRF prevention filter in WebHDFS. Key: HDFS-9711 URL: https://issues.apache.org/jira/browse/HDFS-9711 Project: Hadoop HDFS Issue Type: New

  1   2   >