[jira] [Commented] (HDFS-5640) Add snapshot methods to FileContext.

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366728#comment-14366728 ] Hadoop QA commented on HDFS-5640: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7950) Fix TestFsDatasetImpl#testAddVolumes failure on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7950: - Status: Open (was: Patch Available) > Fix TestFsDatasetImpl#testAddVolumes failure on Windows > --

[jira] [Assigned] (HDFS-7661) Support read when a EC file is being written

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-7661: - Assignee: GAO Rui (was: Tsz Wo Nicholas Sze) > Support read when a EC file is bei

[jira] [Updated] (HDFS-7950) Fix TestFsDatasetImpl#testAddVolumes failure on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7950: - Status: Patch Available (was: Open) > Fix TestFsDatasetImpl#testAddVolumes failure on Windows > --

[jira] [Updated] (HDFS-7950) Fix TestFsDatasetImpl#testAddVolumes failure on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7950: - Attachment: HDFS-7950.00.patch > Fix TestFsDatasetImpl#testAddVolumes failure on Windows >

[jira] [Created] (HDFS-7950) Fix TestFsDatasetImpl#testAddVolumes failure on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7950: Summary: Fix TestFsDatasetImpl#testAddVolumes failure on Windows Key: HDFS-7950 URL: https://issues.apache.org/jira/browse/HDFS-7950 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7792) Add links to FaultInjectFramework and SLGUserGuide to site index

2015-03-17 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366655#comment-14366655 ] Masatake Iwasaki commented on HDFS-7792: Fault Injection Framework does not work in

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-17 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366652#comment-14366652 ] Walter Su commented on HDFS-7891: - 3rd. network topology of 1k nodes cannot compare to the

[jira] [Updated] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-17 Thread Hui Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Zheng updated HDFS-7827: Attachment: HDFS-7827.003.patch > Erasure Coding: support striped blocks in non-protobuf fsimage > --

[jira] [Updated] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-17 Thread Hui Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Zheng updated HDFS-7827: Attachment: (was: HDFS-7827.001.patch) > Erasure Coding: support striped blocks in non-protobuf fsimage >

[jira] [Updated] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-17 Thread Hui Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Zheng updated HDFS-7827: Attachment: (was: HDFS-7285.003.patch) > Erasure Coding: support striped blocks in non-protobuf fsimage >

[jira] [Updated] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-17 Thread Hui Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Zheng updated HDFS-7827: Attachment: HDFS-7285.003.patch Hi Jing I updated the patch,please review it. 1) Corrected the {code}writeIN

[jira] [Created] (HDFS-7949) WebImageViewer need support file size calculation with striped blocks

2015-03-17 Thread Hui Zheng (JIRA)
Hui Zheng created HDFS-7949: --- Summary: WebImageViewer need support file size calculation with striped blocks Key: HDFS-7949 URL: https://issues.apache.org/jira/browse/HDFS-7949 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366647#comment-14366647 ] Hadoop QA commented on HDFS-7829: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7948) TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7948: - Attachment: HDFS-7948.00.patch > TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows > -

[jira] [Updated] (HDFS-7948) TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7948: - Status: Patch Available (was: Open) > TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows >

[jira] [Created] (HDFS-7948) TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7948: Summary: TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows Key: HDFS-7948 URL: https://issues.apache.org/jira/browse/HDFS-7948 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE on Windows

2015-03-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366635#comment-14366635 ] Hudson commented on HDFS-7946: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7355 (See [https:

[jira] [Updated] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE on Windows

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7946: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE on Windows

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7946: Summary: TestDataNodeVolumeFailureReporting NPE on Windows (was: TestDataNodeVolumeFailureReporting

[jira] [Commented] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-17 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366605#comment-14366605 ] Walter Su commented on HDFS-7891: - Thanks [~zhz], the approach is much simple. Could you he

[jira] [Commented] (HDFS-7881) TestHftpFileSystem#testSeek fails in branch-2

2015-03-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366604#comment-14366604 ] Brahma Reddy Battula commented on HDFS-7881: Test failures are unrelated this j

[jira] [Commented] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366581#comment-14366581 ] Hadoop QA commented on HDFS-7946: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366571#comment-14366571 ] Hadoop QA commented on HDFS-7929: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7618) Support read when a file is being encoded/decoded

2015-03-17 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366557#comment-14366557 ] GAO Rui commented on HDFS-7618: --- Sure态these two liras are closely related to each other. I wi

[jira] [Commented] (HDFS-7618) Support read when a file is being encoded/decoded

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366552#comment-14366552 ] Tsz Wo Nicholas Sze commented on HDFS-7618: --- Yes, the EC storage policy was added

[jira] [Updated] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-17 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7891: Attachment: testresult.txt PlacementPolicyBenchmark.txt > A block placement policy with best

[jira] [Updated] (HDFS-5640) Add snapshot methods to FileContext.

2015-03-17 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-5640: --- Attachment: HDFS-5640-002.patch Re-attaching the previous patch to trigger jenkins. > Add snapshot methods to

[jira] [Commented] (HDFS-7945) The WebHdfs system on DN does not honor the length parameter

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366537#comment-14366537 ] Hadoop QA commented on HDFS-7945: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366513#comment-14366513 ] Tsz Wo Nicholas Sze commented on HDFS-7943: --- Is it possible to change append so t

[jira] [Commented] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366502#comment-14366502 ] Tsz Wo Nicholas Sze commented on HDFS-7943: --- Oops, my previous comment was for HD

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366499#comment-14366499 ] Tsz Wo Nicholas Sze commented on HDFS-7587: --- - In verifyQuotaForUCBlock, -* let's

[jira] [Commented] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366496#comment-14366496 ] Tsz Wo Nicholas Sze commented on HDFS-7943: --- - In verifyQuotaForUCBlock, -* let's

[jira] [Commented] (HDFS-7618) Support read when a file is being encoded/decoded

2015-03-17 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366482#comment-14366482 ] GAO Rui commented on HDFS-7618: --- [~szetszwo] Is the related code of storage policy changing a

[jira] [Updated] (HDFS-7618) Support read when a file is being encoded/decoded

2015-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7618: -- Assignee: GAO Rui (was: Tsz Wo Nicholas Sze) Sure, thanks for picking this up. > Suppor

[jira] [Commented] (HDFS-7618) Support read when a file is being encoded/decoded

2015-03-17 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366447#comment-14366447 ] GAO Rui commented on HDFS-7618: --- [~szetszwo] I want to work on this jira, could you assign it

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-17 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Status: Patch Available (was: Open) > Code clean up for LocatedBlock > ---

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-17 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Attachment: HDFS-7829.4.patch Jnkins did not run. I submit my patch again to start another Jenk

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-17 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Attachment: (was: HDFS-7829.4.patch) > Code clean up for LocatedBlock > ---

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-17 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Status: Open (was: Patch Available) > Code clean up for LocatedBlock > ---

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366429#comment-14366429 ] Jing Zhao commented on HDFS-7285: - I think in most cases this conversion should happen in t

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366408#comment-14366408 ] Jing Zhao commented on HDFS-7369: - Thanks for updating the patch, Zhe! I will review the pa

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366400#comment-14366400 ] Hadoop QA commented on HDFS-7878: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366399#comment-14366399 ] Zhe Zhang commented on HDFS-7285: - Thanks Jing for the insights! I certainly agree there ar

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366383#comment-14366383 ] Hadoop QA commented on HDFS-7587: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-03-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7929: Attachment: HDFS-7929-003.patch Fixing the test failure (the added test didn't clean up the cluster). > inot

[jira] [Commented] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366361#comment-14366361 ] Arpit Agarwal commented on HDFS-7946: - +1 for the patch, pending jenkins. Thanks for t

[jira] [Updated] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7946: - Status: Patch Available (was: Open) > TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

[jira] [Updated] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7946: - Issue Type: Sub-task (was: Test) Parent: HDFS-7947 > TestDataNodeVolumeFailureReporting NPE during

[jira] [Created] (HDFS-7947) Fix HDFS unit test failures on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7947: Summary: Fix HDFS unit test failures on Windows Key: HDFS-7947 URL: https://issues.apache.org/jira/browse/HDFS-7947 Project: Hadoop HDFS Issue Type: Test

[jira] [Updated] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7946: - Attachment: HDFS-7946.00.patch > TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows >

[jira] [Created] (HDFS-7946) TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows

2015-03-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7946: Summary: TestDataNodeVolumeFailureReporting NPE during tearDown() on Windows Key: HDFS-7946 URL: https://issues.apache.org/jira/browse/HDFS-7946 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366334#comment-14366334 ] Hadoop QA commented on HDFS-7929: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7942) NFS: regex value of nfs.exports.allowed.hosts is not working as expected

2015-03-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366320#comment-14366320 ] Brandon Li commented on HDFS-7942: -- The regular expression is wrong. Instead of "206.190.5

[jira] [Commented] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366303#comment-14366303 ] Jing Zhao commented on HDFS-7943: - The test failures should be unrelated and they all passe

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366301#comment-14366301 ] Hadoop QA commented on HDFS-7587: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366293#comment-14366293 ] Jing Zhao commented on HDFS-7285: - Thanks for the comment, Zhe! Some comments inline: bq. I

[jira] [Updated] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

2015-03-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7369: Attachment: HDFS-7369-003.patch This new test addresses Jing and Kai's comments, implements the logic of fin

[jira] [Commented] (HDFS-7944) Minor cleanup of BlockPoolManager#getAllNamenodeThreads

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366263#comment-14366263 ] Hadoop QA commented on HDFS-7944: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7943) Append cannot handle the last block with length greater than the preferred block size

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366221#comment-14366221 ] Hadoop QA commented on HDFS-7943: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Issue Comment Deleted] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7369: Comment: was deleted (was: Please tell me how i can use batch file HDFS-1783 https://issues.apache.org/jira/

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-03-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366215#comment-14366215 ] Xiaoyu Yao commented on HDFS-7811: -- Thanks [~jingzhao] for the review. bq. 1. In tryGetB

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

2015-03-17 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366212#comment-14366212 ] Kai Zheng commented on HDFS-7369: - The clarifying sounds good to me. Any update ? > Erasur

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-17 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366196#comment-14366196 ] Lei (Eddy) Xu commented on HDFS-7833: - Hi, [~cnauroth], thanks a lot for reporting this

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366182#comment-14366182 ] Kihwal Lee commented on HDFS-7587: -- Sorry, I missed the comment. Should have refreshed. >

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366168#comment-14366168 ] Hadoop QA commented on HDFS-7922: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366135#comment-14366135 ] Jing Zhao commented on HDFS-7587: - Thanks for the comment, Kihwal. Actually I mentioned thi

[jira] [Commented] (HDFS-7811) Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366129#comment-14366129 ] Jing Zhao commented on HDFS-7811: - Thanks for working on this, Xiaoyu. Some comments below:

[jira] [Commented] (HDFS-7713) Improve the HDFS Web UI browser to allow creating dirs

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366091#comment-14366091 ] Hadoop QA commented on HDFS-7713: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2015-03-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366086#comment-14366086 ] Kihwal Lee commented on HDFS-7645: -- It has been a while since I saw an hdfs precommit work

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366067#comment-14366067 ] Hadoop QA commented on HDFS-7645: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7945) The WebHdfs system on DN does not honor the length parameter

2015-03-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7945: - Attachment: HDFS-7945.000.patch > The WebHdfs system on DN does not honor the length parameter > --

[jira] [Updated] (HDFS-7945) The WebHdfs system on DN does not honor the length parameter

2015-03-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7945: - Status: Patch Available (was: Open) > The WebHdfs system on DN does not honor the length parameter > -

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366048#comment-14366048 ] Zhe Zhang commented on HDFS-7936: - Ahh I see. Let's keep it in branch then. > Erasure codi

[jira] [Updated] (HDFS-7697) Document the scope of the PB OIV tool

2015-03-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7697: - Status: Open (was: Patch Available) > Document the scope of the PB OIV tool >

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2015-03-17 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366045#comment-14366045 ] Jitendra Nath Pandey commented on HDFS-7933: [~xyao], one of the key issues is

[jira] [Updated] (HDFS-7697) Document the scope of the PB OIV tool

2015-03-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7697: - Status: Patch Available (was: Open) > Document the scope of the PB OIV tool >

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2015-03-17 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HDFS-7878: --- Attachment: HDFS-7878.03.patch Attaching the patch with the class changes (actually it's the sa

[jira] [Commented] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366016#comment-14366016 ] Kihwal Lee commented on HDFS-7587: -- Is it possible for the last block size to be greater t

[jira] [Commented] (HDFS-7037) Using distcp to copy data from insecure to secure cluster via hftp doesn't work (branch-2 only)

2015-03-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366004#comment-14366004 ] Aaron T. Myers commented on HDFS-7037: -- I agree with Yongjun - this fix is basically e

[jira] [Updated] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7587: Attachment: HDFS-7587.002.patch Add fix for truncate. > Edit log corruption can happen if append fails with

[jira] [Commented] (HDFS-7816) Unable to open webhdfs paths with "+"

2015-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365902#comment-14365902 ] Hadoop QA commented on HDFS-7816: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-17 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7847: --- Attachment: HDFS-7847.003.patch Thanks for the review [~cmccabe]. I moved those two methods over to DF

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365845#comment-14365845 ] Konstantin Shvachko commented on HDFS-7930: --- Actually taking the last observation

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-03-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365842#comment-14365842 ] Colin Patrick McCabe commented on HDFS-7847: {{getNamenodeProtocolProxy}}, {{ge

[jira] [Updated] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-03-17 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7929: Attachment: HDFS-7929-002.patch Thanks [~cmccabe] for the review. The new patch addresses the comment on lis

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365818#comment-14365818 ] Konstantin Shvachko commented on HDFS-7930: --- Looks good now. One last thing is th

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365801#comment-14365801 ] Colin Patrick McCabe commented on HDFS-7054: The "new" findbugs warnings are al

[jira] [Updated] (HDFS-7927) Fluentd unable to write events to MaprFS using httpfs

2015-03-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7927: --- Status: Open (was: Patch Available) cancelling patch as it does not apply. > Fluentd unable t

[jira] [Updated] (HDFS-7927) Fluentd unable to write events to MaprFS using httpfs

2015-03-17 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7927: --- Fix Version/s: (was: 2.4.1) > Fluentd unable to write events to MaprFS using httpfs > -

[jira] [Updated] (HDFS-7944) Minor cleanup of BlockPoolManager#getAllNamenodeThreads

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7944: Attachment: HDFS-7944.01.patch > Minor cleanup of BlockPoolManager#getAllNamenodeThreads > --

[jira] [Updated] (HDFS-7944) Minor cleanup of BlockPoolManager#getAllNamenodeThreads

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7944: Status: Patch Available (was: Open) > Minor cleanup of BlockPoolManager#getAllNamenodeThreads >

[jira] [Created] (HDFS-7945) The WebHdfs system on DN does not honor the length parameter

2015-03-17 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7945: Summary: The WebHdfs system on DN does not honor the length parameter Key: HDFS-7945 URL: https://issues.apache.org/jira/browse/HDFS-7945 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7945) The WebHdfs system on DN does not honor the length parameter

2015-03-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14365780#comment-14365780 ] Haohui Mai commented on HDFS-7945: -- This is a regression thus it is a blocker. > The WebH

[jira] [Updated] (HDFS-7944) Minor cleanup of BlockPoolManager#getAllNamenodeThreads

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7944: Issue Type: Improvement (was: Bug) > Minor cleanup of BlockPoolManager#getAllNamenodeThreads > -

[jira] [Updated] (HDFS-7944) Minor cleanup of BlockPoolManager#getAllNamenodeThreads

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7944: Description: {{BlockPoolManager#getAllNamenodeThreads}} can avoid unnecessary list to array conversi

[jira] [Moved] (HDFS-7944) Minor cleanup of BlockPoolManager#getAllNamenodeThreads

2015-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal moved HADOOP-11725 to HDFS-7944: -- Target Version/s: 2.8.0 (was: 2.8.0) Affects Version/s: (was: 2

[jira] [Updated] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7587: Attachment: HDFS-7587.001.patch Rebase Daryn's patch. Also make changes based on Nicholas's comments, i.e.,

[jira] [Assigned] (HDFS-7587) Edit log corruption can happen if append fails with a quota violation

2015-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-7587: --- Assignee: Jing Zhao > Edit log corruption can happen if append fails with a quota violation >

[jira] [Updated] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-17 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-7748: - Assignee: Anu Engineer (was: Haohui Mai) > Separate ECN flags from the Status in the DataTransferPipelineA

  1   2   >