[jira] [Updated] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8833: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7285 Status: Resolved (wa

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738225#comment-14738225 ] Kanaka Kumar Avvaru commented on HDFS-8953: --- Test failures in the build doesn't s

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738223#comment-14738223 ] Kanaka Kumar Avvaru commented on HDFS-6955: --- Test failure looks not related to th

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738222#comment-14738222 ] Masatake Iwasaki commented on HDFS-1172: bq. Thanks for the update Fengdong Yu, but

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-09-09 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738215#comment-14738215 ] J.Andreina commented on HDFS-8545: -- Failures are unrelated to this issue. Please review.

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738214#comment-14738214 ] Masatake Iwasaki commented on HDFS-1172: Thanks for the update [~azuryy], but the p

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738209#comment-14738209 ] Zhe Zhang commented on HDFS-8383: - [~szetszwo] Thanks for sharing the thought. {code} Str

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738207#comment-14738207 ] Kai Sasaki commented on HDFS-8287: -- {{writeChunk}} obtains a lock of {{DFSStripedOutputStr

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738197#comment-14738197 ] Hadoop QA commented on HDFS-8833: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9037) Trash messages should be handled by Logger instead of being delivered on System.out

2015-09-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738182#comment-14738182 ] Akira AJISAKA commented on HDFS-9037: - Thanks [~ashutoshc] and [~wheat9] for the commen

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738139#comment-14738139 ] Hadoop QA commented on HDFS-8974: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8974: --- Attachment: HDFS-8974-branch-2.001.patch I attached patch for branch-2. Compiled doc can be se

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738122#comment-14738122 ] Kai Sasaki commented on HDFS-8287: -- I can reproduce it with this command. {{ec_sample.txt}

[jira] [Updated] (HDFS-8837) Remove the unnecessary Quota.Counts class

2015-09-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-8837: -- Attachment: HDFS-8837-branch-2.patch Thanks [~xyao]. Here is the patch for branch-2. It doesn't seem like we need

[jira] [Commented] (HDFS-9040) Erasure coding: A BlockGroupDataStreamer to rule all internal blocks streamers

2015-09-09 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738076#comment-14738076 ] Li Bo commented on HDFS-9040: - Implementing a block group writer is a better solution but you h

[jira] [Commented] (HDFS-8789) Block Placement policy migrator

2015-09-09 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738070#comment-14738070 ] Xu Chen commented on HDFS-8789: --- HI [~ctrezzo] As your say, what that "robust tool " looks

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738057#comment-14738057 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- It seems not an existing problem.

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738042#comment-14738042 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- Could you also try to reproduce the

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: jstack-dump.txt > DFSStripedOutputStream.writeChunk should not wait for writing parity > -

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738037#comment-14738037 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- The WIP patch looks good. Please se

[jira] [Commented] (HDFS-8974) Convert docs in xdoc format to markdown

2015-09-09 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14738013#comment-14738013 ] Masatake Iwasaki commented on HDFS-8974: bq. In rolling upgrades document, there ar

[jira] [Updated] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8287: - Attachment: HDFS-8287-HDFS-7285.WIP.patch > DFSStripedOutputStream.writeChunk should not wait for writing p

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737964#comment-14737964 ] Kai Sasaki commented on HDFS-8287: -- I tried simple test to write a 200MB file. Sorry I don

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737962#comment-14737962 ] Tsz Wo Nicholas Sze commented on HDFS-8383: --- > I think the mission here is to han

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737956#comment-14737956 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- Could you give more details about th

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-09-09 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737945#comment-14737945 ] Walter Su commented on HDFS-8833: - bq. Walter Su Could you take a look and see if it looks

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Status: Patch Available (was: Open) > Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method >

[jira] [Updated] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9027: Status: Open (was: Patch Available) > Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method >

[jira] [Updated] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-09 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9041: Attachment: HDFS-9041.000.patch The v0 patch move the following entry in {{hadoop-hdfs-project/hadoo

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737936#comment-14737936 ] Hadoop QA commented on HDFS-8855: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6142) StandbyException wrapped to InvalidToken exception

2015-09-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737914#comment-14737914 ] Yongjun Zhang commented on HDFS-6142: - HI [~d.yuan], Thanks for reporting the issue, a

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

2015-09-09 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737896#comment-14737896 ] Kai Sasaki commented on HDFS-8287: -- [~szetszwo] Thank you for reviewing. I've just tested

[jira] [Commented] (HDFS-9005) Provide support for upgrade domain script

2015-09-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737842#comment-14737842 ] Ming Ma commented on HDFS-9005: --- Currently it caches the data. It doesn't poll the script per

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737827#comment-14737827 ] Hadoop QA commented on HDFS-8833: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737823#comment-14737823 ] Hudson commented on HDFS-8581: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2312 (See [htt

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737822#comment-14737822 ] Hudson commented on HDFS-7116: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2312 (See [htt

[jira] [Commented] (HDFS-8383) Tolerate multiple failures in DFSStripedOutputStream

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737818#comment-14737818 ] Zhe Zhang commented on HDFS-8383: - While we explore the ideas of refactoring {{DFSOutputStr

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737813#comment-14737813 ] Hadoop QA commented on HDFS-6955: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737798#comment-14737798 ] Zhe Zhang commented on HDFS-8846: - The patch looks good (I suppose the binary file was also

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737774#comment-14737774 ] Hudson commented on HDFS-8581: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #350 (See [htt

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737773#comment-14737773 ] Hudson commented on HDFS-7116: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #350 (See [htt

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737754#comment-14737754 ] Hudson commented on HDFS-8581: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2289 (See [https://

[jira] [Commented] (HDFS-9037) Trash messages should be handled by Logger instead of being delivered on System.out

2015-09-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737742#comment-14737742 ] Haohui Mai commented on HDFS-9037: -- Why this is an incompatible change? > Trash messages

[jira] [Created] (HDFS-9041) Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client

2015-09-09 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-9041: Summary: Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client Key: HDFS-9041 URL: https://issues.apache.org/jira/browse/HDFS-9041 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7611: -- Labels: (was: 2.6.1-candidate) About to make an RC for 2.6.1. Dropping the 2.6.

[jira] [Updated] (HDFS-7843) A truncated file is corrupted after rollback from a rolling upgrade

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7843: -- Labels: (was: 2.6.1-candidate) About to make an RC for 2.6.1. Dropping the 2.6.

[jira] [Updated] (HDFS-7831) Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks()

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7831: -- Labels: (was: 2.6.1-candidate) About to make an RC for 2.6.1. Dropping the 2.6.

[jira] [Updated] (HDFS-7676) Fix TestFileTruncate to avoid bug of HDFS-7611

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7676: -- Labels: (was: 2.6.1-candidate) About to make an RC for 2.6.1. Dropping the 2.6.

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7926: -- Labels: (was: 2.6.1-candidate) About to make an RC for 2.6.1. Dropping the 2.6.

[jira] [Updated] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8850: -- Labels: 2.7.2-candidate (was: 2.6.1-candidate) About to make an RC for 2.6.1. Dr

[jira] [Updated] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2015-09-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-7552: -- Labels: 2.6.1-candidate (was: ) Fix Version/s: 2.6.1 Pulled this into

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737670#comment-14737670 ] Hadoop QA commented on HDFS-8953: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737669#comment-14737669 ] Hudson commented on HDFS-8581: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #363 (See

[jira] [Commented] (HDFS-7351) Document the HDFS Erasure Coding feature

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737665#comment-14737665 ] Zhe Zhang commented on HDFS-7351: - [~umamaheswararao] / [~vinayrpet] We have finalized the

[jira] [Commented] (HDFS-8853) Erasure Coding: Provide ECSchema validation when creating ECZone

2015-09-09 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737643#comment-14737643 ] Zhe Zhang commented on HDFS-8853: - [~andreina] Wondering if you've had a chance to look at

[jira] [Commented] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737637#comment-14737637 ] Hadoop QA commented on HDFS-7995: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.4.patch Patch V4. Added some UTs. Can anyone review it? Thanks. > Webhdfs clie

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737553#comment-14737553 ] Hudson commented on HDFS-8716: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #349 (See [htt

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737548#comment-14737548 ] Hudson commented on HDFS-8716: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2288 (See [https://

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737547#comment-14737547 ] Hudson commented on HDFS-7116: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2288 (See [https://

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737526#comment-14737526 ] Hudson commented on HDFS-7116: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #370 (See [htt

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737527#comment-14737527 ] Hudson commented on HDFS-8581: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #370 (See [htt

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737490#comment-14737490 ] Hudson commented on HDFS-8716: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2311 (See [htt

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737491#comment-14737491 ] Hudson commented on HDFS-8581: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1101 (See [https://

[jira] [Updated] (HDFS-7995) Implement chmod in the HDFS Web UI

2015-09-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7995: --- Attachment: HDFS-7995.03.patch Thanks for your review [~wheat9]. Here is a new patch incorporating all

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Environment: (was: HDP 2.2) > Webhdfs client leaks active NameNode connections >

[jira] [Commented] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737449#comment-14737449 ] Kanaka Kumar Avvaru commented on HDFS-6955: --- Thanks for the review [~vinayrpet].

[jira] [Commented] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737434#comment-14737434 ] Hudson commented on HDFS-8581: -- FAILURE: Integrated in Hadoop-trunk-Commit #8423 (See [https:

[jira] [Commented] (HDFS-9027) Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737432#comment-14737432 ] Hadoop QA commented on HDFS-9027: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-6955) DN should reserve disk space for a full block when creating tmp files

2015-09-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru updated HDFS-6955: -- Attachment: HDFS-6955-06.patch > DN should reserve disk space for a full block when creat

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-09 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-8696: - Description: There is an issue that appears related to the webhdfs server. When making two concurrent requ

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737402#comment-14737402 ] Hudson commented on HDFS-7116: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #362 (See

[jira] [Commented] (HDFS-9022) Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737400#comment-14737400 ] Hadoop QA commented on HDFS-9022: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737397#comment-14737397 ] Hudson commented on HDFS-8716: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #369 (See [htt

[jira] [Updated] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8581: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8581: Summary: ContentSummary on / skips further counts on yielding lock (was: count cmd calculate wrong w

[jira] [Commented] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737357#comment-14737357 ] Vinayakumar B commented on HDFS-8581: - +1 for the latest patch. Test failure is unrela

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737352#comment-14737352 ] Vinayakumar B commented on HDFS-8545: - {quote}But, considering current 'hdfs dfs -du -h

[jira] [Commented] (HDFS-9010) Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737327#comment-14737327 ] Hadoop QA commented on HDFS-9010: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8833) Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737313#comment-14737313 ] Hadoop QA commented on HDFS-8833: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737307#comment-14737307 ] Vinayakumar B commented on HDFS-8545: - This Jira is to add overloaded API of getUsed()

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737297#comment-14737297 ] Hudson commented on HDFS-7116: -- FAILURE: Integrated in Hadoop-trunk-Commit #8422 (See [https:

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737295#comment-14737295 ] Daniel Templeton commented on HDFS-9024: In general the patch looks fine to me. No

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737292#comment-14737292 ] Hudson commented on HDFS-7116: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1100 (See [https://

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737293#comment-14737293 ] Hudson commented on HDFS-8716: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1100 (See [https://

[jira] [Commented] (HDFS-8953) DataNode Metrics logging

2015-09-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737286#comment-14737286 ] Kanaka Kumar Avvaru commented on HDFS-8953: --- Thanks for the review [~vinayrpet].

[jira] [Updated] (HDFS-8953) DataNode Metrics logging

2015-09-09 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanaka Kumar Avvaru updated HDFS-8953: -- Attachment: HDFS-8953-03.patch > DataNode Metrics logging > > >

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737256#comment-14737256 ] Vinayakumar B commented on HDFS-7116: - Thanks [~rakeshr] for the patience and contribut

[jira] [Updated] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7116: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Release Note: Exposed c

[jira] [Updated] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7116: Issue Type: Improvement (was: New Feature) > Add a command to get the balancer bandwidth > -

[jira] [Commented] (HDFS-7116) Add a command to get the balancer bandwidth

2015-09-09 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737238#comment-14737238 ] Vinayakumar B commented on HDFS-7116: - I think tests failures are unrelated +1 for the

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737231#comment-14737231 ] Hudson commented on HDFS-8716: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #361 (See

[jira] [Commented] (HDFS-9037) Trash messages should be handled by Logger instead of being delivered on System.out

2015-09-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737188#comment-14737188 ] Ashutosh Chauhan commented on HDFS-9037: >From Hive's perspective, its super useful

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737186#comment-14737186 ] Hudson commented on HDFS-8716: -- FAILURE: Integrated in Hadoop-trunk-Commit #8421 (See [https:

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-09-09 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737162#comment-14737162 ] Haohui Mai commented on HDFS-8545: -- Why this should be a function in FileSystem instead of

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737147#comment-14737147 ] Hadoop QA commented on HDFS-8545: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8581) count cmd calculate wrong when huge files exist in one folder

2015-09-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737142#comment-14737142 ] Hadoop QA commented on HDFS-8581: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8716: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 3.0.0

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737105#comment-14737105 ] Kihwal Lee commented on HDFS-8716: -- Committed this to trunk and branch-2. > introduce a n

[jira] [Commented] (HDFS-8716) introduce a new config specifically for safe mode block count

2015-09-09 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737101#comment-14737101 ] Kihwal Lee commented on HDFS-8716: -- +1 > introduce a new config specifically for safe mod

  1   2   >