[jira] [Updated] (HDFS-7687) Change fsck to support EC files

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7687: Assignee: Takanobu Asanuma (was: Tsz Wo Nicholas Sze) > Change fsck to support EC files > --

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

2015-03-16 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364675#comment-14364675 ] Takanobu Asanuma commented on HDFS-7687: I'd like to try to do this ticket. Please

[jira] [Updated] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7717: Assignee: Kai Sasaki (was: Jing Zhao) > Erasure Coding: provide a tool for convert files between replication

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364669#comment-14364669 ] Zhe Zhang commented on HDFS-7912: - Sure, let's revisit it later. +1 on the patch. Thanks J

[jira] [Commented] (HDFS-7620) Change disk quota calculation for EC files

2015-03-16 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364668#comment-14364668 ] Takanobu Asanuma commented on HDFS-7620: Oh, thanks for your help, Jing. > Change

[jira] [Commented] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364666#comment-14364666 ] Jing Zhao commented on HDFS-7717: - Sure, assigning the jira to you. > Erasure Coding: prov

[jira] [Resolved] (HDFS-7620) Change disk quota calculation for EC files

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7620. - Resolution: Duplicate Hi [~tasanuma0829], I just find that this issue has been solved by HDFS-7826. I will

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364657#comment-14364657 ] Jing Zhao commented on HDFS-7912: - Yeah, the block contained in the LocatedBlock {{lBlk}} h

[jira] [Updated] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

2015-03-16 Thread Keisuke Ogiwara (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keisuke Ogiwara updated HDFS-7645: -- Attachment: HDFS-7645.04.patch I have attached a new patch. Please review it when you are free. T

[jira] [Commented] (HDFS-7620) Change disk quota calculation for EC files

2015-03-16 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364645#comment-14364645 ] Takanobu Asanuma commented on HDFS-7620: I'd like to try to do this ticket. Please

[jira] [Commented] (HDFS-7717) Erasure Coding: provide a tool for convert files between replication and erasure coding

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364641#comment-14364641 ] Kai Sasaki commented on HDFS-7717: -- [~jingzhao] Hello, Jing. I'd like to work on this issu

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

2015-03-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364621#comment-14364621 ] Konstantin Shvachko commented on HDFS-7930: --- Looks like the right fix. Few sugges

[jira] [Updated] (HDFS-7829) Code clean up for LocatedBlock

2015-03-16 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-7829: --- Attachment: HDFS-7829.4.patch Thank you for your review, Jing. I thought and changed my patch:

[jira] [Commented] (HDFS-5522) Datanode disk error check may be incorrectly skipped

2015-03-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364604#comment-14364604 ] Todd Lipcon commented on HDFS-5522: --- I know this has been closed for a while, but wanted

[jira] [Commented] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364570#comment-14364570 ] Hudson commented on HDFS-2360: -- FAILURE: Integrated in Hadoop-trunk-Commit #7340 (See [https:

[jira] [Updated] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2360: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364536#comment-14364536 ] GAO Rui commented on HDFS-7864: --- [~jingzhao] Thanks for your comment, Jing! I have update

[jira] [Updated] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-16 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-7864: -- Attachment: HDFS-7864.3.patch > Erasure Coding: Update safemode calculation for striped blocks >

[jira] [Assigned] (HDFS-7616) Change FSImage to support BlockGroup

2015-03-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-7616: - Assignee: Takuya Fukudome (was: Tsz Wo Nicholas Sze) Sure, assigned to you. Than

[jira] [Commented] (HDFS-7616) Change FSImage to support BlockGroup

2015-03-16 Thread Takuya Fukudome (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364496#comment-14364496 ] Takuya Fukudome commented on HDFS-7616: --- Hi [~szetszwo], I am interested in working

[jira] [Commented] (HDFS-7938) OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac

2015-03-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364488#comment-14364488 ] Chris Nauroth commented on HDFS-7938: - Hello, [~kiranmr]. Are you interested in taking

[jira] [Commented] (HDFS-7902) Expose truncate API for libwebhdfs

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364457#comment-14364457 ] Colin Patrick McCabe commented on HDFS-7902: {code} 130 int createUrlForNnT

[jira] [Commented] (HDFS-7838) Expose truncate API for libhdfs

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364455#comment-14364455 ] Colin Patrick McCabe commented on HDFS-7838: +1. Thanks, Yi. > Expose truncat

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Status: Patch Available (was: Open) [~jingzhao] I submitted an initial patch including clean up which is m

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Attachment: HDFS-7937.1.patch > Erasure Coding: INodeFile quota computation unit tests > --

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364448#comment-14364448 ] Hadoop QA commented on HDFS-7054: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Attachment: (was: HDFS-7937.1.patch) > Erasure Coding: INodeFile quota computation unit tests > ---

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7937: - Attachment: HDFS-7937.1.patch > Erasure Coding: INodeFile quota computation unit tests > --

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364418#comment-14364418 ] Colin Patrick McCabe commented on HDFS-7054: v2 fixes a missing import > Make

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364411#comment-14364411 ] Colin Patrick McCabe commented on HDFS-7929: The approach looks reasonable here

[jira] [Created] (HDFS-7938) OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac

2015-03-16 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7938: -- Summary: OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac Key: HDFS-7938 URL: https://issues.apache.org/jira/browse/HDFS-7938

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364392#comment-14364392 ] Colin Patrick McCabe commented on HDFS-7915: Good catch. I committed to branch

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364389#comment-14364389 ] Colin Patrick McCabe commented on HDFS-7878: Hi [~jingzhao], I understand that

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364388#comment-14364388 ] Hadoop QA commented on HDFS-7933: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364386#comment-14364386 ] Hadoop QA commented on HDFS-7854: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364346#comment-14364346 ] Zhe Zhang commented on HDFS-7912: - Thanks Jing for clarifying about NN overhead. About the

[jira] [Updated] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7054: --- Attachment: HDFS-7054.002.patch > Make DFSOutputStream tracing more fine-grained >

[jira] [Commented] (HDFS-7912) Erasure Coding: track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364334#comment-14364334 ] Jing Zhao commented on HDFS-7912: - Thanks for the review, Zhe! bq. My only concern is that

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-16 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-004-duplicate3.patch The findbugsWarnings's url cannot be opened, trigger Jenkins again. > Sep

[jira] [Updated] (HDFS-7891) A block placement policy with best fault tolerance

2015-03-16 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7891: Summary: A block placement policy with best fault tolerance (was: a block placement policy with best fault t

[jira] [Commented] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364326#comment-14364326 ] Hadoop QA commented on HDFS-2360: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364300#comment-14364300 ] Hadoop QA commented on HDFS-7054: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7864) Erasure Coding: Update safemode calculation for striped blocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364289#comment-14364289 ] Jing Zhao commented on HDFS-7864: - Thanks for updating the patch, Rui! Some comments for th

[jira] [Updated] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7054: --- Target Version/s: 2.7.0 (was: 2.6.0) Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2015-03-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7054: --- Attachment: HDFS-7054.001.patch > Make DFSOutputStream tracing more fine-grained >

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

2015-03-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364259#comment-14364259 ] Brandon Li commented on HDFS-5523: -- {quote}We should probably disallow nesting in this pha

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364250#comment-14364250 ] Jing Zhao commented on HDFS-7937: - Thanks for opening the jira, Kai. BTW, there is some co

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364239#comment-14364239 ] Jing Zhao commented on HDFS-7936: - Yeah, but we do not have the class BlockInfo in trunk cu

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364236#comment-14364236 ] Hadoop QA commented on HDFS-7932: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364225#comment-14364225 ] Kai Sasaki commented on HDFS-7826: -- [~jingzhao] Thank you Jing for gracious reviewing! And

[jira] [Resolved] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7826. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. Thanks f

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364218#comment-14364218 ] Jing Zhao commented on HDFS-7826: - +1 for the .5 patch. I will commit it shortly. > Erasur

[jira] [Updated] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-7826: - Attachment: HDFS-7826.5.patch > Erasure Coding: Update INodeFile quota computation for striped blocks > ---

[jira] [Commented] (HDFS-7826) Erasure Coding: Update INodeFile quota computation for striped blocks

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364171#comment-14364171 ] Jing Zhao commented on HDFS-7826: - Thanks Kai! Only one comment remaining: In {{storagespac

[jira] [Created] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

2015-03-16 Thread Kai Sasaki (JIRA)
Kai Sasaki created HDFS-7937: Summary: Erasure Coding: INodeFile quota computation unit tests Key: HDFS-7937 URL: https://issues.apache.org/jira/browse/HDFS-7937 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364152#comment-14364152 ] Zhe Zhang commented on HDFS-5523: - Thanks [~brandonli] for the thoughts. bq. 1. if there

[jira] [Commented] (HDFS-7829) Code clean up for LocatedBlock

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364144#comment-14364144 ] Jing Zhao commented on HDFS-7829: - Sorry for the late response, [~tasanuma0829]. For {{Loc

[jira] [Commented] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364105#comment-14364105 ] Arpit Agarwal commented on HDFS-2360: - +1 for the updated patch pending Jenkins. Thank

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364104#comment-14364104 ] Sergey Shelukhin commented on HDFS-7878: Note: confusingly, HdfsFileStatus is not F

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364100#comment-14364100 ] Jing Zhao commented on HDFS-7827: - Currently we still have non-protobuf image for offline p

[jira] [Comment Edited] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364100#comment-14364100 ] Jing Zhao edited comment on HDFS-7827 at 3/16/15 10:31 PM: --- Curre

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2015-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364096#comment-14364096 ] Xiaoyu Yao commented on HDFS-7933: -- Sample output from unit test during decommission: {c

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2015-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7933: - Status: Patch Available (was: Open) > fsck should also report decommissioning replicas. > ---

[jira] [Commented] (HDFS-7891) a block placement policy with best fault tolerance

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364081#comment-14364081 ] Zhe Zhang commented on HDFS-7891: - Thanks Walter for the patch! The logic looks good. It s

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2015-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7933: - Attachment: HDFS-7933.00.patch Attach a patch that removes the corruption warning for decommissioned replic

[jira] [Updated] (HDFS-3549) dist tar build fails in hadoop-hdfs-raid project

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3549: --- Fix Version/s: (was: 2.0.0-alpha) 3.0.0 > dist tar build fails in hadoop

[jira] [Updated] (HDFS-3550) raid added javadoc warnings

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3550: --- Fix Version/s: (was: 2.0.0-alpha) 3.0.0 > raid added javadoc warnings >

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364067#comment-14364067 ] Jing Zhao commented on HDFS-7878: - bq. Colin wrote: if the client makes two different call

[jira] [Updated] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2360: -- Attachment: HDFS-2360.patch Thanks [~arpitagarwal], good idea, addressed in this attachment. > Ugly stacktrace w

[jira] [Commented] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364066#comment-14364066 ] Harsh J commented on HDFS-2360: --- Inspected the failed tests but they are unrelated. The fix a

[jira] [Assigned] (HDFS-7933) fsck should also report decommissioning replicas.

2015-03-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-7933: Assignee: Xiaoyu Yao > fsck should also report decommissioning replicas. >

[jira] [Commented] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364051#comment-14364051 ] Hadoop QA commented on HDFS-2360: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3265) PowerPc Build error.

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364042#comment-14364042 ] Allen Wittenauer commented on HDFS-3265: For those spelunking: this was never comm

[jira] [Updated] (HDFS-3265) PowerPc Build error.

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3265: --- Fix Version/s: (was: 2.0.0-alpha) 3.0.0 > PowerPc Build error. > ---

[jira] [Updated] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7936: Assignee: Zhe Zhang (was: Jing Zhao) > Erasure coding: resolving conflicts when merging with HDFS-7903 and H

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363984#comment-14363984 ] Jing Zhao commented on HDFS-7936: - Hi Zhe, your patch looks good to me. Thanks for the fix!

[jira] [Resolved] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7936. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this. > Erasu

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363987#comment-14363987 ] Zhe Zhang commented on HDFS-7936: - Thanks Jing! We can probably think about pushing some o

[jira] [Commented] (HDFS-7935) Support multi-homed networks when Kerberos security is enabled

2015-03-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363979#comment-14363979 ] Arun Suresh commented on HDFS-7935: --- Hit enter by mistake... Continuing.. So looks like

[jira] [Commented] (HDFS-7935) Support multi-homed networks when Kerberos security is enabled

2015-03-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363976#comment-14363976 ] Arun Suresh commented on HDFS-7935: --- Im running Hadoop 2.6.0, I still get this when tryin

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363961#comment-14363961 ] Zhe Zhang commented on HDFS-7936: - [~jingzhao] Thanks! I actually have a patch (guess JIRA

[jira] [Updated] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7936: Attachment: HDFS-7936-002.patch 001 patch had unnecessary changes to import > Erasure coding: resolving conf

[jira] [Assigned] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-7936: --- Assignee: Jing Zhao (was: Zhe Zhang) > Erasure coding: resolving conflicts when merging with HDFS-790

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363950#comment-14363950 ] Jing Zhao commented on HDFS-7936: - Sure. I will assign the jira to me. > Erasure coding: r

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363949#comment-14363949 ] Jing Zhao commented on HDFS-7936: - Hi Zhe, let me know if you need any help on this. > Era

[jira] [Updated] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7936: Attachment: HDFS-7936-001.patch [~jingzhao] Those are mostly around {{BlockInfoContiguous}} -> {{BlockInfo}}.

[jira] [Updated] (HDFS-3121) hdfs tests for HADOOP-8014

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3121: --- Issue Type: Test (was: Bug) > hdfs tests for HADOOP-8014 > -- > >

[jira] [Created] (HDFS-7936) Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435

2015-03-16 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7936: --- Summary: Erasure coding: resolving conflicts when merging with HDFS-7903 and HDFS-7435 Key: HDFS-7936 URL: https://issues.apache.org/jira/browse/HDFS-7936 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3121) hdfs tests for HADOOP-8014

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3121: --- Fix Version/s: (was: 2.0.0-alpha) 3.0.0 > hdfs tests for HADOOP-8014 > -

[jira] [Commented] (HDFS-2360) Ugly stacktrace when quota exceeds

2015-03-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363942#comment-14363942 ] Arpit Agarwal commented on HDFS-2360: - Hi [~qwertymaniac], the approach looks good. Can

[jira] [Updated] (HDFS-2743) Streamline usage of bookkeeper journal manager

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2743: --- Fix Version/s: (was: 2.0.0-alpha) 3.0.0 > Streamline usage of bookkeeper

[jira] [Commented] (HDFS-7935) Support multi-homed networks when Kerberos security is enabled

2015-03-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363895#comment-14363895 ] Kihwal Lee commented on HDFS-7935: -- Secure HA NN does come up with dfs.namenode.http-addre

[jira] [Commented] (HDFS-2373) Commands using webhdfs and hftp print unnecessary debug information on the console with security enabled

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363889#comment-14363889 ] Allen Wittenauer commented on HDFS-2373: in case someone goes back and spelunks on

[jira] [Updated] (HDFS-2373) Commands using webhdfs and hftp print unnecessary debug information on the console with security enabled

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2373: --- Fix Version/s: (was: 0.23.1) 3.0.0 > Commands using webhdfs and hftp pri

[jira] [Updated] (HDFS-2373) Commands using webhdfs and hftp print unnecessary debug information on the console with security enabled

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-2373: --- Fix Version/s: (was: 2.0.0-alpha) 0.23.1 > Commands using webhdfs and hf

[jira] [Updated] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

2015-03-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7932: - Attachment: HDFS-7932.patch Making it wait shorter for the dataXfer thread group to exit. (From 2.5 seconds

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-03-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363837#comment-14363837 ] Zhe Zhang commented on HDFS-7837: - [~jingzhao] I rebased trunk changes today and manually f

[jira] [Updated] (HDFS-3458) Convert Forrest docs to APT

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3458: --- Fix Version/s: (was: 2.0.0-alpha) > Convert Forrest docs to APT > -

[jira] [Resolved] (HDFS-2771) Move Federation and WebHDFS documentation into HDFS project

2015-03-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-2771. Resolution: Implemented Target Version/s: (was: ) fixed eons ago > Move Federati

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363800#comment-14363800 ] Hudson commented on HDFS-7886: -- FAILURE: Integrated in Hadoop-trunk-Commit #7335 (See [https:

  1   2   3   >