[jira] [Updated] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5800: Hadoop Flags: Reviewed > Typo: soft-limit for hard-limit in DFSClient >

[jira] [Commented] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876238#comment-13876238 ] Akira AJISAKA commented on HDFS-5800: - +1, LGTM. Pending Jenkins. > Typo: soft-limit f

[jira] [Commented] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2014-01-20 Thread Alex Dimakis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876251#comment-13876251 ] Alex Dimakis commented on HDFS-3544: Chris, our VLDB paper has an evolution of Simple r

[jira] [Commented] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876266#comment-13876266 ] Hadoop QA commented on HDFS-5800: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5728) [Diskfull] Block recovery will fail if the metafile not having crc for all chunks of the block

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876267#comment-13876267 ] Hadoop QA commented on HDFS-5728: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876282#comment-13876282 ] Akira AJISAKA commented on HDFS-5800: - The test failure should be unrelated to the simp

[jira] [Updated] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-5776: Attachment: HDFS-5776-v3.txt Thanks [~saint@gmail.com] for your so detailed comments ! Attached v3 addre

[jira] [Updated] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-5776: Attachment: HDFS-5776-v3.txt > Support 'hedged' reads in DFSClient > --- > >

[jira] [Updated] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-5776: Attachment: (was: HDFS-5776-v3.txt) > Support 'hedged' reads in DFSClient >

[jira] [Commented] (HDFS-5492) Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876310#comment-13876310 ] Hadoop QA commented on HDFS-5492: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5688) Wire-encription in QJM

2014-01-20 Thread Juan Carlos Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Carlos Fernandez updated HDFS-5688: Priority: Blocker (was: Major) > Wire-encription in QJM > -- >

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876388#comment-13876388 ] Hadoop QA commented on HDFS-5776: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5800: - Component/s: hdfs-client > Typo: soft-limit for hard-limit in DFSClient >

[jira] [Updated] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5800: - Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Pa

[jira] [Commented] (HDFS-5800) Typo: soft-limit for hard-limit in DFSClient

2014-01-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876461#comment-13876461 ] Hudson commented on HDFS-5800: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5024 (See [https:

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876633#comment-13876633 ] Aaron T. Myers commented on HDFS-5709: -- Latest patch looks very good to me. My only su

[jira] [Commented] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876668#comment-13876668 ] Yongjun Zhang commented on HDFS-5767: - Hi [~brandonli], About the example you provide

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876674#comment-13876674 ] Jing Zhao commented on HDFS-5709: - Thanks Andrew! The new patch looks good to me, +1. The o

[jira] [Commented] (HDFS-5613) NameNode: implement handling of ACLs in combination with symlinks.

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876685#comment-13876685 ] Haohui Mai commented on HDFS-5613: -- +1. The patch looks good. I'll commit it shortly. > N

[jira] [Resolved] (HDFS-5613) NameNode: implement handling of ACLs in combination with symlinks.

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5613. -- Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) Hadoop Flags: Reviewed I've committed

[jira] [Updated] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5709: -- Attachment: hdfs-5709-4.patch > Improve upgrade with existing files and directories named ".snapshot" >

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876724#comment-13876724 ] Andrew Wang commented on HDFS-5709: --- Thanks again for the reviews everyone. v4 takes ATM'

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876733#comment-13876733 ] stack commented on HDFS-5776: - Nice numbers [~xieliang007] When you get a chance, there were a

[jira] [Commented] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876741#comment-13876741 ] Colin Patrick McCabe commented on HDFS-5774: {code} +message CacheManagerSectio

[jira] [Commented] (HDFS-5608) WebHDFS: implement GETACLSTATUS and SETACL.

2014-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876751#comment-13876751 ] Chris Nauroth commented on HDFS-5608: - [~sachinjose2...@gmail.com], I just committed HA

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876763#comment-13876763 ] Aaron T. Myers commented on HDFS-5709: -- +1 pending Jenkins. > Improve upgrade with ex

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876777#comment-13876777 ] Colin Patrick McCabe commented on HDFS-5776: Let's keep TestPread as a test of

[jira] [Commented] (HDFS-5781) Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value

2014-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876795#comment-13876795 ] Colin Patrick McCabe commented on HDFS-5781: I agree that using {{Enum#values}}

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876802#comment-13876802 ] stack commented on HDFS-5776: - bq. I think that when the data being read is local, you will not

[jira] [Commented] (HDFS-5781) Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876810#comment-13876810 ] Jing Zhao commented on HDFS-5781: - Thanks for the comment Colin! The current patch simply u

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876842#comment-13876842 ] Colin Patrick McCabe commented on HDFS-5776: bq. Having hedged read on could am

[jira] [Commented] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876856#comment-13876856 ] Haohui Mai commented on HDFS-5774: -- The language guide of protobuf suggests that marking a

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876860#comment-13876860 ] Hadoop QA commented on HDFS-5709: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876886#comment-13876886 ] Jing Zhao commented on HDFS-5709: - bq. because it catches an additional class of errors (e.

[jira] [Updated] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5709: -- Attachment: hdfs-5709-5.patch Thanks Jing, that clarifies it for me. Newest rev does what you suggest.

[jira] [Commented] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876930#comment-13876930 ] Colin Patrick McCabe commented on HDFS-5774: Maybe I'm missing something, but I

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876949#comment-13876949 ] Jing Zhao commented on HDFS-5709: - Thanks Andrew! +1 pending Jenkins. > Improve upgrade wi

[jira] [Updated] (HDFS-5753) Add new NN startup options for downgrade and rollback using upgrade marker

2014-01-20 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5753: - Attachment: (was: h5786_20140117.patch) > Add new NN startup options for downg

[jira] [Updated] (HDFS-5753) Add new NN startup options for downgrade and rollback using upgrade marker

2014-01-20 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5753: - Attachment: h5753_20140120.patch Oops, uploaded a wrong file; it should be h5753_2

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876974#comment-13876974 ] Suresh Srinivas commented on HDFS-5709: --- Andrew, can you please summarize the solutio

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13876981#comment-13876981 ] Andrew Wang commented on HDFS-5709: --- Hey Suresh, Sure, I can summarize. What this patch

[jira] [Work started] (HDFS-5615) NameNode: implement handling of ACLs in combination with sticky bit.

2014-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5615 started by Chris Nauroth. > NameNode: implement handling of ACLs in combination with sticky bit. > --

[jira] [Updated] (HDFS-5615) NameNode: implement handling of ACLs in combination with sticky bit.

2014-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5615: Attachment: HDFS-5615.1.patch I'm attaching a patch that adds new tests to {{TestStickyBit}}. I als

[jira] [Commented] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877004#comment-13877004 ] Brandon Li commented on HDFS-5767: -- There are many ways things can go wrong. NSS configura

[jira] [Updated] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5743: Attachment: HDFS-5743.003.patch Thanks for the comments Haohui! Rebase the patch and address Haohui's commen

[jira] [Commented] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877013#comment-13877013 ] Jing Zhao commented on HDFS-5743: - The new patch passed all the snapshot-related unit tests

[jira] [Commented] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877018#comment-13877018 ] Haohui Mai commented on HDFS-5743: -- Looks good to me. +1. > Use protobuf to serialize sna

[jira] [Commented] (HDFS-5615) NameNode: implement handling of ACLs in combination with sticky bit.

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877023#comment-13877023 ] Haohui Mai commented on HDFS-5615: -- Looks good to me. Nit: You might be able to write a he

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877026#comment-13877026 ] Suresh Srinivas commented on HDFS-5709: --- bq. Since I don't foresee us adding that man

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877025#comment-13877025 ] Hadoop QA commented on HDFS-5709: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877036#comment-13877036 ] Yongjun Zhang commented on HDFS-5767: - Hi [~brandonli]. This new example you provided

[jira] [Commented] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-20 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877039#comment-13877039 ] Brandon Li commented on HDFS-5767: -- Suppose the nss is configured to return the first foun

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877044#comment-13877044 ] Andrew Wang commented on HDFS-5709: --- Hi Suresh, could you lay out your alternative propos

[jira] [Resolved] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5743. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed I've c

[jira] [Updated] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5774: - Attachment: HDFS-5774.002.patch Changing the optional fields into required based on Colin's comments. The

[jira] [Updated] (HDFS-5771) Track progress when loading fsimage

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5771: - Attachment: HDFS-5771.000.patch > Track progress when loading fsimage > --

[jira] [Updated] (HDFS-5744) Serialize information for token managers in protobuf

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5744: - Attachment: HDFS-5744.002.patch Rebased > Serialize information for token managers in protobuf >

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877056#comment-13877056 ] Jing Zhao commented on HDFS-5709: - bq. I could rename the conf and make it so it takes a de

[jira] [Resolved] (HDFS-5725) Remove compression support from FSImage

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5725. -- Resolution: Invalid According to HDFS-5722 this should be closed as invalid. > Remove compression suppo

[jira] [Updated] (HDFS-5753) Add new NN startup options for downgrade and rollback using upgrade marker

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5753: Hadoop Flags: Reviewed > Add new NN startup options for downgrade and rollback using upgrade marker > -

[jira] [Commented] (HDFS-5722) Implement compression in the HTTP server of SNN / SBN instead of FSImage

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877059#comment-13877059 ] Haohui Mai commented on HDFS-5722: -- HDFS-5793 does require random-access. Currently I pick

[jira] [Commented] (HDFS-5753) Add new NN startup options for downgrade and rollback using upgrade marker

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877057#comment-13877057 ] Jing Zhao commented on HDFS-5753: - +1 the Patch looks good to me. > Add new NN startup opt

[jira] [Commented] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877062#comment-13877062 ] Jing Zhao commented on HDFS-5774: - +1 Patch looks good. > Serialize CachePool directives i

[jira] [Commented] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877063#comment-13877063 ] Colin Patrick McCabe commented on HDFS-5774: Thanks, Haohui. +1. > Serialize

[jira] [Resolved] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5774. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. Thanks to Haohui for the patch and tha

[jira] [Updated] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5774: Fix Version/s: HDFS-5698 (FSImage in protobuf) > Serialize CachePool directives in protobuf > --

[jira] [Updated] (HDFS-5744) Serialize information for token managers in protobuf

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5744: - Attachment: HDFS-5744.003.patch The v3 patch fixes the failure of the unit test {{TestCheckpointForSecuri

[jira] [Commented] (HDFS-5744) Serialize information for token managers in protobuf

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877083#comment-13877083 ] Jing Zhao commented on HDFS-5744: - +1 the Patch looks good to me. > Serialize information

[jira] [Resolved] (HDFS-5744) Serialize information for token managers in protobuf

2014-01-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5744. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed I've c

[jira] [Resolved] (HDFS-198) org.apache.hadoop.dfs.LeaseExpiredException during dfs write

2014-01-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-198. -- Resolution: Not A Problem This one has gone very stale and we have not seen any properly true reports of lease r

[jira] [Commented] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877118#comment-13877118 ] Yongjun Zhang commented on HDFS-5767: - Thanks [~brandonli]. This case you described abo

[jira] [Resolved] (HDFS-5753) Add new NN startup options for downgrade and rollback using upgrade marker

2014-01-20 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-5753. -- Resolution: Fixed Fix Version/s: HDFS-5535 (Rolling upgrades) Thanks Jing

[jira] [Updated] (HDFS-5698) Use protobuf to serialize / deserialize FSImage

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5698: - Attachment: HDFS-5698.000.patch > Use protobuf to serialize / deserialize FSImage > --

[jira] [Updated] (HDFS-5698) Use protobuf to serialize / deserialize FSImage

2014-01-20 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5698: - Status: Patch Available (was: Open) > Use protobuf to serialize / deserialize FSImage > -

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877144#comment-13877144 ] Aaron T. Myers commented on HDFS-5709: -- Hey guys, Jing - I'm not in favor of a generi

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877145#comment-13877145 ] Liang Xie commented on HDFS-5776: - [~saint@gmail.com], [~cmccabe], hedged reads doesn'

[jira] [Created] (HDFS-5801) HDFS rack-awareness for nodes outside of the cluster

2014-01-20 Thread stanley shi (JIRA)
stanley shi created HDFS-5801: - Summary: HDFS rack-awareness for nodes outside of the cluster Key: HDFS-5801 URL: https://issues.apache.org/jira/browse/HDFS-5801 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877146#comment-13877146 ] Liang Xie commented on HDFS-5776: - bq. I guess we probably don't need to special-case local

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877154#comment-13877154 ] Liang Xie commented on HDFS-5776: - bq. Let's keep TestPread as a test of just pread, and ha

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877161#comment-13877161 ] Liang Xie commented on HDFS-5776: - bq. Nit: This seems extraneous in the new Callable: + re

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877173#comment-13877173 ] Liang Xie commented on HDFS-5776: - {quote} Nit: Should the '60' below here: + Thread.sleep(

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877177#comment-13877177 ] Liang Xie commented on HDFS-5776: - bq. Shut down this executor in the finally? Don't want i

[jira] [Updated] (HDFS-5615) NameNode: implement handling of ACLs in combination with sticky bit.

2014-01-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5615: Attachment: HDFS-5615.2.patch Thanks, Haohui. I'm uploading version 2 with the refactoring that you

[jira] [Created] (HDFS-5802) NameNode does not check for inode type before traversing down a path

2014-01-20 Thread Harsh J (JIRA)
Harsh J created HDFS-5802: - Summary: NameNode does not check for inode type before traversing down a path Key: HDFS-5802 URL: https://issues.apache.org/jira/browse/HDFS-5802 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-5698) Use protobuf to serialize / deserialize FSImage

2014-01-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877228#comment-13877228 ] Hadoop QA commented on HDFS-5698: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877231#comment-13877231 ] Liang Xie commented on HDFS-5776: - {quote} getHedgedReadsThreadPool Should be kept internal

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877255#comment-13877255 ] Liang Xie commented on HDFS-5776: - bq. For sure this will always trigger though the number

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877263#comment-13877263 ] Liang Xie commented on HDFS-5776: - bq. When we get to the end of the pipeline here; i.e. al

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13877268#comment-13877268 ] Liang Xie commented on HDFS-5776: - bq. I suppose moving this into finally would be messier

[jira] [Updated] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-20 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-5776: Attachment: HDFS-5776-v4.txt > Support 'hedged' reads in DFSClient > --- > >