[jira] [Commented] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078980#comment-14078980 ] Hadoop QA commented on HDFS-6685: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6767) Cannot remove directory within encryption zone to Trash

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078964#comment-14078964 ] Andrew Wang commented on HDFS-6767: --- Since Stephen's already got this posted to HDFS-6760

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078961#comment-14078961 ] Hudson commented on HDFS-6778: -- FAILURE: Integrated in Hadoop-trunk-Commit #5984 (See [https:

[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078960#comment-14078960 ] Hudson commented on HDFS-6665: -- FAILURE: Integrated in Hadoop-trunk-Commit #5984 (See [https:

[jira] [Updated] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6778: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-29 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078956#comment-14078956 ] Stephen Chu commented on HDFS-6665: --- Thank you, Andrew! > Add tests for XAttrs in combin

[jira] [Updated] (HDFS-6665) Add tests for XAttrs in combination with viewfs

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6665: -- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch Available) Commit

[jira] [Updated] (HDFS-6767) Cannot remove directory within encryption zone to Trash

2014-07-29 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-6767: -- Attachment: HDFS-6767.1.patch I agree that improving the error message and requiring users to skip the t

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078890#comment-14078890 ] Hadoop QA commented on HDFS-6778: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078862#comment-14078862 ] Charles Lamb commented on HDFS-6778: This change only involves javadoc so no tests are

[jira] [Updated] (HDFS-6685) Balancer should preserve storage type of replicas

2014-07-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6685: -- Description: When Balancer moves replicas to balance the cluster, it should always move

[jira] [Updated] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6685: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-6584) > Archival

[jira] [Updated] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6685: -- Attachment: h6685_20140730.patch Thanks Arpit for reviewing the patch. h6685_20140730.p

[jira] [Updated] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6685: -- Status: Patch Available (was: Open) > Archival Storage: Update Balancer to preserve sto

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078845#comment-14078845 ] Hadoop QA commented on HDFS-6778: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078791#comment-14078791 ] Liang Xie commented on HDFS-6766: - bq. should be the condition timeout configurable Per my

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078790#comment-14078790 ] Liang Xie commented on HDFS-6766: - The failed TestBalancer was not related with current pat

[jira] [Updated] (HDFS-6692) Add more HDFS encryption tests

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6692: -- Attachment: hdfs-6692.001.patch Patch attached. I added a fault injector to do various bad things while

[jira] [Commented] (HDFS-6692) Add more HDFS encryption tests

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078773#comment-14078773 ] Andrew Wang commented on HDFS-6692: --- If anyone has more ideas for tests to add, feel free

[jira] [Commented] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078769#comment-14078769 ] Hadoop QA commented on HDFS-6728: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Attachment: HDFS-6778.002.patch Uploading again to trigger jenkins. > The extended attributes javadoc

[jira] [Updated] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Attachment: (was: HDFS-6730.003.patch) > The extended attributes javadoc should simply refer to th

[jira] [Resolved] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb resolved HDFS-6730. Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) > Create a .RAW e

[jira] [Commented] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078758#comment-14078758 ] Hadoop QA commented on HDFS-6778: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078757#comment-14078757 ] Charles Lamb commented on HDFS-6730: Committed to the fs-encryption branch. > Create a

[jira] [Updated] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6730: --- Attachment: HDFS-6730.004.patch 004 is a rebase. > Create a .RAW extended attribute namespace > -

[jira] [Updated] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Attachment: HDFS-6730.003.patch Doc fixed up. > The extended attributes javadoc should simply refer t

[jira] [Updated] (HDFS-6778) The extended attributes javadoc should simply refer to the user docs

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6778: -- Summary: The extended attributes javadoc should simply refer to the user docs (was: The extended attrib

[jira] [Commented] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078737#comment-14078737 ] Andrew Wang commented on HDFS-6730: --- Looks good, just some doc comments: * "four valid n

[jira] [Updated] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6730: --- Attachment: HDFS-6730.002.patch bq.I sympathize with all the javadoc updates. Since the same xattr

[jira] [Commented] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078722#comment-14078722 ] Hadoop QA commented on HDFS-6728: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-29 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078720#comment-14078720 ] Tsz Wo Nicholas Sze commented on HDFS-6441: --- Benoy, thanks for the update. Arpit

[jira] [Commented] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078719#comment-14078719 ] Yongjun Zhang commented on HDFS-6776: - Thanks Allen, sorry I did not describe it clear

[jira] [Updated] (HDFS-6778) The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Status: Patch Available (was: In Progress) > The extended attributes avadoc should simply refer to th

[jira] [Commented] (HDFS-6767) Cannot remove directory within encryption zone to Trash

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078700#comment-14078700 ] Andrew Wang commented on HDFS-6767: --- Yea, you can see the example Stephen put in the desc

[jira] [Commented] (HDFS-6778) The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078692#comment-14078692 ] Andrew Wang commented on HDFS-6778: --- +1 pending, LGTM. Mind marking this as "Patch Availa

[jira] [Created] (HDFS-6779) hdfs version subcommand is missing

2014-07-29 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-6779: -- Summary: hdfs version subcommand is missing Key: HDFS-6779 URL: https://issues.apache.org/jira/browse/HDFS-6779 Project: Hadoop HDFS Issue Type: Improvem

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-29 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078691#comment-14078691 ] Ming Ma commented on HDFS-6772: --- Arpit, the PostponedMisreplicatedBlocks metrics is larger th

[jira] [Updated] (HDFS-6777) Supporting consistent edit log reads when in-progress edit log segments are included

2014-07-29 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6777: --- Description: For inotify, we want to be able to read transactions from in-progress edit log segments s

[jira] [Updated] (HDFS-6778) The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Attachment: HDFS-6778.002.patch Thanks for the review [~andrew.wang], I debated about whether to take

[jira] [Updated] (HDFS-6777) Supporting consistent edit log reads when in-progress edit log segments are included

2014-07-29 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6777: --- Attachment: 6777-design.pdf > Supporting consistent edit log reads when in-progress edit log segments

[jira] [Commented] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078677#comment-14078677 ] Allen Wittenauer commented on HDFS-6776: You should still be able to use distcp, yo

[jira] [Updated] (HDFS-6777) Supporting consistent edit log reads when in-progress edit log segments are included

2014-07-29 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6777: --- Attachment: HDFS-6777.patch > Supporting consistent edit log reads when in-progress edit log segments

[jira] [Commented] (HDFS-788) Datanode behaves badly when one disk is very low on space

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078649#comment-14078649 ] Arpit Agarwal commented on HDFS-788: >From a cursory look I don't think it is fixed. Wou

[jira] [Updated] (HDFS-6777) Supporting consistent edit log reads when in-progress edit log segments are included

2014-07-29 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Thomas updated HDFS-6777: --- Description: For inotify, we want to be able to read transactions from in-progress edit log segments

[jira] [Commented] (HDFS-6767) Cannot remove directory within encryption zone to Trash

2014-07-29 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078646#comment-14078646 ] Alejandro Abdelnur commented on HDFS-6767: -- are we failing the remove to trash wit

[jira] [Commented] (HDFS-6778) The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078642#comment-14078642 ] Andrew Wang commented on HDFS-6778: --- Forgot, AbstractFileSystem could use the same treatm

[jira] [Commented] (HDFS-6778) The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078640#comment-14078640 ] Andrew Wang commented on HDFS-6778: --- This is a nice improvement! It'll reduce duplication

[jira] [Commented] (HDFS-1026) Quota checks fail for small files and quotas

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078639#comment-14078639 ] Hadoop QA commented on HDFS-1026: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078637#comment-14078637 ] Yongjun Zhang commented on HDFS-6776: - Thanks a lot [~aw]! Would you please share some

[jira] [Updated] (HDFS-1026) Quota checks fail for small files and quotas

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1026: --- Status: Patch Available (was: Open) > Quota checks fail for small files and quotas >

[jira] [Updated] (HDFS-1026) Quota checks fail for small files and quotas

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-1026: --- Status: Open (was: Patch Available) > Quota checks fail for small files and quotas >

[jira] [Updated] (HDFS-6778) The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Summary: The extended attributes avadoc should simply refer to the HDFS Extended Attributes doc (was:

[jira] [Commented] (HDFS-6767) Cannot remove directory within encryption zone to Trash

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078628#comment-14078628 ] Andrew Wang commented on HDFS-6767: --- Since having a per-EZ trash directory isn't really w

[jira] [Work started] (HDFS-6778) The Extended Attributes Java doc should simply refer to the Extended Attributes doc

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6778 started by Charles Lamb. > The Extended Attributes Java doc should simply refer to the Extended > Attributes doc > -

[jira] [Updated] (HDFS-6778) The Extended Attributes Java doc should simply refer to the Extended Attributes doc

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6778: --- Attachment: HDFS-6778.001.patch [~andrew.wang], Take a look at the attached diffs and see if you like

[jira] [Commented] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078627#comment-14078627 ] Allen Wittenauer commented on HDFS-6776: Historically, that's intentional. Instead

[jira] [Resolved] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6771. --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Committed, thanks a

[jira] [Updated] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6771: -- Attachment: hdfs-6771.002.patch New patch addresses these nits, thanks for reviewing Charles. I'll commi

[jira] [Commented] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078606#comment-14078606 ] Andrew Wang commented on HDFS-6730: --- Hi Charles, thanks for working on this, some review

[jira] [Created] (HDFS-6777) Supporting consistent edit log reads when in-progress edit log segments are included

2014-07-29 Thread James Thomas (JIRA)
James Thomas created HDFS-6777: -- Summary: Supporting consistent edit log reads when in-progress edit log segments are included Key: HDFS-6777 URL: https://issues.apache.org/jira/browse/HDFS-6777 Project:

[jira] [Created] (HDFS-6778) The Extended Attributes Java doc should simply refer to the Extended Attributes doc

2014-07-29 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6778: -- Summary: The Extended Attributes Java doc should simply refer to the Extended Attributes doc Key: HDFS-6778 URL: https://issues.apache.org/jira/browse/HDFS-6778 Project:

[jira] [Updated] (HDFS-954) There are two security packages in hdfs, should be one

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-954: -- Labels: newbie (was: ) > There are two security packages in hdfs, should be one > --

[jira] [Updated] (HDFS-954) There are two security packages in hdfs, should be one

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-954: -- Component/s: test > There are two security packages in hdfs, should be one >

[jira] [Commented] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078589#comment-14078589 ] Charles Lamb commented on HDFS-6771: Nice. Two nits, but other than that, I'm +1. FSN:

[jira] [Created] (HDFS-6776) distcp from insecure cluster to secure cluster doesn't work

2014-07-29 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-6776: --- Summary: distcp from insecure cluster to secure cluster doesn't work Key: HDFS-6776 URL: https://issues.apache.org/jira/browse/HDFS-6776 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-945. --- Resolution: Duplicate I'm going to dupe this to HADOOP-9194. > Make NameNode resilient to DoS

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078574#comment-14078574 ] Arpit Agarwal commented on HDFS-6772: - Interesting find. Do you have any numbers for ho

[jira] [Commented] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078572#comment-14078572 ] Arpit Agarwal commented on HDFS-6685: - Also, just a heads up. The eventual merge with H

[jira] [Updated] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

2014-07-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6728: Attachment: HDFS-6728.002.patch > Dynamically add new volumes to DataStorage, formatted if necessary

[jira] [Updated] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

2014-07-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6728: Attachment: (was: HDFS-6728.002.patch) > Dynamically add new volumes to DataStorage, formatted i

[jira] [Comment Edited] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078563#comment-14078563 ] Arpit Agarwal edited comment on HDFS-6685 at 7/29/14 11:08 PM: --

[jira] [Commented] (HDFS-6685) Archival Storage: Update Balancer to preserve storage type of replicas

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078563#comment-14078563 ] Arpit Agarwal commented on HDFS-6685: - If the Balancer is an older version than the DNs

[jira] [Work started] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6771 started by Andrew Wang. > Require specification of an encryption key when creating an encryption zone > -

[jira] [Updated] (HDFS-6771) Require specification of an encryption key when creating an encryption zone

2014-07-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6771: -- Attachment: hdfs-6771.001.patch Patch attached. I changed this in HdfsAdmin and CryptoAdmin, updated the

[jira] [Commented] (HDFS-929) DFSClient#getBlockSize is unused

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078552#comment-14078552 ] Allen Wittenauer commented on HDFS-929: --- Do we want to actually deprecate this now or

[jira] [Updated] (HDFS-929) DFSClient#getBlockSize is unused

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-929: -- Status: Open (was: Patch Available) > DFSClient#getBlockSize is unused > ---

[jira] [Updated] (HDFS-929) DFSClient#getBlockSize is unused

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-929: -- Fix Version/s: (was: 0.24.0) > DFSClient#getBlockSize is unused > ---

[jira] [Resolved] (HDFS-924) Support reading and writing sequencefile in libhdfs

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-924. --- Resolution: Won't Fix > Support reading and writing sequencefile in libhdfs >

[jira] [Resolved] (HDFS-910) Update http://hadoop.apache.org/hdfs/credits.html with current list of committers

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-910. --- Resolution: Fixed > Update http://hadoop.apache.org/hdfs/credits.html with current list of > c

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-29 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078527#comment-14078527 ] Benoy Antony commented on HDFS-6441: [~szetszwo], [~arpitagarwal], could you please re

[jira] [Resolved] (HDFS-901) Fedora jdk install creates circular symlinks, causes test-c++-libhdfs not to build

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-901. --- Resolution: Won't Fix > Fedora jdk install creates circular symlinks, causes test-c++-libhdfs n

[jira] [Commented] (HDFS-6775) Users may see TrashPolicy if hdfs dfs -rm is run

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078514#comment-14078514 ] Allen Wittenauer commented on HDFS-6775: I haven't played much with the trash polic

[jira] [Updated] (HDFS-6775) Users may see TrashPolicy if hdfs dfs -rm is run

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6775: --- Affects Version/s: 3.0.0 > Users may see TrashPolicy if hdfs dfs -rm is run >

[jira] [Commented] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078515#comment-14078515 ] Arpit Agarwal commented on HDFS-6768: - The test failures are unrelated. > TestBlockRec

[jira] [Created] (HDFS-6775) Users may see TrashPolicy if hdfs dfs -rm is run

2014-07-29 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-6775: -- Summary: Users may see TrashPolicy if hdfs dfs -rm is run Key: HDFS-6775 URL: https://issues.apache.org/jira/browse/HDFS-6775 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6774) Remove volumes from DataStorage

2014-07-29 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-6774: --- Summary: Remove volumes from DataStorage Key: HDFS-6774 URL: https://issues.apache.org/jira/browse/HDFS-6774 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-6768) TestBlockRecovery, TestRefreshCallQueue and TestGenericRefresh should use ephemeral ports

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078500#comment-14078500 ] Hadoop QA commented on HDFS-6768: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-886) TestHDFSTrash fails on Windows

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-886. --- Resolution: Fixed > TestHDFSTrash fails on Windows > -- > >

[jira] [Resolved] (HDFS-888) TestModTime fails intermittently

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-888. --- Resolution: Fixed > TestModTime fails intermittently > > >

[jira] [Resolved] (HDFS-887) TestHDFSServerPorts fails on Windows

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-887. --- Resolution: Fixed > TestHDFSServerPorts fails on Windows >

[jira] [Commented] (HDFS-6441) Add ability to exclude/include few datanodes while balancing

2014-07-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078471#comment-14078471 ] Hadoop QA commented on HDFS-6441: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

2014-07-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6728: Attachment: HDFS-6728.002.patch Updated the patch to fix a bug to support multiple namespaces. > Dy

[jira] [Commented] (HDFS-6773) MiniDFSCluster can run dramatically faster

2014-07-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14078460#comment-14078460 ] Daryn Sharp commented on HDFS-6773: --- The reason is every NN operation currently takes the

[jira] [Created] (HDFS-6773) MiniDFSCluster can run dramatically faster

2014-07-29 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6773: - Summary: MiniDFSCluster can run dramatically faster Key: HDFS-6773 URL: https://issues.apache.org/jira/browse/HDFS-6773 Project: Hadoop HDFS Issue Type: Improvemen

[jira] [Updated] (HDFS-6730) Create a .RAW extended attribute namespace

2014-07-29 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6730: --- Attachment: HDFS-6730.001.patch A patch to implement the raw.* xattr namespace is attached. > Create

[jira] [Resolved] (HDFS-871) Balancer can hang in PendingBlockMove

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-871. --- Resolution: Fixed likely stale. > Balancer can hang in PendingBlockMove >

[jira] [Resolved] (HDFS-866) libhdfs with gdb got SEGV

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-866. --- Resolution: Cannot Reproduce > libhdfs with gdb got SEGV > - > >

[jira] [Created] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

2014-07-29 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6772: - Summary: Get DNs out of blockContentsStale==true state faster when NN restarts Key: HDFS-6772 URL: https://issues.apache.org/jira/browse/HDFS-6772 Project: Hadoop HDFS Is

[jira] [Resolved] (HDFS-862) Potential NN deadlock in processDistributedUpgradeCommand

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-862. --- Resolution: Won't Fix > Potential NN deadlock in processDistributedUpgradeCommand > ---

  1   2   >