[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352115#comment-14352115 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- If you believe that the new patch co

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352119#comment-14352119 ] Tsz Wo Nicholas Sze commented on HDFS-7769: --- > ... It's been enforced fairly stri

[jira] [Updated] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7898: -- Status: Patch Available (was: Open) > Change TestAppendSnapshotTruncate to fail-fast > -

[jira] [Updated] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7898: -- Attachment: h7898_20150309.patch h7898_20150309.patch: adds timeout and changes DirWorker

[jira] [Updated] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7894: --- Attachment: HDFS-7894-002.patch > Rolling upgrade readiness is not updated in jmx until

[jira] [Commented] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352169#comment-14352169 ] Brahma Reddy Battula commented on HDFS-7894: Thanks a lot for your pointers,,Ad

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352175#comment-14352175 ] Tsz Wo Nicholas Sze commented on HDFS-7884: --- When I was working on HDFS-7746, the

[jira] [Updated] (HDFS-7884) NullPointerException in BlockSender

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7884: -- Attachment: org.apache.hadoop.hdfs.TestAppendSnapshotTruncate-output.txt org.apache.hadoo

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352180#comment-14352180 ] Brahma Reddy Battula commented on HDFS-7884: Thanks a lot for your input...let

[jira] [Work started] (HDFS-7894) Rolling upgrade readiness is not updated in jmx until query command is issued.

2015-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7894 started by Brahma Reddy Battula. -- > Rolling upgrade readiness is not updated in jmx until query command

[jira] [Created] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7903: - Summary: Cannot recover block after truncate and delete snapshot Key: HDFS-7903 URL: https://issues.apache.org/jira/browse/HDFS-7903 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7903: -- Attachment: testMultipleTruncate.patch testMultipleTruncate.patch: after this patch, the

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7903: -- Attachment: testMultipleTruncate.patch > Cannot recover block after truncate and delete s

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7903: -- Attachment: (was: testMultipleTruncate.patch) > Cannot recover block after truncate a

[jira] [Commented] (HDFS-7881) TestHftpFileSystem#testSeek fails in branch-2

2015-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352208#comment-14352208 ] Brahma Reddy Battula commented on HDFS-7881: After deeper look into this issue

[jira] [Commented] (HDFS-7898) Change TestAppendSnapshotTruncate to fail-fast

2015-03-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352234#comment-14352234 ] Hadoop QA commented on HDFS-7898: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7460) Rewrite httpfs to use new shell framework

2015-03-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7460: --- Component/s: scripts > Rewrite httpfs to use new shell framework >

[jira] [Created] (HDFS-7904) NFS hard codes ShellBasedIdMapping

2015-03-08 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HDFS-7904: -- Summary: NFS hard codes ShellBasedIdMapping Key: HDFS-7904 URL: https://issues.apache.org/jira/browse/HDFS-7904 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7904) NFS hard codes ShellBasedIdMapping

2015-03-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7904: --- Component/s: nfs > NFS hard codes ShellBasedIdMapping > -- > >

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352357#comment-14352357 ] Allen Wittenauer commented on HDFS-7877: Isn't this effectively a dupe of HDFS-6729

[jira] [Assigned] (HDFS-7904) NFS hard codes ShellBasedIdMapping

2015-03-08 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-7904: -- Assignee: Brahma Reddy Battula > NFS hard codes ShellBasedIdMapping > --

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7411: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7360: --- Attachment: HDFS-7360-pnative.004.patch In new patch: 1) fix the jni library link order issue. 2) gener

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352424#comment-14352424 ] Hudson commented on HDFS-7411: -- FAILURE: Integrated in Hadoop-trunk-Commit #7281 (See [https:

[jira] [Commented] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352423#comment-14352423 ] Zhanwei Wang commented on HDFS-7360: I have setup a CI on travis-ci.org to test my patc

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

2015-03-08 Thread Hui Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352435#comment-14352435 ] Hui Zheng commented on HDFS-7827: - To support striped block in no-protobuf fsimage we only

[jira] [Updated] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7360: --- Attachment: (was: HDFS-7360-pnative.004.patch) > Test libhdfs3 against MiniDFSCluster > ---

[jira] [Updated] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2015-03-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7360: --- Attachment: HDFS-7360-pnative.004.patch > Test libhdfs3 against MiniDFSCluster > --

[jira] [Updated] (HDFS-7891) a block placement policy with best fault tolerance

2015-03-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7891: Attachment: HDFS-7891.patch > a block placement policy with best fault tolerance > --

[jira] [Commented] (HDFS-7877) Support maintenance state for datanodes

2015-03-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352471#comment-14352471 ] Ming Ma commented on HDFS-7877: --- Thanks Allen for pointing out. We didn't know about HDFS-672

[jira] [Commented] (HDFS-6729) Support maintenance mode for DN

2015-03-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352477#comment-14352477 ] Ming Ma commented on HDFS-6729: --- Eddy, thanks for the work. We didn't know about this at all

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

2015-03-08 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7854: Attachment: HDFS-7854-003.patch Patch 003 fixes one javac warning. Two findBugs warnings seem already existing befor

[jira] [Updated] (HDFS-7857) Incomplete information in authentication failure WARN message caused user confusion

2015-03-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7857: Summary: Incomplete information in authentication failure WARN message caused user confusion (was: I

[jira] [Updated] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7857: Summary: Improve authentication failure WARN message to avoid user confusion (was: Incomplete inform

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352500#comment-14352500 ] Hudson commented on HDFS-7857: -- FAILURE: Integrated in Hadoop-trunk-Commit #7285 (See [https:

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352509#comment-14352509 ] Yongjun Zhang commented on HDFS-7857: - Thanks a lot [~jingzhao]! I tried to commit and

[jira] [Commented] (HDFS-7857) Improve authentication failure WARN message to avoid user confusion

2015-03-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352516#comment-14352516 ] Hudson commented on HDFS-7857: -- FAILURE: Integrated in Hadoop-trunk-Commit #7286 (See [https:

[jira] [Updated] (HDFS-7068) Support multiple block placement policies

2015-03-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7068: Attachment: HDFS-7068.patch > Support multiple block placement policies > ---

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352558#comment-14352558 ] Walter Su commented on HDFS-7068: - I think putting block placement policy selection strateg

[jira] [Updated] (HDFS-5809) BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop

2015-03-08 Thread Vishal Rajan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Rajan updated HDFS-5809: --- Environment: jdk1.6/java 1.7, centos6.4/debian6, 2.0.0-cdh4.5.0 (was: jdk1.6, centos6.4, 2.0.0-cdh4.5.

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352567#comment-14352567 ] Walter Su commented on HDFS-7068: - part of this patch is for HDFS-7613. Maybe I should subm

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352568#comment-14352568 ] Walter Su commented on HDFS-7068: - part of this patch is for HDFS-7613. Maybe I should subm

[jira] [Commented] (HDFS-7613) Block placement policy for erasure coding groups

2015-03-08 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352571#comment-14352571 ] Walter Su commented on HDFS-7613: - This jira is implemented by HDFS-7891 and HDFS-7068 1. a

[jira] [Updated] (HDFS-7737) Implement distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7737: Attachment: Replication Of Name Nodes.pdf Dynamic Subtree Binary Partitioning Proposal.pdf

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: (was: DATABFDT-MetadataMovingToolDesignProposal-Efforttoarealdistributednamenode-050215-1415-

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: (was: Overflow+Table+Design+–+Record+Moved+Namespace+Locations.pdf) > Move metadata across n

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: Metadata Moving Tool.pdf > Move metadata across namenode - Effort to a real distributed namenode

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: Impement Overflow Table.pdf > Move metadata across namenode - Effort to a real distributed nameno

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: (was: Impement Overflow Table.pdf) > Move metadata across namenode - Effort to a real distrib

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: Implement Overflow Table.pdf > Move metadata across namenode - Effort to a real distributed namen

[jira] [Updated] (HDFS-7737) Implement distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7737: Attachment: Implement Overflow Table.pdf > Implement distributed namenode > -- >

[jira] [Updated] (HDFS-7702) Move metadata across namenode - Effort to a real distributed namenode

2015-03-08 Thread Ray Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Zhang updated HDFS-7702: Attachment: (was: Implement Overflow Table.pdf) > Move metadata across namenode - Effort to a real distri

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

2015-03-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352591#comment-14352591 ] Vinayakumar B commented on HDFS-7884: - I think, its just a race between client-read and

[jira] [Comment Edited] (HDFS-7884) NullPointerException in BlockSender

2015-03-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352591#comment-14352591 ] Vinayakumar B edited comment on HDFS-7884 at 3/9/15 6:52 AM: - E