[jira] [Commented] (HDFS-7782) Read a striping layout file from client side

2015-02-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341408#comment-14341408 ] Zhe Zhang commented on HDFS-7782: - I had an offline discussion with [~cmccabe] today around

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-27 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341399#comment-14341399 ] Bikas Saha commented on HDFS-7858: -- bq. The client will proceed to connect to that NN firs

[jira] [Updated] (HDFS-7759) Provide existence-of-a-second-file implementation for pinning blocks on Datanode

2015-02-27 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7759: --- Status: Patch Available (was: Open) Just checked the upgrade logic, it will take care all the files st

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341375#comment-14341375 ] Arun Suresh commented on HDFS-7858: --- [~kihwal], [~bikassaha], I understand your concerns

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-02-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341371#comment-14341371 ] Zhe Zhang commented on HDFS-7837: - Continued review: # I read the code again and figured ou

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-27 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341336#comment-14341336 ] Bikas Saha commented on HDFS-7858: -- We need to be careful about how many clients can be su

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341298#comment-14341298 ] Kai Zheng commented on HDFS-7855: - Hi Bo, 1. To complete the separation, you also need to

[jira] [Updated] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7855: Description: Class Packet is an inner class in DFSOutputStream and also used by DataStreamer. This sub task s

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341261#comment-14341261 ] Li Bo commented on HDFS-7855: - This patch just adds a new class which has not been used by any

[jira] [Commented] (HDFS-7837) Erasure Coding: allocate and persist striped blocks in NameNode

2015-02-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341170#comment-14341170 ] Zhe Zhang commented on HDFS-7837: - Great work Jing! I haven't finished reviewing the entire

[jira] [Comment Edited] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339006#comment-14339006 ] Yi Liu edited comment on HDFS-7285 at 2/28/15 1:36 AM: --- We had anothe

[jira] [Updated] (HDFS-7664) Reed-Solomon ErasureCoder

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7664: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) > Reed-Solomon ErasureCoder > --

[jira] [Updated] (HDFS-7662) Erasure Coder API for encoding and decoding of block group

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7662: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) > Erasure Coder API for encoding and decodin

[jira] [Updated] (HDFS-7699) Erasure Codec API covering the essential aspects for an erasure code

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7699: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) > Erasure Codec API covering the essential a

[jira] [Updated] (HDFS-7785) Improve diagnostics for HttpPutFailedException

2015-02-27 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7785: Status: Patch Available (was: Open) > Improve diagnostics for HttpPutFailedException > -

[jira] [Updated] (HDFS-7785) Improve diagnostics for HttpPutFailedException

2015-02-27 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated HDFS-7785: Status: Open (was: Patch Available) > Improve diagnostics for HttpPutFailedException > -

[jira] [Work started] (HDFS-7613) Block placement policy for erasure coding groups

2015-02-27 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7613 started by Walter Su. --- > Block placement policy for erasure coding groups > ---

[jira] [Updated] (HDFS-7339) Representing striped block groups in NameNode with hierarchical naming protocol

2015-02-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7339: Summary: Representing striped block groups in NameNode with hierarchical naming protocol (was: Allocating an

[jira] [Commented] (HDFS-7820) Client Write fails after rolling upgrade rollback with " already exist in finalized state"

2015-02-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341099#comment-14341099 ] Arpit Agarwal commented on HDFS-7820: - One thing I did not understand - the finalized b

[jira] [Commented] (HDFS-7820) Client Write fails after rolling upgrade rollback with " already exist in finalized state"

2015-02-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341087#comment-14341087 ] Arpit Agarwal commented on HDFS-7820: - Thank you for reporting this issue [~andreina].

[jira] [Updated] (HDFS-7820) Client Write fails after rolling upgrade rollback with " already exist in finalized state"

2015-02-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7820: Summary: Client Write fails after rolling upgrade rollback with " already exist in finalized state"

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341074#comment-14341074 ] Arpit Agarwal commented on HDFS-7836: - bq. 1 M blocks per disk, on 10 disks, and 24 byt

[jira] [Commented] (HDFS-6488) HDFS superuser unable to access user's Trash files using NFSv3 mount

2015-02-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341035#comment-14341035 ] Akira AJISAKA commented on HDFS-6488: - Thanks [~brandonli] for the patch. Some comments

[jira] [Updated] (HDFS-7188) support build libhdfs3 on windows

2015-02-27 Thread Thanh Do (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thanh Do updated HDFS-7188: --- Attachment: HDFS-7188-branch-HDFS-6994-3.patch Hi [~cmccabe]. Attached is my next patch which addresses your co

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341012#comment-14341012 ] Hadoop QA commented on HDFS-7435: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-7862) Revisit the use of long data type

2015-02-27 Thread Thanh Do (JIRA)
Thanh Do created HDFS-7862: -- Summary: Revisit the use of long data type Key: HDFS-7862 URL: https://issues.apache.org/jira/browse/HDFS-7862 Project: Hadoop HDFS Issue Type: Sub-task Repo

[jira] [Created] (HDFS-7861) Revisit Windows socket API compatibility

2015-02-27 Thread Thanh Do (JIRA)
Thanh Do created HDFS-7861: -- Summary: Revisit Windows socket API compatibility Key: HDFS-7861 URL: https://issues.apache.org/jira/browse/HDFS-7861 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7860) Get HA NameNode information from config file

2015-02-27 Thread Thanh Do (JIRA)
Thanh Do created HDFS-7860: -- Summary: Get HA NameNode information from config file Key: HDFS-7860 URL: https://issues.apache.org/jira/browse/HDFS-7860 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340974#comment-14340974 ] Kai Zheng commented on HDFS-7839: - If it's concluded that we don't support nested EC zone,

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340961#comment-14340961 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-trunk-Commit #7222 (See [https:

[jira] [Resolved] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-7769. --- Resolution: Fixed Fix Version/s: 2.7.0 > TestHDFSCLI create files in hdfs projec

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340951#comment-14340951 ] Konstantin Shvachko commented on HDFS-7769: --- I just recommitted this. Thank you N

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340952#comment-14340952 ] Jing Zhao commented on HDFS-7435: - Thanks for updating the patch, Daryn. I will review the

[jira] [Commented] (HDFS-7349) Support DFS command for the EC encoding

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340948#comment-14340948 ] Kai Zheng commented on HDFS-7349: - Please note about preparing and maintaining EC schemas,

[jira] [Commented] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340937#comment-14340937 ] Kai Zheng commented on HDFS-7839: - To better reflect what's been doing here in the patch, s

[jira] [Updated] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7839: Description: As a quick first step to facilitate initial development and testing, HDFS-7347 added EC configu

[jira] [Updated] (HDFS-7839) Erasure coding: implement facilities in NameNode to create and manage EC zones

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7839: Summary: Erasure coding: implement facilities in NameNode to create and manage EC zones (was: Erasure coding

[jira] [Commented] (HDFS-7349) Support DFS command for the EC encoding

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340912#comment-14340912 ] Kai Zheng commented on HDFS-7349: - To ease the sync and collaboration among all of these re

[jira] [Commented] (HDFS-7371) Loading predefined EC schemas from configuration

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340909#comment-14340909 ] Kai Zheng commented on HDFS-7371: - To ease the sync and collaboration among all of these re

[jira] [Commented] (HDFS-7371) Loading predefined EC schemas from configuration

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340897#comment-14340897 ] Kai Zheng commented on HDFS-7371: - It's great to have HDFS-7839, so this one will focus on

[jira] [Created] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

2015-02-27 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-7859: --- Summary: Erasure Coding: Persist EC schemas in NameNode Key: HDFS-7859 URL: https://issues.apache.org/jira/browse/HDFS-7859 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340861#comment-14340861 ] Kai Zheng commented on HDFS-7285: - Thanks [~zhz] a lot for scheduling the meetup discussion

[jira] [Commented] (HDFS-7308) DFSClient write packet size may > 64kB

2015-02-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340851#comment-14340851 ] Yongjun Zhang commented on HDFS-7308: - Thanks [~tfukudom] and [~szetszwo]! > DFSClien

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340846#comment-14340846 ] Kihwal Lee commented on HDFS-7858: -- ZK may not scale to support thousands of clients. I th

[jira] [Commented] (HDFS-7839) Erasure coding: move EC policies from file header to XAttr

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340845#comment-14340845 ] Kai Zheng commented on HDFS-7839: - I took a quick look at the patch and have some comments.

[jira] [Commented] (HDFS-7749) Erasure Coding: Add striped block support in INodeFile

2015-02-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340833#comment-14340833 ] Zhe Zhang commented on HDFS-7749: - I see, thanks for the tips. I'm working on HDFS-7837 and

[jira] [Resolved] (HDFS-6445) NFS: Add a log message 'Permission denied' while writing data from read only mountpoint

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-6445. -- Resolution: Duplicate > NFS: Add a log message 'Permission denied' while writing data from read only > m

[jira] [Comment Edited] (HDFS-6445) NFS: Add a log message 'Permission denied' while writing data from read only mountpoint

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340658#comment-14340658 ] Brandon Li edited comment on HDFS-6445 at 2/27/15 9:14 PM: --- I bel

[jira] [Commented] (HDFS-7749) Erasure Coding: Add striped block support in INodeFile

2015-02-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340822#comment-14340822 ] Jing Zhao commented on HDFS-7749: - Hi Zhe, thanks for running the tests! I guess HDFS-7837

[jira] [Created] (HDFS-7858) Improve HA Namenode Failover detection on the client using Zookeeper

2015-02-27 Thread Arun Suresh (JIRA)
Arun Suresh created HDFS-7858: - Summary: Improve HA Namenode Failover detection on the client using Zookeeper Key: HDFS-7858 URL: https://issues.apache.org/jira/browse/HDFS-7858 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7839) Erasure coding: move EC policies from file header to XAttr

2015-02-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340774#comment-14340774 ] Kai Zheng commented on HDFS-7839: - Thanks [~zhz] for taking care of this. bq.Should we allo

[jira] [Commented] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340759#comment-14340759 ] Hudson commented on HDFS-7685: -- FAILURE: Integrated in Hadoop-trunk-Commit #7221 (See [https:

[jira] [Updated] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7685: Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Com

[jira] [Updated] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml

2015-02-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7685: Summary: Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml (was: Document dfs.nam

[jira] [Updated] (HDFS-7685) Document dfs.namenode.heartbeat.recheck-interval in hdfs-site.xml

2015-02-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7685: Summary: Document dfs.namenode.heartbeat.recheck-interval in hdfs-site.xml (was: Document funct

[jira] [Commented] (HDFS-7749) Erasure Coding: Add striped block support in INodeFile

2015-02-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340742#comment-14340742 ] Zhe Zhang commented on HDFS-7749: - [~jingzhao] I manually ran some failed tests from the HD

[jira] [Updated] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7435: -- Attachment: HDFS-7435.patch Would have been nice if findbugs told me I needed equals and hashCode at the

[jira] [Resolved] (HDFS-6446) NFS: Different error messages for appending/writing data from read only mount

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-6446. -- Resolution: Duplicate > NFS: Different error messages for appending/writing data from read only mount > -

[jira] [Assigned] (HDFS-6446) NFS: Different error messages for appending/writing data from read only mount

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-6446: Assignee: Brandon Li > NFS: Different error messages for appending/writing data from read only mount

[jira] [Commented] (HDFS-6446) NFS: Different error messages for appending/writing data from read only mount

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340678#comment-14340678 ] Brandon Li commented on HDFS-6446: -- I believe this problem has been fixed by HDFS-6411. Th

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340664#comment-14340664 ] Hadoop QA commented on HDFS-7435: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6445) NFS: Add a log message 'Permission denied' while writing data from read only mountpoint

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340658#comment-14340658 ] Brandon Li commented on HDFS-6445: -- I believe it's fixed by other fixes, which did the cor

[jira] [Commented] (HDFS-6445) NFS: Add a log message 'Permission denied' while writing data from read only mountpoint

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340654#comment-14340654 ] Brandon Li commented on HDFS-6445: -- This problem is not reproducible any more. I tried som

[jira] [Assigned] (HDFS-6445) NFS: Add a log message 'Permission denied' while writing data from read only mountpoint

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-6445: Assignee: Brandon Li > NFS: Add a log message 'Permission denied' while writing data from read only

[jira] [Commented] (HDFS-6488) HDFS superuser unable to access user's Trash files using NFSv3 mount

2015-02-27 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340562#comment-14340562 ] Stephen Chu commented on HDFS-6488: --- Hi [~brandonli], the patch looks good. I verified on

[jira] [Commented] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-02-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340571#comment-14340571 ] Yongjun Zhang commented on HDFS-7857: - Hi [~jingzhao], Thanks for your earlier work a

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340565#comment-14340565 ] Konstantin Shvachko commented on HDFS-7769: --- I did also +1 HDFS-7769. The patch w

[jira] [Created] (HDFS-7857) Incomplete information in WARN message caused user confusion

2015-02-27 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-7857: --- Summary: Incomplete information in WARN message caused user confusion Key: HDFS-7857 URL: https://issues.apache.org/jira/browse/HDFS-7857 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-6488) HDFS superuser unable to access user's Trash files using NFSv3 mount

2015-02-27 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-6488: Assignee: Brandon Li > HDFS superuser unable to access user's Trash files using NFSv3 mount > --

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340483#comment-14340483 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-02-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340474#comment-14340474 ] Daryn Sharp commented on HDFS-7836: --- Colin, please take a look and provide feedback on th

[jira] [Updated] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-02-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-6658: -- Attachment: BlocksMap redesign.pdf For months I've been adapting the concepts of Amir's work, and extensi

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340444#comment-14340444 ] Hadoop QA commented on HDFS-6658: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7785) Improve diagnostics for HttpPutFailedException

2015-02-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340449#comment-14340449 ] Steve Loughran commented on HDFS-7785: -- just cancel the patch and then hit the submit

[jira] [Assigned] (HDFS-6658) Namenode memory optimization - Block replicas list

2015-02-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-6658: - Assignee: Daryn Sharp (was: Amir Langer) > Namenode memory optimization - Block replicas list >

[jira] [Commented] (HDFS-7439) Add BlockOpResponseProto's message to DFSClient's exception message

2015-02-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340327#comment-14340327 ] Tsz Wo Nicholas Sze commented on HDFS-7439: --- Thanks for the new patch. Some mino

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340309#comment-14340309 ] Daryn Sharp commented on HDFS-7435: --- [~sureshms], [~jingzhao], could you please review th

[jira] [Commented] (HDFS-7308) DFSClient write packet size may > 64kB

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340313#comment-14340313 ] Hudson commented on HDFS-7308: -- FAILURE: Integrated in Hadoop-trunk-Commit #7219 (See [https:

[jira] [Updated] (HDFS-7308) DFSClient write packet size may > 64kB

2015-02-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7308: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Ava

[jira] [Updated] (HDFS-7435) PB encoding of block reports is very inefficient

2015-02-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-7435: -- Attachment: HDFS-7435.patch Fixed findbugs by adding equals and reverting back the switch. Fixed fsimage

[jira] [Commented] (HDFS-7308) DFSClient write packet size may > 64kB

2015-02-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340296#comment-14340296 ] Tsz Wo Nicholas Sze commented on HDFS-7308: --- +1 the new patch looks good. Thanks

[jira] [Commented] (HDFS-6753) Initialize checkDisk when DirectoryScanner not able to get files list for scanning

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340282#comment-14340282 ] Hudson commented on HDFS-6753: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2067 (See [htt

[jira] [Commented] (HDFS-7774) Unresolved symbols error while compiling HDFS on Windows 7/32 bit

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340287#comment-14340287 ] Hudson commented on HDFS-7774: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2067 (See [htt

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340286#comment-14340286 ] Hudson commented on HDFS-7769: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2067 (See [htt

[jira] [Commented] (HDFS-7819) Log WARN message for the blocks which are not in Block ID based layout

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340289#comment-14340289 ] Hudson commented on HDFS-7819: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2067 (See [htt

[jira] [Commented] (HDFS-7774) Unresolved symbols error while compiling HDFS on Windows 7/32 bit

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340251#comment-14340251 ] Hudson commented on HDFS-7774: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #117 (See

[jira] [Commented] (HDFS-6753) Initialize checkDisk when DirectoryScanner not able to get files list for scanning

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340245#comment-14340245 ] Hudson commented on HDFS-6753: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #117 (See

[jira] [Commented] (HDFS-7819) Log WARN message for the blocks which are not in Block ID based layout

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340253#comment-14340253 ] Hudson commented on HDFS-7819: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #117 (See

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340250#comment-14340250 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #117 (See

[jira] [Commented] (HDFS-7855) Separate class Packet from DFSOutputStream

2015-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340199#comment-14340199 ] Hadoop QA commented on HDFS-7855: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340181#comment-14340181 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #108 (See [htt

[jira] [Commented] (HDFS-6753) Initialize checkDisk when DirectoryScanner not able to get files list for scanning

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340177#comment-14340177 ] Hudson commented on HDFS-6753: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #108 (See [htt

[jira] [Commented] (HDFS-7774) Unresolved symbols error while compiling HDFS on Windows 7/32 bit

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340182#comment-14340182 ] Hudson commented on HDFS-7774: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #108 (See [htt

[jira] [Commented] (HDFS-7819) Log WARN message for the blocks which are not in Block ID based layout

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340184#comment-14340184 ] Hudson commented on HDFS-7819: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #108 (See [htt

[jira] [Commented] (HDFS-7774) Unresolved symbols error while compiling HDFS on Windows 7/32 bit

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340171#comment-14340171 ] Hudson commented on HDFS-7774: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2049 (See [https://

[jira] [Commented] (HDFS-7819) Log WARN message for the blocks which are not in Block ID based layout

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340173#comment-14340173 ] Hudson commented on HDFS-7819: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2049 (See [https://

[jira] [Commented] (HDFS-6753) Initialize checkDisk when DirectoryScanner not able to get files list for scanning

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340166#comment-14340166 ] Hudson commented on HDFS-6753: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2049 (See [https://

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340170#comment-14340170 ] Hudson commented on HDFS-7769: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2049 (See [https://

[jira] [Commented] (HDFS-7439) Add BlockOpResponseProto's message to DFSClient's exception message

2015-02-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340083#comment-14340083 ] Hadoop QA commented on HDFS-7439: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7820) Client Write fails after rolling upgrade operation with " already exist in finalized state"

2015-02-27 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-7820: - Attachment: HDFS-7820.1.patch I have attached a patch where the block id value will be incremented by 10 m

  1   2   >