[jira] [Commented] (HDFS-7697) Document the scope of the PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-7697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361610#comment-14361610 ] Lei (Eddy) Xu commented on HDFS-7697: - Thanks to bring it up, [~wheat9]. I will post th

[jira] [Updated] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6946: - Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) > TestBalancerWithSaslDataTransfer fa

[jira] [Commented] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361568#comment-14361568 ] Hadoop QA commented on HDFS-7929: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361567#comment-14361567 ] Hadoop QA commented on HDFS-7915: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361552#comment-14361552 ] Yi Liu commented on HDFS-7926: -- You have a point there, thanks. > NameNode implementation of

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361536#comment-14361536 ] Karthik Kambatla commented on HDFS-7858: If possible, it would be nice to make the

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361484#comment-14361484 ] Hudson commented on HDFS-7915: -- FAILURE: Integrated in Hadoop-trunk-Commit #7323 (See [https:

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361481#comment-14361481 ] Tsz Wo Nicholas Sze commented on HDFS-7926: --- "idempotent" means applying the same

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361480#comment-14361480 ] Hudson commented on HDFS-7915: -- FAILURE: Integrated in Hadoop-trunk-Commit #7322 (See [https:

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Status: Patch Available (was: Reopened) > The DataNode can sometimes allocate a ShortC

[jira] [Reopened] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-7915: oops, I just saw that jenkins didn't run on v6 yet. sigh... > The DataNode can sometime

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch A

[jira] [Commented] (HDFS-5946) Webhdfs DN choosing code is flawed

[ https://issues.apache.org/jira/browse/HDFS-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361443#comment-14361443 ] Haohui Mai commented on HDFS-5946: -- Any updates on this? > Webhdfs DN choosing code is fl

[jira] [Resolved] (HDFS-6118) Code cleanup

[ https://issues.apache.org/jira/browse/HDFS-6118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-6118. -- Resolution: Fixed > Code cleanup > > > Key: HDFS-6118 > URL:

[jira] [Resolved] (HDFS-6496) WebHDFS cannot open file

[ https://issues.apache.org/jira/browse/HDFS-6496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-6496. -- Resolution: Invalid > WebHDFS cannot open file > > > Key: HDFS-6

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361433#comment-14361433 ] Yongjun Zhang commented on HDFS-7915: - Hi [~cmccabe], Thanks for the updated patch. +1

[jira] [Resolved] (HDFS-7050) Implementation of NameNodeMXBean.getLiveNodes() skips DataNodes started on the same host

[ https://issues.apache.org/jira/browse/HDFS-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-7050. -- Resolution: Duplicate Fixed in HDFS-7303 > Implementation of NameNodeMXBean.getLiveNodes() skips DataNod

[jira] [Commented] (HDFS-7063) WebHDFS: Avoid using sockets in datanode when the traffic is local

[ https://issues.apache.org/jira/browse/HDFS-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361427#comment-14361427 ] Haohui Mai commented on HDFS-7063: -- It should not be an issue if short circuit read is tur

[jira] [Assigned] (HDFS-7930) commitBlockSynchronization() does not remove locations, which were not confirmed

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7930: Assignee: Yi Liu > commitBlockSynchronization() does not remove locations, which were not > confirmed > ---

[jira] [Resolved] (HDFS-7191) WebHDFS prematurely closes connections under high concurrent loads

[ https://issues.apache.org/jira/browse/HDFS-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-7191. -- Resolution: Duplicate HDFS-7279 should fix this problem. > WebHDFS prematurely closes connections under

[jira] [Comment Edited] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361389#comment-14361389 ] Yi Liu edited comment on HDFS-7926 at 3/14/15 12:29 AM: Thanks [~sz

[jira] [Commented] (HDFS-7697) Document the scope of the PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-7697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361390#comment-14361390 ] Haohui Mai commented on HDFS-7697: -- I think it is best to get it done before 2.7 is out. A

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361389#comment-14361389 ] Yi Liu commented on HDFS-7926: -- Thanks [~szetszwo] for the fix. Actually I agree that {{idempo

[jira] [Updated] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6585: - Resolution: Duplicate Status: Resolved (was: Patch Available) I think the patch has been supersede

[jira] [Commented] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361382#comment-14361382 ] Hadoop QA commented on HDFS-6585: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6585) INodesInPath.resolve is called multiple times in FSNamesystem.setPermission

[ https://issues.apache.org/jira/browse/HDFS-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6585: - Labels: (was: patch) > INodesInPath.resolve is called multiple times in FSNamesystem.setPermission >

[jira] [Resolved] (HDFS-5193) Unifying HA support in HftpFileSystem, HsftpFileSystem and WebHdfsFileSystem

[ https://issues.apache.org/jira/browse/HDFS-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-5193. -- Resolution: Won't Fix As hftp is phasing out there are few motivations to get this fixed. > Unifying HA

[jira] [Commented] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361354#comment-14361354 ] Hadoop QA commented on HDFS-7917: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7929: Attachment: HDFS-7929-000.patch > inotify unable fetch pre-upgrade edit log segments once upgrade starts > --

[jira] [Updated] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

[ https://issues.apache.org/jira/browse/HDFS-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7929: Status: Patch Available (was: Open) Very rough initial patch to demo the idea. [~cmccabe] Could you take a

[jira] [Updated] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7917: Attachment: HDFS-7917.000.patch Add {{DataNodeTestUtils#injectDataDirFailure()}} and {{restoreDataDi

[jira] [Updated] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7917: Status: Patch Available (was: Open) > Use file to replace data dirs in test to simulate a disk failu

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.006.patch > The DataNode can sometimes allocate a ShortCircuitShm

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations, which were not confirmed

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361304#comment-14361304 ] Byron Wong commented on HDFS-7930: -- The failure is reproducible (after applying the latest

[jira] [Comment Edited] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361303#comment-14361303 ] Colin Patrick McCabe edited comment on HDFS-7878 at 3/13/15 11:24 PM: ---

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361303#comment-14361303 ] Colin Patrick McCabe commented on HDFS-7878: bq. Jing wrote: Could you please a

[jira] [Resolved] (HDFS-1841) Enforce read-only permissions in FUSE open()

[ https://issues.apache.org/jira/browse/HDFS-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-1841. Resolution: Duplicate duplicate of HDFS-4139 from 2012 > Enforce read-only permissio

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361289#comment-14361289 ] Brandon Li commented on HDFS-5523: -- [~Rosa], I guess you posted comments to a wrong JIRA.

[jira] [Commented] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361282#comment-14361282 ] Colin Patrick McCabe commented on HDFS-7261: thanks, [~brahmareddy]. 403

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361281#comment-14361281 ] Chris Nauroth commented on HDFS-7915: - Thanks, Colin. I had missed that the first time

[jira] [Commented] (HDFS-7838) Expose truncate API for libhdfs

[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361279#comment-14361279 ] Colin Patrick McCabe commented on HDFS-7838: The libhdfs part looks correct, bu

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361271#comment-14361271 ] Hadoop QA commented on HDFS-7915: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361264#comment-14361264 ] Colin Patrick McCabe commented on HDFS-7915: I did answer that comment, here:

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361263#comment-14361263 ] Rosa Ali commented on HDFS-7369: Please tell me how i can use batch file HDFS-1783 https:/

[jira] [Commented] (HDFS-5356) MiniDFSCluster shoud close all open FileSystems when shutdown()

[ https://issues.apache.org/jira/browse/HDFS-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361258#comment-14361258 ] Hadoop QA commented on HDFS-5356: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361260#comment-14361260 ] Rosa Ali commented on HDFS-7915: Please tell me how i can use batch file HDFS-1783 https:/

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361259#comment-14361259 ] Rosa Ali commented on HDFS-5523: Please tell me how i can use batch file HDFS-1783 https:/

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361257#comment-14361257 ] Rosa Ali commented on HDFS-7922: Please tell me how i can use batch file HDFS-1783 https:/

[jira] [Commented] (HDFS-7922) ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors

[ https://issues.apache.org/jira/browse/HDFS-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361255#comment-14361255 ] Colin Patrick McCabe commented on HDFS-7922: Note that this is never a problem

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361225#comment-14361225 ] Brandon Li commented on HDFS-5523: -- [~zhz], please feel free to take over. I am not workin

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361218#comment-14361218 ] Chris Nauroth commented on HDFS-7915: - I'm repeating my earlier comment in case it got

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361210#comment-14361210 ] Hadoop QA commented on HDFS-7915: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7915: --- Attachment: HDFS-7915.005.patch updated patch > The DataNode can sometimes allocate a

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361208#comment-14361208 ] Colin Patrick McCabe commented on HDFS-7915: bq. 1. I think we should look hard

[jira] [Created] (HDFS-7933) fsck should also report decommissioning replicas.

Jitendra Nath Pandey created HDFS-7933: -- Summary: fsck should also report decommissioning replicas. Key: HDFS-7933 URL: https://issues.apache.org/jira/browse/HDFS-7933 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361176#comment-14361176 ] Zhe Zhang commented on HDFS-7369: - Thanks for the review Kai! # Naming: Thanks for bringin

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361165#comment-14361165 ] Hadoop QA commented on HDFS-7932: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7932: - Attachment: HDFS-7932.patch > Speed up the shutdown of datanode during rolling upgrade > --

[jira] [Updated] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7932: - Assignee: Kihwal Lee Status: Patch Available (was: Open) > Speed up the shutdown of datanode during

[jira] [Commented] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

[ https://issues.apache.org/jira/browse/HDFS-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361160#comment-14361160 ] Kihwal Lee commented on HDFS-7932: -- Here is an example of slow shutdown. Instead of waiti

[jira] [Created] (HDFS-7932) Speed up the shutdown of datanode during rolling upgrade

Kihwal Lee created HDFS-7932: Summary: Speed up the shutdown of datanode during rolling upgrade Key: HDFS-7932 URL: https://issues.apache.org/jira/browse/HDFS-7932 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-7369) Erasure coding: distribute recovery work for striped blocks to DataNode

[ https://issues.apache.org/jira/browse/HDFS-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361131#comment-14361131 ] Kai Zheng commented on HDFS-7369: - Thanks Zhe for the update. Some comments. 1. Looking at

[jira] [Updated] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2605: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Statu

[jira] [Commented] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361075#comment-14361075 ] Hudson commented on HDFS-2605: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7320 (See [https:

[jira] [Updated] (HDFS-7903) Cannot recover block after truncate and delete snapshot

[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7903: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Statu

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361041#comment-14361041 ] Hudson commented on HDFS-7903: -- FAILURE: Integrated in Hadoop-trunk-Commit #7319 (See [https:

[jira] [Updated] (HDFS-7931) Spurious Error message "Could not find uri with key [dfs.encryption.key.provider.uri] to create a key" appears even when Encryption is dissabled

[ https://issues.apache.org/jira/browse/HDFS-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7931: -- Environment: (was: The {{addDelegationTokens}} method in {{DistributedFileSystem}} calls {{DFSClient#

[jira] [Updated] (HDFS-7931) Spurious Error message "Could not find uri with key [dfs.encryption.key.provider.uri] to create a key" appears even when Encryption is dissabled

[ https://issues.apache.org/jira/browse/HDFS-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7931: -- Description: The {{addDelegationTokens}} method in {{DistributedFileSystem}} calls {{DFSClient#getKeyPro

[jira] [Assigned] (HDFS-7931) Spurious Error message "Could not find uri with key [dfs.encryption.key.provider.uri] to create a key" appears even when Encryption is dissabled

[ https://issues.apache.org/jira/browse/HDFS-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned HDFS-7931: - Assignee: Arun Suresh > Spurious Error message "Could not find uri with key > [dfs.encryption.key

[jira] [Created] (HDFS-7931) Spurious Error message "Could not find uri with key [dfs.encryption.key.provider.uri] to create a key" appears even when Encryption is dissabled

Arun Suresh created HDFS-7931: - Summary: Spurious Error message "Could not find uri with key [dfs.encryption.key.provider.uri] to create a key" appears even when Encryption is dissabled Key: HDFS-7931 URL: https://is

[jira] [Updated] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7435: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360982#comment-14360982 ] Hudson commented on HDFS-7435: -- FAILURE: Integrated in Hadoop-trunk-Commit #7318 (See [https:

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations, which were not confirmed

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360974#comment-14360974 ] Konstantin Shvachko commented on HDFS-7930: --- I saw it with truncate in HDFS-7886,

[jira] [Created] (HDFS-7930) commitBlockSynchronization() does not remove locations, which were not confirmed

Konstantin Shvachko created HDFS-7930: - Summary: commitBlockSynchronization() does not remove locations, which were not confirmed Key: HDFS-7930 URL: https://issues.apache.org/jira/browse/HDFS-7930

[jira] [Commented] (HDFS-5523) Support multiple subdirectory exports in HDFS NFS gateway

[ https://issues.apache.org/jira/browse/HDFS-5523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360951#comment-14360951 ] Zhe Zhang commented on HDFS-5523: - Hi [~brandonli], we recently see some use cases for this

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360942#comment-14360942 ] Konstantin Shvachko commented on HDFS-7926: --- Cool. Truncate should be idempotent

[jira] [Commented] (HDFS-7433) Optimize performance of DatanodeManager's node map

[ https://issues.apache.org/jira/browse/HDFS-7433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360920#comment-14360920 ] Hadoop QA commented on HDFS-7433: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Comment Edited] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360903#comment-14360903 ] Konstantin Shvachko edited comment on HDFS-7886 at 3/13/15 6:47 PM: -

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360903#comment-14360903 ] Konstantin Shvachko commented on HDFS-7886: --- Hey guys, thanks for the reviews. Ca

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360878#comment-14360878 ] Kihwal Lee commented on HDFS-7435: -- +1 I also ran TestDatanodeManager multiple times on my

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7926: - Fix Version/s: 2.7.0 > NameNode implementation of ClientProtocol.truncate(..) is not idempotent > -

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360869#comment-14360869 ] Brandon Li commented on HDFS-7926: -- Thank you, [~szetszwo], for the fix. I've committed th

[jira] [Updated] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7926: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > NameNod

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360854#comment-14360854 ] Daryn Sharp commented on HDFS-7435: --- The retry cache test failure is HDFS-7524. I cannot

[jira] [Commented] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360840#comment-14360840 ] Hadoop QA commented on HDFS-7928: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Comment Edited] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360820#comment-14360820 ] Arpit Agarwal edited comment on HDFS-7645 at 3/13/15 6:04 PM: --

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360820#comment-14360820 ] Arpit Agarwal commented on HDFS-7645: - Hi [~ogikei], did you get a chance to read the c

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360800#comment-14360800 ] Hadoop QA commented on HDFS-7435: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360791#comment-14360791 ] Hudson commented on HDFS-7926: -- FAILURE: Integrated in Hadoop-trunk-Commit #7317 (See [https:

[jira] [Updated] (HDFS-7928) Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy

[ https://issues.apache.org/jira/browse/HDFS-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7928: - Status: Open (was: Patch Available) Cancelling a patch to address Daryn's comments > Scanning blo

[jira] [Commented] (HDFS-7927) Fluentd unable to write events to MaprFS using httpfs

[ https://issues.apache.org/jira/browse/HDFS-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360751#comment-14360751 ] Tsuyoshi Ozawa commented on HDFS-7927: -- s/webhdfs/fluent-plugin-webhdfs/ > Fluentd un

[jira] [Commented] (HDFS-7927) Fluentd unable to write events to MaprFS using httpfs

[ https://issues.apache.org/jira/browse/HDFS-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360749#comment-14360749 ] Tsuyoshi Ozawa commented on HDFS-7927: -- [~rslysh] the code of webhdfs looks same thing

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360718#comment-14360718 ] Zhe Zhang commented on HDFS-7337: - Thanks for the pointers to HDFS-7859 and HDFS-7866. Yes

[jira] [Created] (HDFS-7929) inotify unable fetch pre-upgrade edit log segments once upgrade starts

Zhe Zhang created HDFS-7929: --- Summary: inotify unable fetch pre-upgrade edit log segments once upgrade starts Key: HDFS-7929 URL: https://issues.apache.org/jira/browse/HDFS-7929 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7827) Erasure Coding: support striped blocks in non-protobuf fsimage

[ https://issues.apache.org/jira/browse/HDFS-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360678#comment-14360678 ] Haohui Mai commented on HDFS-7827: -- I'm not sure whether this is the right thing to do as

[jira] [Commented] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360675#comment-14360675 ] Hadoop QA commented on HDFS-7854: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7896) HDFS Slow disk detection

[ https://issues.apache.org/jira/browse/HDFS-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360674#comment-14360674 ] Arpit Agarwal commented on HDFS-7896: - Hi [~zhangyongxyz], this is not related to archi

[jira] [Updated] (HDFS-7854) Separate class DataStreamer out of DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-7854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7854: Attachment: HDFS-7854-004-duplicate.patch 004 patch works on my local machine as well. Submitting a duplicate

[jira] [Commented] (HDFS-7645) Rolling upgrade is restoring blocks from trash multiple times

[ https://issues.apache.org/jira/browse/HDFS-7645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360657#comment-14360657 ] Kihwal Lee commented on HDFS-7645: -- I think you want {{clearTrash()}} to be called when a

[jira] [Commented] (HDFS-7926) NameNode implementation of ClientProtocol.truncate(..) is not idempotent

[ https://issues.apache.org/jira/browse/HDFS-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360625#comment-14360625 ] Jitendra Nath Pandey commented on HDFS-7926: +1 > NameNode implementation of C

  1   2   >