[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784843#comment-13784843 ] Aaron T. Myers commented on HDFS-2956: -- You actually can't safely downgrade a PB field

[jira] [Updated] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

[ https://issues.apache.org/jira/browse/HDFS-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5289: - Resolution: Fixed Fix Version/s: 2.1.2-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

[ https://issues.apache.org/jira/browse/HDFS-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784685#comment-13784685 ] Aaron T. Myers commented on HDFS-5289: -- Thanks a lot for the review, Todd. I'm quite c

[jira] [Commented] (HDFS-4437) Clients should not retain leases on moved files

[ https://issues.apache.org/jira/browse/HDFS-4437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784660#comment-13784660 ] Aaron T. Myers commented on HDFS-4437: -- Daryn, just checking - do you intend to work o

[jira] [Updated] (HDFS-5288) Close idle connections in portmap

[ https://issues.apache.org/jira/browse/HDFS-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5288: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-4750 > Close idle connections in por

[jira] [Resolved] (HDFS-3958) Integrate upgrade/finalize/rollback with external journals

[ https://issues.apache.org/jira/browse/HDFS-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3958. -- Resolution: Duplicate Resolving as a duplicate of HDFS-5138, which has a lot more discussion abo

[jira] [Resolved] (HDFS-3133) Add support for DFS upgrade with HA enabled

[ https://issues.apache.org/jira/browse/HDFS-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3133. -- Resolution: Duplicate Resolving as a duplicate of HDFS-5138, which has a lot more discussion abo

[jira] [Updated] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

[ https://issues.apache.org/jira/browse/HDFS-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5289: - Status: Patch Available (was: Open) > Race condition in TestRetryCacheWithHA#testCreateSymlink ca

[jira] [Updated] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

[ https://issues.apache.org/jira/browse/HDFS-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5289: - Attachment: HDFS-5289.patch Here's a patch which addresses the issue by catching the exception and

[jira] [Created] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

Aaron T. Myers created HDFS-5289: Summary: Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure Key: HDFS-5289 URL: https://issues.apache.org/jira/browse/HDFS-5289 Pro

[jira] [Updated] (HDFS-5246) Make Hadoop nfs server port and mount daemon port configurable

[ https://issues.apache.org/jira/browse/HDFS-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5246: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-4750 > Make Hadoop nfs server port a

[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771059#comment-13771059 ] Aaron T. Myers commented on HDFS-5223: -- I was chatting about this informally with [~tl

[jira] [Created] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

Aaron T. Myers created HDFS-5223: Summary: Allow edit log/fsimage format changes without changing layout version Key: HDFS-5223 URL: https://issues.apache.org/jira/browse/HDFS-5223 Project: Hadoop HDF

[jira] [Updated] (HDFS-4924) Show NameNode state on dfsclusterhealth page

[ https://issues.apache.org/jira/browse/HDFS-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4924: - Priority: Major (was: Blocker) I agree, this should not be a blocker. This is a nice thing to add

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765713#comment-13765713 ] Aaron T. Myers commented on HDFS-5138: -- Hi Kihwal, IMO we should focus solely on #1 f

[jira] [Commented] (HDFS-4096) Add snapshot information to namenode WebUI

[ https://issues.apache.org/jira/browse/HDFS-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765967#comment-13765967 ] Aaron T. Myers commented on HDFS-4096: -- I think there should be two "t"s in both "snap

[jira] [Resolved] (HDFS-4299) WebHDFS Should Support HA Configuration

[ https://issues.apache.org/jira/browse/HDFS-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4299. -- Resolution: Duplicate Assignee: (was: Haohui Mai) Thanks, Daisuke. Closing this one ou

[jira] [Commented] (HDFS-5158) add command-line support for manipulating cache directives

[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765047#comment-13765047 ] Aaron T. Myers commented on HDFS-5158: -- Looking better, but still a few little issues.

[jira] [Commented] (HDFS-4299) WebHDFS Should Support HA Configuration

[ https://issues.apache.org/jira/browse/HDFS-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13765029#comment-13765029 ] Aaron T. Myers commented on HDFS-4299: -- This seems like a duplicate of HDFS-5122, but

[jira] [Commented] (HDFS-5158) add command-line support for manipulating cache directives

[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13764587#comment-13764587 ] Aaron T. Myers commented on HDFS-5158: -- That all sounds good to me. Thanks, Colin.

[jira] [Commented] (HDFS-5158) add command-line support for manipulating cache directives

[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13764061#comment-13764061 ] Aaron T. Myers commented on HDFS-5158: -- bq. "CachedPath" would be a misleading name, s

[jira] [Commented] (HDFS-4680) Audit logging of delegation tokens for MR tracing

[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763835#comment-13763835 ] Aaron T. Myers commented on HDFS-4680: -- +1, the latest patch looks good to me. Thanks

[jira] [Commented] (HDFS-5158) add command-line support for manipulating cache directives

[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13763827#comment-13763827 ] Aaron T. Myers commented on HDFS-5158: -- A few high-level comments: # I think the name

[jira] [Updated] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5159: - Resolution: Fixed Fix Version/s: 2.1.1-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759192#comment-13759192 ] Aaron T. Myers commented on HDFS-5159: -- Since Jenkins came back clean, I'm going to co

[jira] [Commented] (HDFS-4680) Audit logging of delegation tokens for MR tracing

[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758740#comment-13758740 ] Aaron T. Myers commented on HDFS-4680: -- The latest patch looks pretty good to me. My o

[jira] [Updated] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5159: - Attachment: HDFS-5159.patch Thanks a lot for the review, Jing. Here's a patch which addresses your

[jira] [Updated] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5159: - Attachment: HDFS-5159.patch Here's a patch which addresses the issue by changing the 2NN to base t

[jira] [Updated] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5159: - Status: Patch Available (was: Open) > Secondary NameNode fails to checkpoint if error occurs

[jira] [Commented] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

[ https://issues.apache.org/jira/browse/HDFS-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757437#comment-13757437 ] Aaron T. Myers commented on HDFS-5159: -- Example error in the logs if a 2NN experiences

[jira] [Created] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

Aaron T. Myers created HDFS-5159: Summary: Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint Key: HDFS-5159 URL: https://issues.apache.org/jira/browse/HDFS-5159

[jira] [Commented] (HDFS-5121) add RPCs for creating and manipulating cache pools

[ https://issues.apache.org/jira/browse/HDFS-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755202#comment-13755202 ] Aaron T. Myers commented on HDFS-5121: -- Patch looks pretty good to me. A few small com

[jira] [Commented] (HDFS-5141) Add cache status information to datanode heartbeat

[ https://issues.apache.org/jira/browse/HDFS-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13755004#comment-13755004 ] Aaron T. Myers commented on HDFS-5141: -- Patch looks pretty good to me. One small comme

[jira] [Commented] (HDFS-4680) Audit logging of delegation tokens for MR tracing

[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749075#comment-13749075 ] Aaron T. Myers commented on HDFS-4680: -- bq. I'll think about it more today since I'm t

[jira] [Commented] (HDFS-4879) Add "blocked ArrayList" collection to avoid CMS full GCs

[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13746946#comment-13746946 ] Aaron T. Myers commented on HDFS-4879: -- I agree with Colin's comment, but would also a

[jira] [Commented] (HDFS-5102) Snapshot names should not be allowed to contain slash characters

[ https://issues.apache.org/jira/browse/HDFS-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742035#comment-13742035 ] Aaron T. Myers commented on HDFS-5102: -- +1, patch looks great to me. I'm confident tha

[jira] [Commented] (HDFS-5102) Snapshot names should not be allowed to contain slash characters

[ https://issues.apache.org/jira/browse/HDFS-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741495#comment-13741495 ] Aaron T. Myers commented on HDFS-5102: -- Here's an example of the problem. Note that th

[jira] [Created] (HDFS-5102) Snapshot names should not be allowed to contain slash characters

Aaron T. Myers created HDFS-5102: Summary: Snapshot names should not be allowed to contain slash characters Key: HDFS-5102 URL: https://issues.apache.org/jira/browse/HDFS-5102 Project: Hadoop HDFS

[jira] [Created] (HDFS-5097) TestDoAsEffectiveUser can fail on JDK 7

Aaron T. Myers created HDFS-5097: Summary: TestDoAsEffectiveUser can fail on JDK 7 Key: HDFS-5097 URL: https://issues.apache.org/jira/browse/HDFS-5097 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5079: - Hadoop Flags: Incompatible change > Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProt

[jira] [Commented] (HDFS-4816) transitionToActive blocks if the SBN is doing checkpoint image transfer

[ https://issues.apache.org/jira/browse/HDFS-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13739135#comment-13739135 ] Aaron T. Myers commented on HDFS-4816: -- +1, the latest patch looks good to me. I also

[jira] [Updated] (HDFS-5055) nn->2nn ignores dfs.namenode.secondary.http-address

[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5055: - Assignee: Vinay Target Version/s: 2.1.0-beta Status: Patch Available (wa

[jira] [Commented] (HDFS-4680) Audit logging of delegation tokens for MR tracing

[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734001#comment-13734001 ] Aaron T. Myers commented on HDFS-4680: -- The core changes look good to me, though it lo

[jira] [Commented] (HDFS-5064) Standby checkpoints should not block concurrent readers

[ https://issues.apache.org/jira/browse/HDFS-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732990#comment-13732990 ] Aaron T. Myers commented on HDFS-5064: -- bq. I think most of writers on SBN are datanod

[jira] [Commented] (HDFS-5055) nn->2nn ignores dfs.namenode.secondary.http-address

[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732213#comment-13732213 ] Aaron T. Myers commented on HDFS-5055: -- bq. What is preventing HDFS-3404 from being us

[jira] [Commented] (HDFS-5055) nn->2nn ignores dfs.namenode.secondary.http-address

[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13731555#comment-13731555 ] Aaron T. Myers commented on HDFS-5055: -- bq. Since the config is defined/clearly not wi

[jira] [Commented] (HDFS-5055) nn->2nn ignores dfs.namenode.secondary.http-address

[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13730306#comment-13730306 ] Aaron T. Myers commented on HDFS-5055: -- Even still, HDFS-4304 fixes a bug that affecte

[jira] [Commented] (HDFS-5055) nn->2nn ignores dfs.namenode.secondary.http-address

[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13730268#comment-13730268 ] Aaron T. Myers commented on HDFS-5055: -- I don't think we can reasonably roll back HDFS

[jira] [Commented] (HDFS-5055) nn->2nn ignores dfs.namenode.secondary.http-address

[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13730196#comment-13730196 ] Aaron T. Myers commented on HDFS-5055: -- Yep, this behavior did indeed change. The issu

[jira] [Commented] (HDFS-5060) NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions

[ https://issues.apache.org/jira/browse/HDFS-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13729693#comment-13729693 ] Aaron T. Myers commented on HDFS-5060: -- bq. Adding to what Kihwal said, this should be

[jira] [Created] (HDFS-5064) Standby checkpoints should not block concurrent readers

Aaron T. Myers created HDFS-5064: Summary: Standby checkpoints should not block concurrent readers Key: HDFS-5064 URL: https://issues.apache.org/jira/browse/HDFS-5064 Project: Hadoop HDFS Iss

[jira] [Created] (HDFS-5060) NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions

Aaron T. Myers created HDFS-5060: Summary: NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions Key: HDFS-5060 URL: https://issues.apache.org/jira/browse

[jira] [Assigned] (HDFS-5037) Active NN should trigger its own edit log rolls

[ https://issues.apache.org/jira/browse/HDFS-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-5037: Assignee: Aaron T. Myers > Active NN should trigger its own edit log rolls > ---

[jira] [Commented] (HDFS-5031) BlockScanner scans the block multiple times and on restart scans everything

[ https://issues.apache.org/jira/browse/HDFS-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13723351#comment-13723351 ] Aaron T. Myers commented on HDFS-5031: -- Hi Vinay, not sure that this should be conside

[jira] [Updated] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5027: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719809#comment-13719809 ] Aaron T. Myers commented on HDFS-5027: -- Thanks, Kihwal. > On startup,

[jira] [Commented] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719722#comment-13719722 ] Aaron T. Myers commented on HDFS-5027: -- Thanks for the comment, Kihwal. If you have ti

[jira] [Commented] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719264#comment-13719264 ] Aaron T. Myers commented on HDFS-5027: -- Why would you want to use fewer threads than t

[jira] [Commented] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13719241#comment-13719241 ] Aaron T. Myers commented on HDFS-5027: -- bq. so, is it possible that you create a large

[jira] [Updated] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5027: - Status: Patch Available (was: Open) > On startup, DN should scan volumes in parallel > --

[jira] [Updated] (HDFS-5027) On startup, DN should scan volumes in parallel

[ https://issues.apache.org/jira/browse/HDFS-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5027: - Attachment: HDFS-5027.patch Little patch which moves the directory scanning from serial to paralle

[jira] [Created] (HDFS-5027) On startup, DN should scan volumes in parallel

Aaron T. Myers created HDFS-5027: Summary: On startup, DN should scan volumes in parallel Key: HDFS-5027 URL: https://issues.apache.org/jira/browse/HDFS-5027 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-5025) Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover

[ https://issues.apache.org/jira/browse/HDFS-5025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5025: - Summary: Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA fail

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713897#comment-13713897 ] Aaron T. Myers commented on HDFS-4817: -- +1, the latest patch looks good to me. Thanks

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713278#comment-13713278 ] Aaron T. Myers commented on HDFS-4817: -- Latest patch looks really good. Two very small

[jira] [Assigned] (HDFS-4946) Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable

[ https://issues.apache.org/jira/browse/HDFS-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-4946: Assignee: James Kinley > Allow preferLocalNode in BlockPlacementPolicyDefault to be conf

[jira] [Updated] (HDFS-4657) If incremental BR is received before first full BR NN will log a line for every block on a DN

[ https://issues.apache.org/jira/browse/HDFS-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4657: - Attachment: HDFS-4657.patch Here's a quick patch which implements option #3. No tests are included

[jira] [Updated] (HDFS-4657) If incremental BR is received before first full BR NN will log a line for every block on a DN

[ https://issues.apache.org/jira/browse/HDFS-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4657: - Status: Patch Available (was: Open) > If incremental BR is received before first full BR NN w

[jira] [Commented] (HDFS-4841) FsShell commands using secure webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13702564#comment-13702564 ] Aaron T. Myers commented on HDFS-4841: -- +1, the patch looks good to me.

[jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4465: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

[ https://issues.apache.org/jira/browse/HDFS-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13699650#comment-13699650 ] Aaron T. Myers commented on HDFS-4817: -- Patch looks pretty good to me, Colin. A few sm

[jira] [Commented] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13699566#comment-13699566 ] Aaron T. Myers commented on HDFS-4465: -- That sounds fine to me. Do all of those branch

[jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4465: - Attachment: HDFS-4465.patch Thanks for the review, Suresh. Here's a patch which removes that unnec

[jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4465: - Attachment: HDFS-4465.patch Here's an updated patch which should address all of your feedback, Sur

[jira] [Commented] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13695906#comment-13695906 ] Aaron T. Myers commented on HDFS-4465: -- Sorry, Suresh. I got distracted. Yes, I'm wor

[jira] [Commented] (HDFS-4924) Show NameNode state on dfsclusterhealth page

[ https://issues.apache.org/jira/browse/HDFS-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13689745#comment-13689745 ] Aaron T. Myers commented on HDFS-4924: -- Isn't all of this already on the dfsclusterhea

[jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4465: - Target Version/s: 2.1.0-beta Affects Version/s: 2.0.5-alpha Status: Patch Avail

[jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4465: - Attachment: HDFS-4465.patch Here's a more polished patch which implements the changes I previously

[jira] [Assigned] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-4465: Assignee: Aaron T. Myers (was: Suresh Srinivas) > Optimize datanode ReplicasMap and Rep

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13686294#comment-13686294 ] Aaron T. Myers commented on HDFS-4906: -- Pretty sure the TestBlocksWithNotEnoughRacks f

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Attachment: HDFS-4906.patch Whoops! Forgot to actually post the updated patch. >

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Attachment: HDFS-4906.patch The TestMultiThreadedHflush test was looking for some specific excepti

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Attachment: HDFS-4906.patch Thanks a lot for the review, Steve. In the latest patch I've switched

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Attachment: HDFS-4906.patch Whoops! Missed adding an implementation of the new abstract method to

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Attachment: HDFS-4906.patch Here's a patch which addresses the issue by changing FSOutputSummer to

[jira] [Updated] (HDFS-4906) HDFS Output streams should not accept writes after being closed

[ https://issues.apache.org/jira/browse/HDFS-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4906: - Status: Patch Available (was: Open) > HDFS Output streams should not accept writes after bein

[jira] [Created] (HDFS-4906) HDFS Output streams should not accept writes after being closed

Aaron T. Myers created HDFS-4906: Summary: HDFS Output streams should not accept writes after being closed Key: HDFS-4906 URL: https://issues.apache.org/jira/browse/HDFS-4906 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4897) Moving/copying a directory does not include the directory's quota settings

[ https://issues.apache.org/jira/browse/HDFS-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679689#comment-13679689 ] Aaron T. Myers commented on HDFS-4897: -- bq. Perhaps the –p option could be extended,

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675458#comment-13675458 ] Aaron T. Myers commented on HDFS-4872: -- I think we should again seriously consider imp

[jira] [Updated] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4815: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675278#comment-13675278 ] Aaron T. Myers commented on HDFS-4815: -- +1, patch looks good to me as well. Chris, mi

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13669880#comment-13669880 ] Aaron T. Myers commented on HDFS-3934: -- Makes sense re: points 8 and 11. I agree with

[jira] [Commented] (HDFS-4847) hdfs dfs -count of a .snapshot directory fails claiming file does not exist

[ https://issues.apache.org/jira/browse/HDFS-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13668835#comment-13668835 ] Aaron T. Myers commented on HDFS-4847: -- Hey Jing, not sure I agree with this reasoning

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13665668#comment-13665668 ] Aaron T. Myers commented on HDFS-3934: -- The latest patch looks pretty good to me, Coli

[jira] [Updated] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4298: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664439#comment-13664439 ] Aaron T. Myers commented on HDFS-4298: -- TestBookKeeperHACheckpoints is currently faili

[jira] [Commented] (HDFS-4840) ReplicationMonitor and FSEditLogLoader get NPE during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664367#comment-13664367 ] Aaron T. Myers commented on HDFS-4840: -- I've also seen this fail recently during a run

[jira] [Updated] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4298: - Attachment: HDFS-4298.patch Thanks a lot for the review, Todd. Here's a patch which addresses your

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13663251#comment-13663251 ] Aaron T. Myers commented on HDFS-4298: -- TestBookKeeperHACheckpoints is currently faili

<    1   2   3   4   5   6   7   8   9   10   >