[jira] [Updated] (HDFS-4830) Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml

2013-05-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4830: - Status: Patch Available (was: Open) Typo in config settings for

[jira] [Updated] (HDFS-4830) Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml

2013-05-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4830: - Attachment: HDFS-4830.patch Good point, Turbo. I also noticed that I failed to change the

[jira] [Commented] (HDFS-4830) Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml

2013-05-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660130#comment-13660130 ] Aaron T. Myers commented on HDFS-4830: -- bq. +1, sorry I forgot to observe this the

[jira] [Updated] (HDFS-4830) Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml

2013-05-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4830: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-1804) Add a new block-volume device choosing policy that looks at free space

2013-05-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Release Note: There is now a new option to have the DN take into account available disk space on

[jira] [Commented] (HDFS-4831) Performing direct read using libhdfs sometimes raises SIGPIPE (which in turn throws SIGABRT) causing client crashes

2013-05-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660170#comment-13660170 ] Aaron T. Myers commented on HDFS-4831: -- Good find, and thanks a lot for testing out

[jira] [Updated] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4825: - Affects Version/s: 2.0.5-beta Status: Patch Available (was: Open) Marking PA for

[jira] [Updated] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4825: - Target Version/s: 2.0.5-beta webhdfs / httpfs tests broken because of min block size change

[jira] [Commented] (HDFS-4765) Permission check of symlink deletion incorrectly throws UnresolvedLinkException

2013-05-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656126#comment-13656126 ] Aaron T. Myers commented on HDFS-4765: -- +1, the patch looks good to me. I'm going to

[jira] [Commented] (HDFS-4765) Permission check of symlink deletion incorrectly throws UnresolvedLinkException

2013-05-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656143#comment-13656143 ] Aaron T. Myers commented on HDFS-4765: -- I've committed this to trunk, but, perhaps

[jira] [Commented] (HDFS-4300) TransferFsImage.downloadEditsToStorage should use a tmp file for destination

2013-05-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656151#comment-13656151 ] Aaron T. Myers commented on HDFS-4300: -- +1, the latest patch looks good to me. I'm

[jira] [Updated] (HDFS-4300) TransferFsImage.downloadEditsToStorage should use a tmp file for destination

2013-05-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4300: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-4765) Permission check of symlink deletion incorrectly throws UnresolvedLinkException

2013-05-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4765: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654666#comment-13654666 ] Aaron T. Myers commented on HDFS-4698: -- +1, the latest patch looks good to me. I'm

[jira] [Updated] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4698: - Fix Version/s: 3.0.0 I've just committed this to trunk. The patch doesn't apply cleanly to

[jira] [Resolved] (HDFS-4352) Encapsulate arguments to BlockReaderFactory in a class

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4352. -- Resolution: Won't Fix Seems some folks don't think this is the best idea.

[jira] [Commented] (HDFS-4751) TestLeaseRenewer#testThreadName flakes

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654768#comment-13654768 ] Aaron T. Myers commented on HDFS-4751: -- +1, the latest patch looks good to me. I'm

[jira] [Updated] (HDFS-4751) TestLeaseRenewer#testThreadName flakes

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4751: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4765) Permission check of symlink deletion incorrectly throws UnresolvedLinkException

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654790#comment-13654790 ] Aaron T. Myers commented on HDFS-4765: -- Patch looks pretty good to me, Andrew, though

[jira] [Updated] (HDFS-4300) TransferFsImage.downloadEditsToStorage should use a tmp file for destination

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4300: - Attachment: hdfs-4300-4.patch The most recent patch doesn't apply cleanly because of the commit

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654915#comment-13654915 ] Aaron T. Myers commented on HDFS-2802: -- It's great to see this work get merged to

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654935#comment-13654935 ] Aaron T. Myers commented on HDFS-347: - bq. There were some open issues which we wanted

[jira] [Commented] (HDFS-4810) several HDFS HA tests have timeouts that are too short

2013-05-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653235#comment-13653235 ] Aaron T. Myers commented on HDFS-4810: -- Patch looks good to me. +1 pending Jenkins.

[jira] [Commented] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

2013-05-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653324#comment-13653324 ] Aaron T. Myers commented on HDFS-2856: -- Thanks a lot for working on this issue, Chris.

[jira] [Commented] (HDFS-4787) Create a new HdfsConfiguration before each TestDFSClientRetries testcases

2013-05-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653330#comment-13653330 ] Aaron T. Myers commented on HDFS-4787: -- This looks like three spaces to me within the

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-05-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653353#comment-13653353 ] Aaron T. Myers commented on HDFS-4698: -- The latest patch looks great to me. Just two

[jira] [Updated] (HDFS-4661) fix various bugs in short circuit read

2013-05-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4661: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-4810) several HDFS HA tests have timeouts that are too short

2013-05-09 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4810: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4787) Create a new HdfsConfiguration before each TestDFSClientRetries testcases

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652141#comment-13652141 ] Aaron T. Myers commented on HDFS-4787: -- Looks to me like the indentation is still 3

[jira] [Commented] (HDFS-4789) redirectToRandomDataNode tries to get a delegation token without verifying security is enabled

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652149#comment-13652149 ] Aaron T. Myers commented on HDFS-4789: -- Hey Stephen, looks like this patch doesn't

[jira] [Updated] (HDFS-4789) redirectToRandomDataNode tries to get a delegation token without verifying security is enabled

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4789: - Target Version/s: 2.0.5-beta Affects Version/s: 2.0.4-alpha Release Note: (was:

[jira] [Commented] (HDFS-4799) Corrupt replica can be prematurely removed from corruptReplicas map

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652169#comment-13652169 ] Aaron T. Myers commented on HDFS-4799: -- Great sleuthing, Todd. Test and fix look

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652251#comment-13652251 ] Aaron T. Myers commented on HDFS-4698: -- Latest patch looks pretty good to me. Two

[jira] [Commented] (HDFS-4808) Limit snapshot related methods to DistributedFileSystem

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652407#comment-13652407 ] Aaron T. Myers commented on HDFS-4808: -- I don't necessarily think these should be

[jira] [Commented] (HDFS-4808) Limit snapshot related methods to DistributedFileSystem

2013-05-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652647#comment-13652647 ] Aaron T. Myers commented on HDFS-4808: -- bq. Why cannot this be a general FileSystem

[jira] [Commented] (HDFS-4804) WARN when users set the block balanced preference percent below 0.5 or above 1.0

2013-05-07 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13651333#comment-13651333 ] Aaron T. Myers commented on HDFS-4804: -- +1, the patch looks good to me. I'm going to

[jira] [Updated] (HDFS-4804) WARN when users set the block balanced preference percent below 0.5 or above 1.0

2013-05-07 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4804: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645337#comment-13645337 ] Aaron T. Myers commented on HDFS-4305: -- [~sureshms] Done. Add a

[jira] [Updated] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4305: - Release Note: This change introduces a maximum number of blocks per file, by default one million,

[jira] [Commented] (HDFS-4777) File creation with overwrite flag set to true results in logSync holding namesystem lock

2013-04-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645717#comment-13645717 ] Aaron T. Myers commented on HDFS-4777: -- Thanks a lot for working on this, Suresh.

[jira] [Commented] (HDFS-4777) File creation with overwrite flag set to true results in logSync holding namesystem lock

2013-04-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645767#comment-13645767 ] Aaron T. Myers commented on HDFS-4777: -- bq. My preference is to not logSync at all

[jira] [Commented] (HDFS-4733) Make HttpFS username pattern configurable

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644693#comment-13644693 ] Aaron T. Myers commented on HDFS-4733: -- Thanks, Daryn. I agree with what you're saying

[jira] [Updated] (HDFS-4733) Make HttpFS username pattern configurable

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4733: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4687) TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644862#comment-13644862 ] Aaron T. Myers commented on HDFS-4687: -- +1, the patch looks good to me. I ran this

[jira] [Updated] (HDFS-4687) TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4687: - Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644884#comment-13644884 ] Aaron T. Myers commented on HDFS-4305: -- Thanks for confirming you're OK with this,

[jira] [Updated] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4305: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4751) TestLeaseRenewer#testThreadName flakes

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645142#comment-13645142 ] Aaron T. Myers commented on HDFS-4751: -- Though I think you've correctly identified the

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645264#comment-13645264 ] Aaron T. Myers commented on HDFS-4305: -- Thanks a lot for the report, Zhijie. I've

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

2013-04-26 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13643276#comment-13643276 ] Aaron T. Myers commented on HDFS-4754: -- Hi Nicolas, in general I'm a little leery of

[jira] [Created] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4739: Summary: NN can miscalculate the number of extra edit log segments to retain Key: HDFS-4739 URL: https://issues.apache.org/jira/browse/HDFS-4739 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4739: - Attachment: HDFS-4739.patch Attached patch fixes the issue by: # Discounting truly required

[jira] [Updated] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4739: - Status: Patch Available (was: Open) NN can miscalculate the number of extra edit log

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640762#comment-13640762 ] Aaron T. Myers commented on HDFS-4698: -- bq. I think it would not be too difficult to

[jira] [Updated] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4739: - Attachment: HDFS-4739.patch Missed a bounds check. Updated patch should fix the test failures.

[jira] [Commented] (HDFS-4708) Add snapshot user guide

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640901#comment-13640901 ] Aaron T. Myers commented on HDFS-4708: -- Hi Nicholas, what limitation are you referring

[jira] [Created] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4747: Summary: Convert snapshot user guide to APT from XDOC Key: HDFS-4747 URL: https://issues.apache.org/jira/browse/HDFS-4747 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4747: - Attachment: HDFS-4747.patch Here's a patch which addresses the issue. The content is identical to

[jira] [Commented] (HDFS-4708) Add snapshot user guide

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641134#comment-13641134 ] Aaron T. Myers commented on HDFS-4708: -- Thanks for the pointer, Nicholas. It doesn't

[jira] [Updated] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4747: - Attachment: HdfsSnapshots.html Including the rendered HTML file so folks can see that easily.

[jira] [Updated] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4747: - Description: To be consistent with the rest of the HDFS docs, the snapshots user guide should use

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641149#comment-13641149 ] Aaron T. Myers commented on HDFS-4747: -- Hi Nicholas, a while back myself and others

[jira] [Commented] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641155#comment-13641155 ] Aaron T. Myers commented on HDFS-4739: -- Thanks a lot for the reviews, Todd and Chris.

[jira] [Commented] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13641195#comment-13641195 ] Aaron T. Myers commented on HDFS-4747: -- The effort was to convert the xdocs to APT.

[jira] [Updated] (HDFS-4733) Make HttpFS username pattern configurable

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4733: - Target Version/s: 2.0.5-beta Fix Version/s: (was: 2.0.5-beta) Make HttpFS

[jira] [Commented] (HDFS-4733) Make HttpFS username pattern configurable

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13639711#comment-13639711 ] Aaron T. Myers commented on HDFS-4733: -- +1, the patch looks good to me. Daryn - has

[jira] [Moved] (HDFS-4737) JVM path embedded in fuse binaries

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers moved HADOOP-9468 to HDFS-4737: -- Assignee: (was: Sean Mackrory) Target Version/s:

[jira] [Assigned] (HDFS-4737) JVM path embedded in fuse binaries

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-4737: Assignee: Sean Mackrory JVM path embedded in fuse binaries

[jira] [Updated] (HDFS-4737) JVM path embedded in fuse binaries

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4737: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4671) DFSAdmin fetchImage should require superuser privilege even when security is not enabled

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640017#comment-13640017 ] Aaron T. Myers commented on HDFS-4671: -- bq. I can see the argument for this change,

[jira] [Commented] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640059#comment-13640059 ] Aaron T. Myers commented on HDFS-4698: -- Patch looks pretty good to me, though I do

[jira] [Updated] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4698: - Target Version/s: 2.0.5-beta Affects Version/s: (was: 2.0.3-alpha)

[jira] [Commented] (HDFS-4708) Add snapshot user guide

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640064#comment-13640064 ] Aaron T. Myers commented on HDFS-4708: -- Hey folks, really sorry I showed up to this

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640088#comment-13640088 ] Aaron T. Myers commented on HDFS-4305: -- +1, the patch looks good to me. I'm going to

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13640092#comment-13640092 ] Aaron T. Myers commented on HDFS-4305: -- Whoops, I spoke too soon. Looks like the patch

[jira] [Updated] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4305: - Target Version/s: 2.0.5-beta (was: 3.0.0, 2.0.3-alpha) Affects Version/s: (was:

[jira] [Commented] (HDFS-4666) Disallow users to create file/dir named .snapshot

2013-04-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13632097#comment-13632097 ] Aaron T. Myers commented on HDFS-4666: -- Sounds fine to me to do it in a separate JIRA

[jira] [Commented] (HDFS-4529) Decide the semantic of concat with snapshots

2013-04-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13632101#comment-13632101 ] Aaron T. Myers commented on HDFS-4529: -- That sounds good to me as well. Thanks

[jira] [Commented] (HDFS-4666) Disallow users to create file/dir named .snapshot

2013-04-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631448#comment-13631448 ] Aaron T. Myers commented on HDFS-4666: -- bq. For upgrading, we may throw an exception

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2013-04-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-347: Target Version/s: 2.0.5-beta Fix Version/s: 3.0.0 Since the merge vote passed, I have merged

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2013-04-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13630905#comment-13630905 ] Aaron T. Myers commented on HDFS-347: - Nicholas, There is quite a bit of precedent for

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Attachment: HDFS-1804.patch Thanks a lot for the review, Chris. Here's a patch which should

[jira] [Updated] (HDFS-1804) Add a new block-volume device choosing policy that looks at free space

2013-04-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Summary: Add a new block-volume device choosing policy that looks at free space (was: Modify or

[jira] [Updated] (HDFS-1804) Add a new block-volume device choosing policy that looks at free space

2013-04-05 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-04 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Attachment: HDFS-1804.patch Updated patch to fix the RAT and findbugs warnings.

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-04 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Attachment: HDFS-1804.patch Thanks a lot for the review, Harsh. Responses to your review inline.

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-04 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Attachment: HDFS-1804.patch Bummer. Here's a patch to address the findbugs warning, which was

[jira] [Commented] (HDFS-4666) Disallow users to create file/dir named .snapshot

2013-04-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13621368#comment-13621368 ] Aaron T. Myers commented on HDFS-4666: -- Along the same line: we should probably put in

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Attachment: HDFS-1804.patch Here's a patch which addresses the issue by adding a new volume

[jira] [Assigned] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-1804: Assignee: Aaron T. Myers Modify or add a new block-volume device choosing policy that

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Target Version/s: 2.0.5-beta Affects Version/s: 2.0.4-alpha Labels: (was:

[jira] [Updated] (HDFS-1804) Modify or add a new block-volume device choosing policy that looks at free space

2013-04-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-1804: - Status: Patch Available (was: Open) Modify or add a new block-volume device choosing policy

[jira] [Commented] (HDFS-4656) DN heartbeat loop can be briefly tight

2013-04-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13621532#comment-13621532 ] Aaron T. Myers commented on HDFS-4656: -- Hi Mohammed, First, I recommend you email

[jira] [Commented] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

2013-04-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620043#comment-13620043 ] Aaron T. Myers commented on HDFS-4658: -- Thanks for the review, Daryn. There's no easy

[jira] [Updated] (HDFS-4658) Standby NN will log that it has received a block report after becoming active

2013-04-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4658: - Resolution: Fixed Fix Version/s: 2.0.5-beta Target Version/s: 2.0.5-beta (was:

[jira] [Created] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4655: Summary: DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN Key: HDFS-4655 URL: https://issues.apache.org/jira/browse/HDFS-4655

[jira] [Updated] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

2013-04-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4655: - Attachment: HDFS-4655.patch Trivial patch attached. No tests are included since this only results

[jira] [Updated] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

2013-04-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4655: - Status: Patch Available (was: Open) DNA_FINALIZE is logged as being an unknown command by

[jira] [Created] (HDFS-4656) DN heartbeat loop can be briefly tight

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4656: Summary: DN heartbeat loop can be briefly tight Key: HDFS-4656 URL: https://issues.apache.org/jira/browse/HDFS-4656 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-4656) DN heartbeat loop can be briefly tight

2013-04-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4656: - Attachment: HDFS-4656.patch Trivial patch attached. To test this I added some extra logging both

<    2   3   4   5   6   7   8   9   10   11   >