[jira] [Commented] (HADOOP-11851) s3n to swallow IOEs on inner stream close

[ https://issues.apache.org/jira/browse/HADOOP-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503893#comment-14503893 ] Takenori Sato commented on HADOOP-11851: Isn't this the duplicate of HADOOP-1173

[jira] [Commented] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392251#comment-14392251 ] Takenori Sato commented on HADOOP-11742: _mkdir_ and _ls_ worked as expected wit

[jira] [Commented] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392231#comment-14392231 ] Takenori Sato commented on HADOOP-11742: Patches are verified as follows. 1. ru

[jira] [Updated] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11742: --- Attachment: HADOOP-11742-branch-2.7.003-2.patch This is the patch to fix the unit test, _Abs

[jira] [Updated] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11742: --- Attachment: HADOOP-11742-branch-2.7.003-1.patch This is the patch to fix _S3AFileSystem#getF

[jira] [Reopened] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato reopened HADOOP-11742: I confirmed mkdir fails on an empty bucket for AWS as follows: 1. make sure the bucket is emp

[jira] [Commented] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386493#comment-14386493 ] Takenori Sato commented on HADOOP-11753: Thanks, it makes sense. I will discuss

[jira] [Reopened] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato reopened HADOOP-11742: Reopen to mark this as invalid. > mkdir by file system shell fails on an empty bucket > -

[jira] [Resolved] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato resolved HADOOP-11742. Resolution: Invalid > mkdir by file system shell fails on an empty bucket > --

[jira] [Commented] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386172#comment-14386172 ] Takenori Sato commented on HADOOP-11742: Thomas, Steve, yes, again this is again

[jira] [Updated] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11742: --- Resolution: Fixed Assignee: Takenori Sato Status: Resolved (was: Patch Availab

[jira] [Resolved] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato resolved HADOOP-11753. Resolution: Invalid > TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative r

[jira] [Commented] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386168#comment-14386168 ] Takenori Sato commented on HADOOP-11753: Thanks for the clarification. Yes, this

[jira] [Updated] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11742: --- Attachment: HADOOP-11742-branch-2.7.002.patch I found _AbstractFSContractTestBase#setup_ alw

[jira] [Updated] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11753: --- Attachment: HADOOP-11753-branch-2.7.001.patch set Range header only when contentLength > 0

[jira] [Commented] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381384#comment-14381384 ] Takenori Sato commented on HADOOP-11753: Hi, OK, thanks. I was about to start. S

[jira] [Commented] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381351#comment-14381351 ] Takenori Sato commented on HADOOP-11742: OK, will do. But found the current s3a

[jira] [Commented] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381343#comment-14381343 ] Takenori Sato commented on HADOOP-11753: Another one. {code} testSeekZeroByteFi

[jira] [Commented] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381338#comment-14381338 ] Takenori Sato commented on HADOOP-11753: _TestS3AContractSeek#testBlockReadZeroB

[jira] [Updated] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header

[ https://issues.apache.org/jira/browse/HADOOP-11753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11753: --- Summary: TestS3AContractOpen#testOpenReadZeroByteFile fails due to negative range header (w

[jira] [Created] (HADOOP-11753) TestS3AContractOpen#testOpenReadZeroByteFile fals due to negative range header

Takenori Sato created HADOOP-11753: -- Summary: TestS3AContractOpen#testOpenReadZeroByteFile fals due to negative range header Key: HADOOP-11753 URL: https://issues.apache.org/jira/browse/HADOOP-11753

[jira] [Commented] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379380#comment-14379380 ] Takenori Sato commented on HADOOP-11742: I checked how this is covered in test c

[jira] [Updated] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

[ https://issues.apache.org/jira/browse/HADOOP-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11742: --- Attachment: HADOOP-11742-branch-2.7.001.patch An empty key means a root directory instead of

[jira] [Created] (HADOOP-11742) mkdir by file system shell fails on an empty bucket

Takenori Sato created HADOOP-11742: -- Summary: mkdir by file system shell fails on an empty bucket Key: HADOOP-11742 URL: https://issues.apache.org/jira/browse/HADOOP-11742 Project: Hadoop Common

[jira] [Updated] (HADOOP-11730) The broken s3n read retry logic causes a wrong output being committed

[ https://issues.apache.org/jira/browse/HADOOP-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11730: --- Attachment: (was: HADOOP-11730-branch-2.6.0.001.patch) > The broken s3n read retry logic

[jira] [Updated] (HADOOP-11730) The broken s3n read retry logic causes a wrong output being committed

[ https://issues.apache.org/jira/browse/HADOOP-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11730: --- Attachment: HADOOP-11730-branch-2.6.0.001.patch The first patch with the updated test case.

[jira] [Updated] (HADOOP-11730) The broken s3n read retry logic causes a wrong output being committed

[ https://issues.apache.org/jira/browse/HADOOP-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato updated HADOOP-11730: --- Attachment: HADOOP-11730-branch-2.6.0.001.patch The first proposal without the test case. 2

[jira] [Created] (HADOOP-11730) The broken s3n read retry logic causes a wrong output being committed

Takenori Sato created HADOOP-11730: -- Summary: The broken s3n read retry logic causes a wrong output being committed Key: HADOOP-11730 URL: https://issues.apache.org/jira/browse/HADOOP-11730 Project:

[jira] [Resolved] (HADOOP-10037) s3n read truncated, but doesn't throw exception

[ https://issues.apache.org/jira/browse/HADOOP-10037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato resolved HADOOP-10037. Resolution: Fixed The issue that had reopened this turned out being a separate issue. > s

[jira] [Commented] (HADOOP-10037) s3n read truncated, but doesn't throw exception

[ https://issues.apache.org/jira/browse/HADOOP-10037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370292#comment-14370292 ] Takenori Sato commented on HADOOP-10037: David, thanks for your clarification.

[jira] [Reopened] (HADOOP-10037) s3n read truncated, but doesn't throw exception

[ https://issues.apache.org/jira/browse/HADOOP-10037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takenori Sato reopened HADOOP-10037: I confirmed this happens on Hadoop 2.6.0, and found the reason. Here's the stacktrace. {quot

[jira] [Commented] (HADOOP-10400) Incorporate new S3A FileSystem implementation

[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104967#comment-14104967 ] Takenori Sato commented on HADOOP-10400: Hi Jordan Mendelson, I came from HADOO