[jira] [Commented] (HADOOP-9384) Update S3 native fs implementation to use AWS SDK to support authorization through roles

2014-09-16 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136386#comment-14136386 ] David S. Wang commented on HADOOP-9384: --- +1 to [~ste...@apache.org]'s comment > Up

[jira] [Resolved] (HADOOP-10677) ExportSnapshot fails on kerberized cluster using s3a

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang resolved HADOOP-10677. Resolution: Fixed Fix Version/s: 2.6.0 This was fixed as part of HADOOP-10400. > E

[jira] [Resolved] (HADOOP-10676) S3AOutputStream not reading new config knobs for multipart configs

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang resolved HADOOP-10676. Resolution: Fixed Fix Version/s: 2.6.0 This was fixed as part of HADOOP-10400. > S

[jira] [Resolved] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang resolved HADOOP-10675. Resolution: Fixed Fix Version/s: 2.6.0 This was fixed as part of HADOOP-10400. > A

[jira] [Updated] (HADOOP-11091) Eliminate old configuration parameter names from s3a

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11091: --- Attachment: HADOOP-11091-1.patch Trunk patch for eliminating the configuration names that st

[jira] [Updated] (HADOOP-11091) Eliminate old configuration parameter names from s3a

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11091: --- Assignee: David S. Wang Target Version/s: 2.6.0 Affects Version/s: (was

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-13 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Attachment: HADOOP-10400-8-branch-2.patch Here's a branch-2 backport for the latest patch HA

[jira] [Commented] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-13 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132738#comment-14132738 ] David S. Wang commented on HADOOP-10400: [~ste...@apache.org], thanks for the +1

[jira] [Created] (HADOOP-11091) Eliminate old configuration parameter names from s3a

2014-09-13 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-11091: -- Summary: Eliminate old configuration parameter names from s3a Key: HADOOP-11091 URL: https://issues.apache.org/jira/browse/HADOOP-11091 Project: Hadoop Common

[jira] [Commented] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-12 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132408#comment-14132408 ] David S. Wang commented on HADOOP-10400: I should note a few things: * I had to

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-12 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Status: Patch Available (was: Open) > Incorporate new S3A FileSystem implementation > -

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-12 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Attachment: HADOOP-10400-8.patch Thanks Steve for your comments. I've attached a trunk patc

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-12 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Status: Open (was: Patch Available) > Incorporate new S3A FileSystem implementation > -

[jira] [Reopened] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang reopened HADOOP-11074: > Move s3-related FS connector code to hadoop-aws > --

[jira] [Reopened] (HADOOP-10373) create tools/hadoop-amazon for aws/EMR support

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang reopened HADOOP-10373: > create tools/hadoop-amazon for aws/EMR support > ---

[jira] [Reopened] (HADOOP-9540) Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing.

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang reopened HADOOP-9540: --- > Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit > testing. > -

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Attachment: HADOOP-10400-branch-2.patch This is the branch-2 backport for HADOOP-10400. It

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Attachment: HADOOP-11074-branch-2.patch This is the branch-2 backport for HADOOP-11074. It

[jira] [Updated] (HADOOP-9540) Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing.

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-9540: -- Attachment: HADOOP-9540-branch-2.patch This is the branch-2 backport for HADOOP-9540. > Expose

[jira] [Updated] (HADOOP-10373) create tools/hadoop-amazon for aws/EMR support

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10373: --- Attachment: HADOOP-10373-branch-2.patch This is the branch-2 backport for HADOOP-10373. > c

[jira] [Commented] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14130129#comment-14130129 ] David S. Wang commented on HADOOP-10400: The failing unit test is unrelated to t

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Target Version/s: 3.0.0 Status: Patch Available (was: Open) > Incorporate new

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Attachment: HADOOP-10400-7.patch HADOOP-10400-7.patch does the following: * Rebases HADOOP-

[jira] [Updated] (HADOOP-10400) Incorporate new S3A FileSystem implementation

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10400: --- Status: Open (was: Patch Available) > Incorporate new S3A FileSystem implementation > -

[jira] [Commented] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128711#comment-14128711 ] David S. Wang commented on HADOOP-11074: I don't think the failing test is relat

[jira] [Commented] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14128616#comment-14128616 ] David S. Wang commented on HADOOP-11074: Forgot to also mention that I changed t

[jira] [Created] (HADOOP-11082) Resolve findbugs warnings in hadoop-aws module

2014-09-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-11082: -- Summary: Resolve findbugs warnings in hadoop-aws module Key: HADOOP-11082 URL: https://issues.apache.org/jira/browse/HADOOP-11082 Project: Hadoop Common

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Attachment: HADOOP-11074.patch.3 This patch copies the findbugs exclude file from hadoop-com

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Status: Patch Available (was: Open) > Move s3-related FS connector code to hadoop-aws > ---

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Status: Open (was: Patch Available) > Move s3-related FS connector code to hadoop-aws > ---

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-09 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Status: Patch Available (was: Open) > Move s3-related FS connector code to hadoop-aws > ---

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-09 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Attachment: HADOOP-11074.patch.2 Change to original patch to put the auth-keys.xml changes b

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-09 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Status: Open (was: Patch Available) > Move s3-related FS connector code to hadoop-aws > ---

[jira] [Commented] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-09 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14127779#comment-14127779 ] David S. Wang commented on HADOOP-11074: The contract tests seem to be failing b

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-09 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Status: Patch Available (was: Open) > Move s3-related FS connector code to hadoop-aws > ---

[jira] [Updated] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-09 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-11074: --- Attachment: HADOOP-11074.patch This patch does the following: * Move the s3 and s3native FS

[jira] [Created] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-08 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-11074: -- Summary: Move s3-related FS connector code to hadoop-aws Key: HADOOP-11074 URL: https://issues.apache.org/jira/browse/HADOOP-11074 Project: Hadoop Common

[jira] [Updated] (HADOOP-10714) AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call

2014-06-17 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10714: --- Attachment: HADOOP-10714-1.patch > AmazonS3Client.deleteObjects() need to be limited to 100

[jira] [Created] (HADOOP-10714) AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call

2014-06-17 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10714: -- Summary: AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call Key: HADOOP-10714 URL: https://issues.apache.org/jira/browse/HADOOP-10714 Proj

[jira] [Updated] (HADOOP-10677) ExportSnapshot fails on kerberized cluster using s3a

2014-06-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10677: --- Attachment: HADOOP-10677-1.patch Thanks to Matteo Bertozzi for the patch! > ExportSnapshot

[jira] [Created] (HADOOP-10677) ExportSnapshot fails on kerberized cluster using s3a

2014-06-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10677: -- Summary: ExportSnapshot fails on kerberized cluster using s3a Key: HADOOP-10677 URL: https://issues.apache.org/jira/browse/HADOOP-10677 Project: Hadoop Common

[jira] [Updated] (HADOOP-10676) S3AOutputStream not reading new config knobs for multipart configs

2014-06-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10676: --- Attachment: HADOOP-10676-1.patch > S3AOutputStream not reading new config knobs for multipa

[jira] [Created] (HADOOP-10676) S3AOutputStream not reading new config knobs for multipart configs

2014-06-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10676: -- Summary: S3AOutputStream not reading new config knobs for multipart configs Key: HADOOP-10676 URL: https://issues.apache.org/jira/browse/HADOOP-10676 Project: Had

[jira] [Updated] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-06-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10675: --- Attachment: HADOOP-10675-2.patch > Add server-side encryption functionality to s3a > --

[jira] [Commented] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-06-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026435#comment-14026435 ] David S. Wang commented on HADOOP-10675: I'll submit this once HADOOP-10400 is c

[jira] [Updated] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-06-10 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10675: --- Attachment: HADOOP-10675-1.patch > Add server-side encryption functionality to s3a > --

[jira] [Created] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-06-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10675: -- Summary: Add server-side encryption functionality to s3a Key: HADOOP-10675 URL: https://issues.apache.org/jira/browse/HADOOP-10675 Project: Hadoop Common

[jira] [Commented] (HADOOP-10568) Add s3 server-side encryption

2014-05-02 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13988468#comment-13988468 ] David S. Wang commented on HADOOP-10568: [~atm], Thank you for looking at this

[jira] [Updated] (HADOOP-10568) Add s3 server-side encryption

2014-05-02 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10568: --- Attachment: HADOOP-10568-2.patch Added blurb in core-default.xml. > Add s3 server-side enc

[jira] [Created] (HADOOP-10568) Add s3 server-side encryption

2014-05-02 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10568: -- Summary: Add s3 server-side encryption Key: HADOOP-10568 URL: https://issues.apache.org/jira/browse/HADOOP-10568 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-10568) Add s3 server-side encryption

2014-05-02 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10568: --- Status: Patch Available (was: Open) > Add s3 server-side encryption >

[jira] [Updated] (HADOOP-10568) Add s3 server-side encryption

2014-05-02 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10568: --- Attachment: HADOOP-10568.patch Trunk patch. Will attach branch-2 patch soon. > Add s3 ser

[jira] [Updated] (HADOOP-10046) Print a log message when SSL is enabled

2013-10-14 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10046: --- Status: Patch Available (was: Open) Proposed patch. > Print a log message when SSL is ena

[jira] [Updated] (HADOOP-10046) Print a log message when SSL is enabled

2013-10-14 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang updated HADOOP-10046: --- Attachment: HADOOP-10046.patch > Print a log message when SSL is enabled >

[jira] [Created] (HADOOP-10046) Print a log message when SSL is enabled

2013-10-14 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10046: -- Summary: Print a log message when SSL is enabled Key: HADOOP-10046 URL: https://issues.apache.org/jira/browse/HADOOP-10046 Project: Hadoop Common Issue T

[jira] [Commented] (HADOOP-9394) Port findHangingTest.sh from HBase to Hadoop

2013-03-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13599349#comment-13599349 ] David S. Wang commented on HADOOP-9394: --- +1 (non-binding) > Port f