[jira] [Updated] (HADOOP-15612) Improve exception when tfile fails to load LzoCodec

[ https://issues.apache.org/jira/browse/HADOOP-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated HADOOP-15612: --- Resolution: Fixed Fix Version/s: 3.0.4 3.1.1 3.

[jira] [Updated] (HADOOP-15409) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

[ https://issues.apache.org/jira/browse/HADOOP-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15409: Priority: Blocker (was: Major) tagging as blocker for 3.2; my task is to review this >

[jira] [Commented] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555153#comment-16555153 ] Hudson commented on HADOOP-15609: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Resolved] (HADOOP-15592) AssumedRoleCredentialProvider to propagate connection settings of S3A FS

[ https://issues.apache.org/jira/browse/HADOOP-15592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15592. - Resolution: Duplicate > AssumedRoleCredentialProvider to propagate connection settings

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555154#comment-16555154 ] Xiao Chen commented on HADOOP-15593: Thanks for the clarification [~eyang]. Accord

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555140#comment-16555140 ] Eric Yang commented on HADOOP-15593: [~xiaochen] If tgt.getEndTime().getTime() capt

[jira] [Commented] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555136#comment-16555136 ] Steve Loughran commented on HADOOP-15426: - there's also the option of using an

[jira] [Updated] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15426: Priority: Blocker (was: Major) > S3guard throttle events => 400 error code => exception

[jira] [Comment Edited] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554997#comment-16554997 ] Steve Loughran edited comment on HADOOP-15426 at 7/25/18 4:55 AM: ---

[jira] [Updated] (HADOOP-15609) Retry KMS calls when SSLHandshakeException occurs

[ https://issues.apache.org/jira/browse/HADOOP-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15609: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2 3.0.4

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555116#comment-16555116 ] Xiao Chen commented on HADOOP-15593: If we did what's proposed in [my previous com

[jira] [Commented] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16555083#comment-16555083 ] genericqa commented on HADOOP-15583: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554997#comment-16554997 ] Steve Loughran commented on HADOOP-15426: - This is pretty major, as it really m

[jira] [Updated] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15426: Affects Version/s: (was: 3.2.0) 3.1.0 Target Version/s: 3.

[jira] [Work started] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15426 started by Steve Loughran. --- > S3guard throttle events => 400 error code => exception > -

[jira] [Commented] (HADOOP-15629) Missing trimming in readlink in case of protocol

[ https://issues.apache.org/jira/browse/HADOOP-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554989#comment-16554989 ] Giovanni Matteo Fumarola commented on HADOOP-15629: --- We found some te

[jira] [Assigned] (HADOOP-15629) Missing trimming in readlink in case of protocol

[ https://issues.apache.org/jira/browse/HADOOP-15629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HADOOP-15629: Assignee: Giovanni Matteo Fumarola > Missing trimming in readlink in case of protocol >

[jira] [Created] (HADOOP-15629) Missing trimming in readlink in case of protocol

Íñigo Goiri created HADOOP-15629: Summary: Missing trimming in readlink in case of protocol Key: HADOOP-15629 URL: https://issues.apache.org/jira/browse/HADOOP-15629 Project: Hadoop Common Is

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Status: Patch Available (was: Open) > Stabilize S3A Assumed Role support > -

[jira] [Commented] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554963#comment-16554963 ] Steve Loughran commented on HADOOP-15583: - Patch 003 * assumed role tests work

[jira] [Resolved] (HADOOP-15627) S3A ITests failing if bucket explicitly set to s3guard+DDB

[ https://issues.apache.org/jira/browse/HADOOP-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15627. - Resolution: Duplicate > S3A ITests failing if bucket explicitly set to s3guard+DDB > --

[jira] [Commented] (HADOOP-13600) S3a rename() to copy files in a directory in parallel

[ https://issues.apache.org/jira/browse/HADOOP-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554959#comment-16554959 ] genericqa commented on HADOOP-13600: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Attachment: HADOOP-15583-003.patch > Stabilize S3A Assumed Role support > ---

[jira] [Resolved] (HADOOP-14528) s3a encryption tests fail when dest bucket has SSE-KMS enabled

[ https://issues.apache.org/jira/browse/HADOOP-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14528. - Resolution: Won't Fix something to be aware when you run the tests: if you force encryp

[jira] [Updated] (HADOOP-14528) s3a encryption tests fail when dest bucket has SSE-KMS enabled

[ https://issues.apache.org/jira/browse/HADOOP-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14528: Summary: s3a encryption tests fail when dest bucket has SSE-KMS enabled (was: s3a encryp

[jira] [Resolved] (HADOOP-13853) S3ADataBlocks.DiskBlock to lazy create dest file for faster 0-byte puts

[ https://issues.apache.org/jira/browse/HADOOP-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13853. - Resolution: Won't Fix for s3 io, the local FS isn't normally the bottleneck > S3ADataB

[jira] [Resolved] (HADOOP-12949) Add HTrace to the s3a connector

[ https://issues.apache.org/jira/browse/HADOOP-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12949. - Resolution: Won't Fix closing as WONTFIX as htrace is being pulled from hadoop. Once we

[jira] [Commented] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554938#comment-16554938 ] Steve Loughran commented on HADOOP-15426: - * retry sleep time needs to be bigge

[jira] [Assigned] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15426: --- Assignee: Steve Loughran > S3guard throttle events => 400 error code => exception

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554923#comment-16554923 ] Steve Loughran commented on HADOOP-15349: - I'm pleased to say I can now trigger

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554903#comment-16554903 ] Eric Yang commented on HADOOP-15593: [~xiaochen] Good catch on the logic. I think

[jira] [Commented] (HADOOP-15544) ABFS: validate packing, transient classpath, hadoop fs CLI

[ https://issues.apache.org/jira/browse/HADOOP-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554894#comment-16554894 ] Da Zhou commented on HADOOP-15544: -- Thank you [~ste...@apache.org] for sharing the ste

[jira] [Commented] (HADOOP-15612) Improve exception when tfile fails to load LzoCodec

[ https://issues.apache.org/jira/browse/HADOOP-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554887#comment-16554887 ] Hudson commented on HADOOP-15612: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Resolved] (HADOOP-15572) Test S3Guard ops with assumed roles & verify required permissions

[ https://issues.apache.org/jira/browse/HADOOP-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15572. - Resolution: Duplicate > Test S3Guard ops with assumed roles & verify required permissio

[jira] [Updated] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15426: Description: managed to create on a parallel test run {code} org.apache.hadoop.fs.s3a.AWS

[jira] [Commented] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554863#comment-16554863 ] Steve Loughran commented on HADOOP-15426: - Screenshot of the state of play; thi

[jira] [Commented] (HADOOP-15604) Test if the unprocessed items in S3Guard DDB metadata store caused by I/O thresholds

[ https://issues.apache.org/jira/browse/HADOOP-15604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554858#comment-16554858 ] Steve Loughran commented on HADOOP-15604: - IS this happening in the S3A committ

[jira] [Updated] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15426: Attachment: Screen Shot 2018-07-24 at 15.16.46.png > S3guard throttle events => 400 error

[jira] [Commented] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554847#comment-16554847 ] Steve Loughran commented on HADOOP-15426: - Managed to recreate this in a parall

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554846#comment-16554846 ] genericqa commented on HADOOP-14927: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Updated] (HADOOP-15426) S3guard throttle events => 400 error code => exception

[ https://issues.apache.org/jira/browse/HADOOP-15426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15426: Summary: S3guard throttle events => 400 error code => exception (was: S3guard throttle e

[jira] [Updated] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15583: Description: started off just on sharing credentials across S3A and S3Guard, but in the

[jira] [Commented] (HADOOP-13230) s3a's use of fake empty directory blobs does not interoperate with other s3 tools

[ https://issues.apache.org/jira/browse/HADOOP-13230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554808#comment-16554808 ] Steve Jacobs commented on HADOOP-13230: --- Could this be implemented replacing the

[jira] [Commented] (HADOOP-15583) Stabilize S3A Assumed Role support

[ https://issues.apache.org/jira/browse/HADOOP-15583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554801#comment-16554801 ] Steve Loughran commented on HADOOP-15583: - Stack if your role doesn't have acce

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554795#comment-16554795 ] genericqa commented on HADOOP-14212: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13936: Target Version/s: 3.2.0 > S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete

[jira] [Updated] (HADOOP-13936) S3Guard: DynamoDB can go out of sync with S3AFileSystem::delete operation

[ https://issues.apache.org/jira/browse/HADOOP-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13936: Affects Version/s: 3.1.1 3.1.0 > S3Guard: DynamoDB can go out of s

[jira] [Commented] (HADOOP-14927) ITestS3GuardTool failures in testDestroyNoBucket()

[ https://issues.apache.org/jira/browse/HADOOP-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554790#comment-16554790 ] Steve Loughran commented on HADOOP-14927: - OK: so its related to the region you

[jira] [Commented] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554789#comment-16554789 ] Steve Jacobs commented on HADOOP-15628: --- We have an in house object store that ha

[jira] [Commented] (HADOOP-15627) S3A ITests failing if bucket explicitly set to s3guard+DDB

[ https://issues.apache.org/jira/browse/HADOOP-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554734#comment-16554734 ] Steve Loughran commented on HADOOP-15627: - Fixing in the HADOOP-15583 branch, a

[jira] [Updated] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13649: Parent: HADOOP-15226 (was: HADOOP-15619) > s3guard: implement time-based (TTL) expiry fo

[jira] [Updated] (HADOOP-13756) LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash.

[ https://issues.apache.org/jira/browse/HADOOP-13756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13756: Parent: HADOOP-15226 (was: HADOOP-15619) > LocalMetadataStore#put(DirListingMetadata) sh

[jira] [Commented] (HADOOP-15363) (transient) ITestS3AInconsistency.testOpenFailOnRead S3Guard failure

[ https://issues.apache.org/jira/browse/HADOOP-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554731#comment-16554731 ] Steve Loughran commented on HADOOP-15363: - Not seen this for a while; feel free

[jira] [Updated] (HADOOP-15034) S3Guard instrumentation to include cost of DynamoDB ops as metric

[ https://issues.apache.org/jira/browse/HADOOP-15034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15034: Parent: HADOOP-15619 (was: HADOOP-15226) > S3Guard instrumentation to include cost of Dy

[jira] [Updated] (HADOOP-14576) s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14576: Parent: HADOOP-15619 (was: HADOOP-15226) > s3guard DynamoDB resource not found: tables n

[jira] [Updated] (HADOOP-15573) s3guard set-capacity to not retry on an access denied exception

[ https://issues.apache.org/jira/browse/HADOOP-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15573: Parent: HADOOP-15619 (was: HADOOP-15226) > s3guard set-capacity to not retry on an acces

[jira] [Updated] (HADOOP-15563) s3guard init and set-capacity to support DDB autoscaling

[ https://issues.apache.org/jira/browse/HADOOP-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15563: Parent: HADOOP-15619 (was: HADOOP-15226) > s3guard init and set-capacity to support DDB

[jira] [Updated] (HADOOP-13980) S3Guard CLI: Add fsck check command

[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13980: Parent: HADOOP-15619 (was: HADOOP-15226) > S3Guard CLI: Add fsck check command > ---

[jira] [Updated] (HADOOP-14335) Improve DynamoDB schema update story

[ https://issues.apache.org/jira/browse/HADOOP-14335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14335: Parent: HADOOP-15619 (was: HADOOP-15226) > Improve DynamoDB schema update story > --

[jira] [Updated] (HADOOP-14585) Ensure controls in-place to prevent clients with significant clock skews pruning aggressively

[ https://issues.apache.org/jira/browse/HADOOP-14585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14585: Parent: HADOOP-15619 (was: HADOOP-15226) > Ensure controls in-place to prevent clients w

[jira] [Updated] (HADOOP-14000) s3guard metadata stores to support millons of children

[ https://issues.apache.org/jira/browse/HADOOP-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14000: Parent: HADOOP-15619 (was: HADOOP-15226) > s3guard metadata stores to support millons of

[jira] [Updated] (HADOOP-15193) add bulk delete call to metastore API & DDB impl

[ https://issues.apache.org/jira/browse/HADOOP-15193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15193: Parent: HADOOP-15619 (was: HADOOP-15226) > add bulk delete call to metastore API & DDB i

[jira] [Updated] (HADOOP-13843) S3Guard, MetadataStore to support atomic create(path, overwrite=false)

[ https://issues.apache.org/jira/browse/HADOOP-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13843: Parent: HADOOP-15619 (was: HADOOP-15226) > S3Guard, MetadataStore to support atomic crea

[jira] [Updated] (HADOOP-14109) improvements to S3GuardTool destroy command

[ https://issues.apache.org/jira/browse/HADOOP-14109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14109: Parent: HADOOP-15619 (was: HADOOP-15226) > improvements to S3GuardTool destroy command >

[jira] [Updated] (HADOOP-13454) S3Guard: Provide custom FileSystem Statistics.

[ https://issues.apache.org/jira/browse/HADOOP-13454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13454: Parent: HADOOP-15619 (was: HADOOP-15226) > S3Guard: Provide custom FileSystem Statistics

[jira] [Updated] (HADOOP-14425) Add more s3guard metrics

[ https://issues.apache.org/jira/browse/HADOOP-14425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14425: Parent: HADOOP-15619 (was: HADOOP-15226) > Add more s3guard metrics > --

[jira] [Updated] (HADOOP-13649) s3guard: implement time-based (TTL) expiry for LocalMetadataStore

[ https://issues.apache.org/jira/browse/HADOOP-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13649: Parent: HADOOP-15619 (was: HADOOP-15226) > s3guard: implement time-based (TTL) expiry fo

[jira] [Updated] (HADOOP-13756) LocalMetadataStore#put(DirListingMetadata) should also put file metadata into fileHash.

[ https://issues.apache.org/jira/browse/HADOOP-13756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-13756: Parent: HADOOP-15619 (was: HADOOP-15226) > LocalMetadataStore#put(DirListingMetadata) sh

[jira] [Updated] (HADOOP-15492) increase performance of s3guard import command

[ https://issues.apache.org/jira/browse/HADOOP-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15492: Parent: HADOOP-15619 (was: HADOOP-15226) > increase performance of s3guard import comman

[jira] [Comment Edited] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554611#comment-16554611 ] Steve Loughran edited comment on HADOOP-15628 at 7/24/18 7:44 PM: ---

[jira] [Commented] (HADOOP-15627) S3A ITests failing if bucket explicitly set to s3guard+DDB

[ https://issues.apache.org/jira/browse/HADOOP-15627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554713#comment-16554713 ] Steve Loughran commented on HADOOP-15627: - latter test failure goes away if you

[jira] [Commented] (HADOOP-15566) Remove HTrace support

[ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554695#comment-16554695 ] Steve Loughran commented on HADOOP-15566: - Stack is of course correct: we want

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554680#comment-16554680 ] Xiao Chen commented on HADOOP-15593: It makes sense for the best-effort retries in

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554659#comment-16554659 ] Eric Yang commented on HADOOP-15593: [~xiaochen] Renewal thread supposed to run unt

[jira] [Commented] (HADOOP-15623) Compiling hadoop-azure fails with jdk10 (javax javascript)

[ https://issues.apache.org/jira/browse/HADOOP-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554621#comment-16554621 ] Steve Loughran commented on HADOOP-15623: - Might be related to this https://www

[jira] [Assigned] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15628: --- Assignee: Steve Loughran > S3A Filesystem does not check return from AmazonS3Clien

[jira] [Updated] (HADOOP-15623) Compiling hadoop-azure fails with jdk10 (javax javascript)

[ https://issues.apache.org/jira/browse/HADOOP-15623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15623: Component/s: build > Compiling hadoop-azure fails with jdk10 (javax javascript) > ---

[jira] [Comment Edited] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554611#comment-16554611 ] Steve Loughran edited comment on HADOOP-15628 at 7/24/18 6:14 PM: ---

[jira] [Commented] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554611#comment-16554611 ] Steve Loughran commented on HADOOP-15628: - ps: that's not the current delete co

[jira] [Updated] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15628: Description: Deletes in S3A that use the Multi-Delete functionality in the Amazon S3 api

[jira] [Commented] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

[ https://issues.apache.org/jira/browse/HADOOP-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554589#comment-16554589 ] Steve Loughran commented on HADOOP-15628: - That's interesting. # How did you

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554585#comment-16554585 ] Xiao Chen commented on HADOOP-15593: Thanks for revving [~gabor.bota] and [~eyang]

[jira] [Created] (HADOOP-15628) S3A Filesystem does not check return from AmazonS3Client deleteObjects

Steve Jacobs created HADOOP-15628: - Summary: S3A Filesystem does not check return from AmazonS3Client deleteObjects Key: HADOOP-15628 URL: https://issues.apache.org/jira/browse/HADOOP-15628 Project: H

[jira] [Updated] (HADOOP-15576) S3A Multipart Uploader to work with S3Guard and encryption

[ https://issues.apache.org/jira/browse/HADOOP-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15576: Summary: S3A Multipart Uploader to work with S3Guard and encryption (was: S3A Multipar

[jira] [Commented] (HADOOP-15576) S3A Multipart Uploader API implementation to work with S3Guard and encryption

[ https://issues.apache.org/jira/browse/HADOOP-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554542#comment-16554542 ] Steve Loughran commented on HADOOP-15576: - Ewan, still expecting this * S3AMul

[jira] [Updated] (HADOOP-15576) S3A Multipart Uploader API implementation to work with S3Guard and encryption

[ https://issues.apache.org/jira/browse/HADOOP-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15576: Description: The new Multipart Uploader API of HDFS-13186 needs to work with S3Guard, wit

[jira] [Updated] (HADOOP-15576) S3A Multipart Uploader API implementation to work with S3Guard and encryption

[ https://issues.apache.org/jira/browse/HADOOP-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15576: Summary: S3A Multipart Uploader API implementation to work with S3Guard and encryption

[jira] [Updated] (HADOOP-15566) Remove HTrace support

[ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-15566: -- Labels: security (was: ) > Remove HTrace support > - > >

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554453#comment-16554453 ] Eric Yang commented on HADOOP-15593: [~gabor.bota] Thank you for the patch. In pat

[jira] [Commented] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554358#comment-16554358 ] Adam Antal commented on HADOOP-14212: - Thank you for the suggestions [~ajayydv], I

[jira] [Updated] (HADOOP-14212) Expose SecurityEnabled boolean field in JMX for other services besides NameNode

[ https://issues.apache.org/jira/browse/HADOOP-14212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated HADOOP-14212: Attachment: HADOOP-14212.006.patch > Expose SecurityEnabled boolean field in JMX for other servic

[jira] [Commented] (HADOOP-15607) AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream

[ https://issues.apache.org/jira/browse/HADOOP-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554234#comment-16554234 ] genericqa commented on HADOOP-15607: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-15607) AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream

[ https://issues.apache.org/jira/browse/HADOOP-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554209#comment-16554209 ] wujinhu commented on HADOOP-15607: -- [~Sammi] Finally, I reproduced this issue by chang

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554186#comment-16554186 ] genericqa commented on HADOOP-15593: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Updated] (HADOOP-15607) AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutputStream

[ https://issues.apache.org/jira/browse/HADOOP-15607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-15607: - Attachment: HADOOP-15607.003.patch > AliyunOSS: fix duplicated partNumber issue in AliyunOSSBlockOutput

[jira] [Commented] (HADOOP-15395) DefaultImpersonationProvider fails to parse proxy user config if username has . in it

[ https://issues.apache.org/jira/browse/HADOOP-15395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554100#comment-16554100 ] Mukul Kumar Singh commented on HADOOP-15395: Thanks for working on this [~a

[jira] [Updated] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-15593: Attachment: HADOOP-15593.004.patch > UserGroupInformation TGT renewer throws NPE > --

[jira] [Commented] (HADOOP-15593) UserGroupInformation TGT renewer throws NPE

[ https://issues.apache.org/jira/browse/HADOOP-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554020#comment-16554020 ] Gabor Bota commented on HADOOP-15593: - Hi [~eyang], The first approach you've prop

[jira] [Commented] (HADOOP-15456) create base image for running secure ozone cluster

[ https://issues.apache.org/jira/browse/HADOOP-15456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16554002#comment-16554002 ] Elek, Marton commented on HADOOP-15456: --- Thank you very much the patch [~ajayydv]

[jira] [Comment Edited] (HADOOP-15611) Improve log in FairCallQueue

[ https://issues.apache.org/jira/browse/HADOOP-15611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553932#comment-16553932 ] Yiqun Lin edited comment on HADOOP-15611 at 7/24/18 9:14 AM:

  1   2   >