[jira] [Resolved] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18516. - Fix Version/s: 3.4.1 Resolution: Fixed > [ABFS]: Support fixed SAS token config

[jira] [Updated] (HADOOP-19154) upgrade bouncy castle to 1.78.1 due to CVEs

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19154: Fix Version/s: 3.4.1 > upgrade bouncy castle to 1.78.1 due to CVEs >

[jira] [Resolved] (HADOOP-19178) WASB Driver Deprecation and eventual removal

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19178. - Fix Version/s: 3.3.9 3.5.0 Assignee: Anuj Modi (was: Sneha

[jira] [Resolved] (HADOOP-19114) upgrade to commons-compress 1.26.1 due to cves

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19114. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > upgrade to

[jira] [Commented] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853112#comment-17853112 ] Steve Loughran commented on HADOOP-19196: - bq. good catch. [~mukund-thakur], I consider my

[jira] [Commented] (HADOOP-19197) S3A: Support AWS KMS Encryption Context

2024-06-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17853109#comment-17853109 ] Steve Loughran commented on HADOOP-19197: - makes sense. as well as the request factory you will

[jira] [Comment Edited] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852870#comment-17852870 ] Steve Loughran edited comment on HADOOP-19196 at 6/6/24 5:01 PM: - we

[jira] [Commented] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852870#comment-17852870 ] Steve Loughran commented on HADOOP-19196: - we need a contract test for this. {code}

[jira] [Assigned] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19196: --- Assignee: Mukund Thakur > Bulk delete api doesn't take the path to delete as the

[jira] [Created] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-06 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19196: --- Summary: Bulk delete api doesn't take the path to delete as the base path Key: HADOOP-19196 URL: https://issues.apache.org/jira/browse/HADOOP-19196 Project:

[jira] [Updated] (HADOOP-19154) upgrade bouncy castle to 1.78.1 due to CVEs

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19154: Fix Version/s: 3.5.0 > upgrade bouncy castle to 1.78.1 due to CVEs >

[jira] [Updated] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19193: Component/s: build > Create orphan commit for website deployment >

[jira] [Assigned] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19193: --- Assignee: Cheng Pan > Create orphan commit for website deployment >

[jira] [Resolved] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19193. - Fix Version/s: 3.5.0 Resolution: Fixed > Create orphan commit for website

[jira] [Resolved] (HADOOP-19188) TestHarFileSystem and TestFilterFileSystem failing after bulk delete API added

2024-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19188. - Resolution: Fixed > TestHarFileSystem and TestFilterFileSystem failing after bulk

[jira] [Updated] (HADOOP-19191) Batch APIs for delete

2024-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19191: Component/s: fs/s3 > Batch APIs for delete > - > >

[jira] [Resolved] (HADOOP-19191) Batch APIs for delete

2024-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19191. - Resolution: Duplicate Fixed in HADOOP-18679; there's an iceberg PR up to use the

[jira] [Updated] (HADOOP-19191) Batch APIs for delete

2024-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19191: Issue Type: New Feature (was: Bug) > Batch APIs for delete > - > >

[jira] [Commented] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851112#comment-17851112 ] Steve Loughran commented on HADOOP-19013: - i think the new test needs a

[jira] [Commented] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851108#comment-17851108 ] Steve Loughran commented on HADOOP-19013: - got a failure now {code} [ERROR] Tests run: 5,

[jira] [Created] (HADOOP-19189) ITestS3ACommitterFactory failing

2024-05-31 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19189: --- Summary: ITestS3ACommitterFactory failing Key: HADOOP-19189 URL: https://issues.apache.org/jira/browse/HADOOP-19189 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-18516) [ABFS]: Support fixed SAS token config in addition to Custom SASTokenProvider Implementation

2024-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18516: Fix Version/s: 3.5.0 > [ABFS]: Support fixed SAS token config in addition to Custom

[jira] [Updated] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18679: Description: iceberg and hbase could benefit from being able to give a list of

[jira] [Assigned] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18679: --- Assignee: Mukund Thakur > Add API for bulk/paged delete of files and objects >

[jira] [Updated] (HADOOP-19188) TestHarFileSystem and TestFilterFileSystem failing after bulk delete API added

2024-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19188: Fix Version/s: 3.5.0 > TestHarFileSystem and TestFilterFileSystem failing after bulk

[jira] [Updated] (HADOOP-19188) TestHarFileSystem and TestFilterFileSystem failing after bulk delete API added

2024-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19188: Affects Version/s: 3.4.1 > TestHarFileSystem and TestFilterFileSystem failing after bulk

[jira] [Updated] (HADOOP-19131) WrappedIO to export modern filesystem/statistics APIs in a reflection friendly form

2024-05-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19131: Description: parquet, avro etc are still stuck building with older hadoop releases.

[jira] [Updated] (HADOOP-19131) WrappedIO to export modern filesystem/statistics APIs in a reflection friendly form

2024-05-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19131: Affects Version/s: 3.3.6 > WrappedIO to export modern filesystem/statistics APIs in a

[jira] [Updated] (HADOOP-19131) WrappedIO to export modern filesystem/statistics APIs in a reflection friendly form

2024-05-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19131: Summary: WrappedIO to export modern filesystem/statistics APIs in a reflection friendly

[jira] [Updated] (HADOOP-19131) Assist reflection IO with WrappedOperations class

2024-05-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19131: Parent: (was: HADOOP-18477) Issue Type: Improvement (was: Sub-task) >

[jira] [Updated] (HADOOP-19131) Assist reflection IO with WrappedOperations class

2024-05-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19131: Priority: Major (was: Minor) > Assist reflection IO with WrappedOperations class >

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

2024-05-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17849980#comment-17849980 ] Steve Loughran commented on HADOOP-18708: - [~srahman] looking forward to the patch Anything we

[jira] [Created] (HADOOP-19188) TestHarFileSystem and TestFilterFileSystem failing after bulk delete API added

2024-05-27 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19188: --- Summary: TestHarFileSystem and TestFilterFileSystem failing after bulk delete API added Key: HADOOP-19188 URL: https://issues.apache.org/jira/browse/HADOOP-19188

[jira] [Updated] (HADOOP-18962) Upgrade kafka to 3.4.0

2024-05-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18962: Component/s: build > Upgrade kafka to 3.4.0 > -- > >

[jira] [Resolved] (HADOOP-18962) Upgrade kafka to 3.4.0

2024-05-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18962. - Fix Version/s: 3.5.0 Resolution: Fixed > Upgrade kafka to 3.4.0 >

[jira] [Resolved] (HADOOP-19168) Upgrade Kafka Clients due to CVEs

2024-05-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19168. - Resolution: Duplicate rohit, dupe of HADOOP-18962. let's focus on that > Upgrade

[jira] [Updated] (HADOOP-19182) Upgrade kafka to 3.4.0

2024-05-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19182: Affects Version/s: 3.4.0 > Upgrade kafka to 3.4.0 > -- > >

[jira] [Updated] (HADOOP-19182) Upgrade kafka to 3.4.0

2024-05-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19182: Issue Type: Improvement (was: Bug) > Upgrade kafka to 3.4.0 > -- >

[jira] [Created] (HADOOP-19185) Improve ABFS metric integration with iOStatistics

2024-05-23 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19185: --- Summary: Improve ABFS metric integration with iOStatistics Key: HADOOP-19185 URL: https://issues.apache.org/jira/browse/HADOOP-19185 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18325) ABFS: Add correlated metric support for ABFS operations

2024-05-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18325. - Fix Version/s: 3.5.0 Resolution: Fixed > ABFS: Add correlated metric support

[jira] [Comment Edited] (HADOOP-19178) WASB Driver Deprecation and eventual removal

2024-05-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848360#comment-17848360 ] Steve Loughran edited comment on HADOOP-19178 at 5/22/24 2:17 PM: --

[jira] [Updated] (HADOOP-19177) TestS3ACachingBlockManager fails intermittently in Yetus

2024-05-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19177: Parent: HADOOP-18028 Issue Type: Sub-task (was: Test) >

[jira] [Commented] (HADOOP-19177) TestS3ACachingBlockManager fails intermittently in Yetus

2024-05-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848364#comment-17848364 ] Steve Loughran commented on HADOOP-19177: - before going near this I want HADOOP-18184 in, as

[jira] [Commented] (HADOOP-19178) WASB Driver Deprecation and eventual removal

2024-05-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848360#comment-17848360 ] Steve Loughran commented on HADOOP-19178: - makes sense, I've been undertesting it anyway. It'd

[jira] [Resolved] (HADOOP-19163) Upgrade protobuf version to 3.25.3

2024-05-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19163. - Resolution: Fixed done. not sure what version to tag with. Proposed: we cut a new

[jira] [Commented] (HADOOP-19181) IAMCredentialsProvider throttle failures

2024-05-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848336#comment-17848336 ] Steve Loughran commented on HADOOP-19181: - Spent some time looking into the AWS SDK with

[jira] [Commented] (HADOOP-18990) S3A: retry on credential expiry

2024-05-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847848#comment-17847848 ] Steve Loughran commented on HADOOP-18990: - noticed that an AWS product (greegrass) has

[jira] [Commented] (HADOOP-19181) IAMCredentialsProvider throttle failures

2024-05-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847840#comment-17847840 ] Steve Loughran commented on HADOOP-19181: - reviewing AWS SDK JIRA, there's still a shorter

[jira] [Updated] (HADOOP-19181) IAMCredentialsProvider throttle failures

2024-05-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19181: Description: Tests report throttling errors in IAM being remapped to noauth and failure

[jira] [Created] (HADOOP-19181) IAMCredentialsProvider throttle failures

2024-05-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19181: --- Summary: IAMCredentialsProvider throttle failures Key: HADOOP-19181 URL: https://issues.apache.org/jira/browse/HADOOP-19181 Project: Hadoop Common

[jira] [Updated] (HADOOP-18722) Optimise S3A delete objects when multiObjectDelete is disabled

2024-05-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18722: Affects Version/s: 3.3.6 > Optimise S3A delete objects when multiObjectDelete is

[jira] [Updated] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-05-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18679: Summary: Add API for bulk/paged delete of files and objects (was: Add API for

[jira] [Resolved] (HADOOP-19172) Upgrade aws-java-sdk to 1.12.720

2024-05-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19172. - Fix Version/s: 3.3.9 3.5.0 3.4.1

[jira] [Resolved] (HADOOP-19073) WASB: Fix connection leak in FolderRenamePending

2024-05-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19073. - Resolution: Fixed > WASB: Fix connection leak in FolderRenamePending >

[jira] [Assigned] (HADOOP-19073) WASB: Fix connection leak in FolderRenamePending

2024-05-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19073: --- Assignee: xy > WASB: Fix connection leak in FolderRenamePending >

[jira] [Updated] (HADOOP-19073) WASB: Fix connection leak in FolderRenamePending

2024-05-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19073: Fix Version/s: 3.5.0 > WASB: Fix connection leak in FolderRenamePending >

[jira] [Updated] (HADOOP-19170) Fixes compilation issues on Mac

2024-05-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19170: Fix Version/s: 3.4.1 > Fixes compilation issues on Mac > ---

[jira] [Created] (HADOOP-19176) S3A Xattr headers need hdfs-compatible prefix

2024-05-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19176: --- Summary: S3A Xattr headers need hdfs-compatible prefix Key: HADOOP-19176 URL: https://issues.apache.org/jira/browse/HADOOP-19176 Project: Hadoop Common

[jira] [Assigned] (HADOOP-18786) Hadoop build depends on archives.apache.org

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18786: --- Assignee: Christopher Tubbs > Hadoop build depends on archives.apache.org >

[jira] [Updated] (HADOOP-18786) Hadoop build depends on archives.apache.org

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18786: Fix Version/s: 3.5.0 > Hadoop build depends on archives.apache.org >

[jira] [Assigned] (HADOOP-18958) Improve UserGroupInformation debug log

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18958: --- Assignee: wangzhihui > Improve UserGroupInformation debug log >

[jira] [Resolved] (HADOOP-18958) Improve UserGroupInformation debug log

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18958. - Fix Version/s: 3.5.0 Resolution: Fixed > Improve UserGroupInformation debug

[jira] [Updated] (HADOOP-18958) Improve UserGroupInformation debug log

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18958: Summary: Improve UserGroupInformation debug log (was: UserGroupInformation debug log

[jira] [Reopened] (HADOOP-18958) UserGroupInformation debug log improve

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-18958: - > UserGroupInformation debug log improve > -- > >

[jira] [Updated] (HADOOP-19171) S3A: handle alternative forms of connection failure

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19171: Description: We've had reports of network connection failures surfacing deeper in the

[jira] [Updated] (HADOOP-19171) S3A: handle alternative forms of connection failure

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19171: Description: We've had reports of network connection failures surfacing deeper in the

[jira] [Created] (HADOOP-19175) update s3a committer docs

2024-05-14 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19175: --- Summary: update s3a committer docs Key: HADOOP-19175 URL: https://issues.apache.org/jira/browse/HADOOP-19175 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-19174) Tez and hive jobs fail due to google's protobuf 2.5.0 in classpath

2024-05-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846230#comment-17846230 ] Steve Loughran commented on HADOOP-19174: - * which hadoop version * what happens if you remove

[jira] [Commented] (HADOOP-19165) Explore dropping protobuf 2.5.0 from the distro

2024-05-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846021#comment-17846021 ] Steve Loughran commented on HADOOP-19165: - relates to HADOOP-18487, where I tried to do most of

[jira] [Assigned] (HADOOP-19172) Upgrade aws-java-sdk to 1.12.720

2024-05-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19172: --- Assignee: Steve Loughran > Upgrade aws-java-sdk to 1.12.720 >

[jira] [Created] (HADOOP-19172) Upgrade aws-java-sdk to 1.12.720

2024-05-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19172: --- Summary: Upgrade aws-java-sdk to 1.12.720 Key: HADOOP-19172 URL: https://issues.apache.org/jira/browse/HADOOP-19172 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-19171) S3A: handle alternative forms of connection failure

2024-05-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845921#comment-17845921 ] Steve Loughran commented on HADOOP-19171: - stack 2 {code} Caused by:

[jira] [Commented] (HADOOP-19171) S3A: handle alternative forms of connection failure

2024-05-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845920#comment-17845920 ] Steve Loughran commented on HADOOP-19171: - stack 1 {code} Caused by:

[jira] [Created] (HADOOP-19171) AWS v2: handle alternative forms of connection failure

2024-05-13 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19171: --- Summary: AWS v2: handle alternative forms of connection failure Key: HADOOP-19171 URL: https://issues.apache.org/jira/browse/HADOOP-19171 Project: Hadoop Common

[jira] [Updated] (HADOOP-19171) S3A: handle alternative forms of connection failure

2024-05-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19171: Summary: S3A: handle alternative forms of connection failure (was: AWS v2: handle

[jira] [Commented] (HADOOP-19161) S3A: option "fs.s3a.performance.flags" to take list of performance flags

2024-05-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844398#comment-17844398 ] Steve Loughran commented on HADOOP-19161: - HADOOP-18544 is the delete optimisation. we know

[jira] [Commented] (HADOOP-19163) Upgrade protobuf version to 3.24.4

2024-05-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843730#comment-17843730 ] Steve Loughran commented on HADOOP-19163: - i'm on vacation this week. > Upgrade protobuf

[jira] [Commented] (HADOOP-19164) Hadoop CLI MiniCluster is broken

2024-05-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843489#comment-17843489 ] Steve Loughran commented on HADOOP-19164: - * be nice to cut the need for mockito out * and we

[jira] [Updated] (HADOOP-19161) S3A: option "fs.s3a.performance.flags" to take list of performance flags

2024-05-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19161: Summary: S3A: option "fs.s3a.performance.flags" to take list of performance flags (was:

[jira] [Created] (HADOOP-19161) S3A: support a comma separated list of performance flags

2024-05-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19161: --- Summary: S3A: support a comma separated list of performance flags Key: HADOOP-19161 URL: https://issues.apache.org/jira/browse/HADOOP-19161 Project: Hadoop

[jira] [Updated] (HADOOP-19160) hadoop-auth should not depend on kerb-simplekdc

2024-05-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19160: Affects Version/s: 3.4.0 > hadoop-auth should not depend on kerb-simplekdc >

[jira] [Resolved] (HADOOP-19146) noaa-cors-pds bucket access with global endpoint fails

2024-04-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19146. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > noaa-cors-pds

[jira] [Updated] (HADOOP-19146) noaa-cors-pds bucket access with global endpoint fails

2024-04-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19146: Priority: Minor (was: Major) > noaa-cors-pds bucket access with global endpoint fails >

[jira] [Commented] (HADOOP-19107) Drop support for HBase v1 & upgrade HBase v2

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842024#comment-17842024 ] Steve Loughran commented on HADOOP-19107: - yay! # add in release notes? # backport to 3.4.1? #

[jira] [Assigned] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19159: --- Assignee: Xi Chen > Fix hadoop-aws document for

[jira] [Commented] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842017#comment-17842017 ] Steve Loughran commented on HADOOP-19159: - thanks! merged to all the maintained branches > Fix

[jira] [Updated] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19159: Affects Version/s: 3.3.6 > Fix hadoop-aws document for

[jira] [Resolved] (HADOOP-19159) Fix hadoop-aws document for fs.s3a.committer.abort.pending.uploads

2024-04-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19159. - Fix Version/s: 3.3.9 3.5.0 3.4.1

[jira] [Updated] (HADOOP-19158) S3A: Support ByteBufferPositionedReadable through vector IO

2024-04-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19158: Summary: S3A: Support ByteBufferPositionedReadable through vector IO (was: S3A: Support

[jira] [Updated] (HADOOP-19158) S3A: Support delegating ByteBufferPositionedReadable through vector IO

2024-04-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19158: Summary: S3A: Support delegating ByteBufferPositionedReadable through vector IO (was:

[jira] [Updated] (HADOOP-19158) S3A: Support delegating ByteBufferPositionedReadable through vector IO

2024-04-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19158: Description: Make it easy for any stream with vector io to support

[jira] [Created] (HADOOP-19158) Support delegating ByteBufferPositionedReadable to vector reads

2024-04-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19158: --- Summary: Support delegating ByteBufferPositionedReadable to vector reads Key: HADOOP-19158 URL: https://issues.apache.org/jira/browse/HADOOP-19158 Project:

[jira] [Commented] (HADOOP-19157) [ABFS] Filesystem contract tests to use methodPath for robust parallel test runs

2024-04-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17840122#comment-17840122 ] Steve Loughran commented on HADOOP-19157: - note: this is not a problem with abfs -it just has

[jira] [Created] (HADOOP-19157) [ABFS] Filesystem contract tests to use methodPath for robust parallel test runs

2024-04-23 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19157: --- Summary: [ABFS] Filesystem contract tests to use methodPath for robust parallel test runs Key: HADOOP-19157 URL: https://issues.apache.org/jira/browse/HADOOP-19157

[jira] [Resolved] (HADOOP-19102) [ABFS]: FooterReadBufferSize should not be greater than readBufferSize

2024-04-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19102. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > [ABFS]:

[jira] [Commented] (HADOOP-19085) Compatibility Benchmark over HCFS Implementations

2024-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839704#comment-17839704 ] Steve Loughran commented on HADOOP-19085: - that's really interesting. abfs has full filesystem

[jira] [Updated] (HADOOP-19083) provide hadoop binary tarball without aws v2 sdk

2024-04-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19083: Description: Have the default hadoop binary .tar.gz exclude the aws v2 sdk by default.

[jira] [Updated] (HADOOP-19154) upgrade bouncy castle to 1.78.1 due to CVEs

2024-04-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19154: Affects Version/s: 3.3.6 3.4.0 > upgrade bouncy castle to 1.78.1

[jira] [Created] (HADOOP-19153) hadoop-common still exports logback as a transitive dependency

2024-04-17 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19153: --- Summary: hadoop-common still exports logback as a transitive dependency Key: HADOOP-19153 URL: https://issues.apache.org/jira/browse/HADOOP-19153 Project:

[jira] [Commented] (HADOOP-19084) prune dependency exports of hadoop-* modules

2024-04-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838241#comment-17838241 ] Steve Loughran commented on HADOOP-19084: - logback is still being exported by hadoop-common via

  1   2   3   4   5   6   7   8   9   10   >