[jira] [Resolved] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19196. Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Bulk delete api

[jira] [Updated] (HADOOP-19137) [ABFS]Prevent ABFS initialization for non-hierarchal-namespace account if Customer-provided-key configs given.

2024-06-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19137: --- Fix Version/s: 3.4.1 > [ABFS]Prevent ABFS initialization for non-hierarchal-namespace

[jira] [Resolved] (HADOOP-19137) [ABFS]Prevent ABFS initialization for non-hierarchal-namespace account if Customer-provided-key configs given.

2024-06-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19137. Resolution: Fixed > [ABFS]Prevent ABFS initialization for non-hierarchal-namespace

[jira] [Updated] (HADOOP-19137) [ABFS]Prevent ABFS initialization for non-hierarchal-namespace account if Customer-provided-key configs given.

2024-06-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19137: --- Fix Version/s: 3.5.0 > [ABFS]Prevent ABFS initialization for non-hierarchal-namespace

[jira] [Updated] (HADOOP-19137) [ABFS]Prevent ABFS initialization for non-hierarchal-namespace account if Customer-provided-key configs given.

2024-06-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19137: --- Summary: [ABFS]Prevent ABFS initialization for non-hierarchal-namespace account if

[jira] [Updated] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-06-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18679: --- Description: iceberg and hbase could benefit from being able to give a list of individual

[jira] [Commented] (HADOOP-19196) Bulk delete api doesn't take the path to delete as the base path

2024-06-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17852954#comment-17852954 ] Mukund Thakur commented on HADOOP-19196: good catch.  > Bulk delete api doesn't take the path

[jira] [Resolved] (HADOOP-19190) Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms

2024-06-03 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19190. Resolution: Fixed > Skip

[jira] [Updated] (HADOOP-19190) Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms

2024-06-03 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19190: --- Fix Version/s: 3.4.1 > Skip

[jira] [Commented] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17851217#comment-17851217 ] Mukund Thakur commented on HADOOP-19013: yes, you are right. thanks 

[jira] [Updated] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-31 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19013: --- Description: Once a path while uploading has been encrypted with SSE-KMS with a key id and

[jira] [Created] (HADOOP-19190) Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms

2024-05-31 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19190: -- Summary: Skip ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when bucket not encrypted with sse-kms Key: HADOOP-19190 URL:

[jira] [Updated] (HADOOP-19188) TestHarFileSystem and TestFilterFileSystem failing after bulk delete API added

2024-05-30 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19188: --- Fix Version/s: 3.4.1 > TestHarFileSystem and TestFilterFileSystem failing after bulk

[jira] [Resolved] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-05-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18679. Resolution: Fixed > Add API for bulk/paged delete of files and objects >

[jira] [Resolved] (HADOOP-19184) TestStagingCommitter.testJobCommitFailure failing

2024-05-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19184. Fix Version/s: 3.4.1 Resolution: Fixed >

[jira] [Updated] (HADOOP-18679) Add API for bulk/paged delete of files and objects

2024-05-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18679: --- Fix Version/s: 3.4.1 > Add API for bulk/paged delete of files and objects >

[jira] [Updated] (HADOOP-19184) TestStagingCommitter.testJobCommitFailure failing

2024-05-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19184: --- Description: {code:java} [INFO] [ERROR] Failures: [ERROR]  

[jira] [Created] (HADOOP-19184) TestStagingCommitter.testJobCommitFailure failing

2024-05-22 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19184: -- Summary: TestStagingCommitter.testJobCommitFailure failing Key: HADOOP-19184 URL: https://issues.apache.org/jira/browse/HADOOP-19184 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-15 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19013. Resolution: Fixed > fs.getXattrs(path) for S3FS doesn't have >

[jira] [Updated] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-05-15 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19013: --- Fix Version/s: 3.4.1 > fs.getXattrs(path) for S3FS doesn't have >

[jira] [Created] (HADOOP-19177) TestS3ACachingBlockManager fails intermittently in Yetus

2024-05-15 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19177: -- Summary: TestS3ACachingBlockManager fails intermittently in Yetus Key: HADOOP-19177 URL: https://issues.apache.org/jira/browse/HADOOP-19177 Project: Hadoop Common

[jira] [Resolved] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-19150. Fix Version/s: 3.4.1 Resolution: Fixed > Test

[jira] [Created] (HADOOP-19150) Test ITestAbfsRestOperationException#testAuthFailException is broken.

2024-04-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19150: -- Summary: Test ITestAbfsRestOperationException#testAuthFailException is broken. Key: HADOOP-19150 URL: https://issues.apache.org/jira/browse/HADOOP-19150

[jira] [Created] (HADOOP-19149) ABFS: Implement ThreadLocal for ObjectMapper in AzureHttpOperation via config option with static shared instance as an alternative.

2024-04-16 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19149: -- Summary: ABFS: Implement ThreadLocal for ObjectMapper in AzureHttpOperation via config option with static shared instance as an alternative. Key: HADOOP-19149 URL:

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2024-04-15 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837408#comment-17837408 ] Mukund Thakur commented on HADOOP-18296: {quote}Mukund, do we actually need to coalesce ranges

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

2024-04-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836272#comment-17836272 ] Mukund Thakur commented on HADOOP-18296: Yes, it is. Although direct buffers are not used in

[jira] [Commented] (HADOOP-17826) ABFS: Transient failure of TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting

2024-04-03 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833737#comment-17833737 ] Mukund Thakur commented on HADOOP-17826: I am seeing this now .  {code:java} [ERROR] Tests run:

[jira] [Created] (HADOOP-19110) ITestExponentialRetryPolicy failing in branch-3.4

2024-03-13 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19110: -- Summary: ITestExponentialRetryPolicy failing in branch-3.4 Key: HADOOP-19110 URL: https://issues.apache.org/jira/browse/HADOOP-19110 Project: Hadoop Common

[jira] [Commented] (HADOOP-19106) [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE

2024-03-12 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825849#comment-17825849 ] Mukund Thakur commented on HADOOP-19106: It fails because

[jira] [Commented] (HADOOP-19106) [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE

2024-03-12 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825838#comment-17825838 ] Mukund Thakur commented on HADOOP-19106: It does fail for me with the same config mentioned in  

[jira] [Commented] (HADOOP-18854) add options to disable range merging of vectored io

2024-03-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825443#comment-17825443 ] Mukund Thakur commented on HADOOP-18854: There is already an option to disable merging 

[jira] [Commented] (HADOOP-19106) [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE

2024-03-11 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825418#comment-17825418 ] Mukund Thakur commented on HADOOP-19106: CC [~snvijaya]  [~pranavs]  > [ABFS] All tests of.

[jira] [Created] (HADOOP-19106) [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE

2024-03-11 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19106: -- Summary: [ABFS] All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE Key: HADOOP-19106 URL: https://issues.apache.org/jira/browse/HADOOP-19106

[jira] [Updated] (HADOOP-18759) [ABFS][Backoff-Optimization] Have a Static retry policy for connection timeout failures

2024-02-20 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18759: --- Fix Version/s: 3.5.0 > [ABFS][Backoff-Optimization] Have a Static retry policy for

[jira] [Updated] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2024-01-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19015: --- Fix Version/s: 3.3.7 > Increase fs.s3a.connection.maximum to 500 to minimize risk of

[jira] [Commented] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-01-02 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801945#comment-17801945 ] Mukund Thakur commented on HADOOP-19013: Well, this is an attribute. So setting it would be

[jira] [Updated] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2023-12-19 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19015: --- Component/s: fs/s3 > Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout

[jira] [Updated] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2023-12-19 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-19015: --- Affects Version/s: 3.4.0 > Increase fs.s3a.connection.maximum to 500 to minimize risk of

[jira] [Created] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2023-12-19 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19015: -- Summary: Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool Key: HADOOP-19015 URL:

[jira] [Assigned] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2023-12-19 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-19015: -- Assignee: Mukund Thakur > Increase fs.s3a.connection.maximum to 500 to minimize

[jira] [Created] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2023-12-14 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-19013: -- Summary: fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header. Key: HADOOP-19013 URL:

[jira] [Commented] (HADOOP-11867) Add a high-performance vectored read API.

2023-10-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17779666#comment-17779666 ] Mukund Thakur commented on HADOOP-11867: Hey [~yuanbo]  Vectored IO is intelligent. It merges

[jira] [Resolved] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18929. Fix Version/s: 3.3.9 Resolution: Fixed > Build failure while trying to create

[jira] [Assigned] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-18929: -- Assignee: PJ Fanning > Build failure while trying to create apache 3.3.7 release

[jira] [Commented] (HADOOP-18890) remove okhttp usage

2023-10-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17774965#comment-17774965 ] Mukund Thakur commented on HADOOP-18890: Yes. I see you have already merged.  > remove okhttp

[jira] [Commented] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773811#comment-17773811 ] Mukund Thakur commented on HADOOP-18929: Oh okay. A quick followup PR will do. Thanks > Build

[jira] [Reopened] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-10-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reopened HADOOP-18895: > upgrade to commons-compress 1.24.0 due to CVE >

[jira] [Commented] (HADOOP-18895) upgrade to commons-compress 1.24.0 due to CVE

2023-10-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773793#comment-17773793 ] Mukund Thakur commented on HADOOP-18895: We need to revert this as it is causing

[jira] [Commented] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-10 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17773753#comment-17773753 ] Mukund Thakur commented on HADOOP-18929: Thanks, [~ayushtkn]  for checking quickly. Let me

[jira] [Created] (HADOOP-18929) Build failure while trying to create apache 3.3.7 release locally.

2023-10-10 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18929: -- Summary: Build failure while trying to create apache 3.3.7 release locally. Key: HADOOP-18929 URL: https://issues.apache.org/jira/browse/HADOOP-18929 Project:

[jira] [Resolved] (HADOOP-18845) Add ability to configure ConnectionTTL of http connections while creating S3 Client.

2023-08-25 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18845. Resolution: Fixed > Add ability to configure ConnectionTTL of http connections while

[jira] [Created] (HADOOP-18845) Add ability to configure ConnectionTTL of http connections while creating S3 Client.

2023-08-09 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18845: -- Summary: Add ability to configure ConnectionTTL of http connections while creating S3 Client. Key: HADOOP-18845 URL: https://issues.apache.org/jira/browse/HADOOP-18845

[jira] [Resolved] (HADOOP-18763) Upgrade aws-java-sdk to 1.12.367+

2023-06-14 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18763. Fix Version/s: 3.3.6 Resolution: Fixed > Upgrade aws-java-sdk to 1.12.367+ >

[jira] [Assigned] (HADOOP-18763) Upgrade aws-java-sdk to 1.12.367+

2023-06-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-18763: -- Assignee: Viraj Jasani (was: Mukund Thakur) > Upgrade aws-java-sdk to 1.12.367+ >

[jira] [Assigned] (HADOOP-18763) Upgrade aws-java-sdk to 1.12.367+

2023-06-13 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-18763: -- Assignee: Mukund Thakur > Upgrade aws-java-sdk to 1.12.367+ >

[jira] [Commented] (HADOOP-17852) ABFS: Test with 100MB buffer size in ITestAbfsReadWriteAndSeek times out

2023-05-24 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725998#comment-17725998 ] Mukund Thakur commented on HADOOP-17852: seeing this in one of our customer prod cluster.

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-02-21 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691825#comment-17691825 ] Mukund Thakur commented on HADOOP-18637: As discussed offline, following changes will be

[jira] [Resolved] (HADOOP-18103) High performance vectored read API in Hadoop

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18103. Fix Version/s: 3.3.5 (was: 3.4.0) Resolution: Fixed > High

[jira] [Resolved] (HADOOP-18507) VectorIO FileRange type to support a "reference" field

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18507. Fix Version/s: 3.3.5 Resolution: Fixed > VectorIO FileRange type to support a

[jira] [Updated] (HADOOP-18460) ITestS3AContractVectoredRead.testStopVectoredIoOperationsUnbuffer failing

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18460: --- Fix Version/s: (was: 3.4.0) >

[jira] [Reopened] (HADOOP-11867) Add a high-performance vectored read API.

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reopened HADOOP-11867: > Add a high-performance vectored read API. > - > >

[jira] [Resolved] (HADOOP-11867) Add a high-performance vectored read API.

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-11867. Resolution: Fixed > Add a high-performance vectored read API. >

[jira] [Resolved] (HADOOP-18320) Improve S3A delegations token documentation

2023-01-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18320. Fix Version/s: 3.3.9 Resolution: Fixed > Improve S3A delegations token

[jira] [Updated] (HADOOP-11867) Add a high-performance vectored read API.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-11867: --- Fix Version/s: 3.3.5 > Add a high-performance vectored read API. >

[jira] [Updated] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18104: --- Fix Version/s: 3.3.5 > Add configs to configure minSeekForVectorReads and

[jira] [Updated] (HADOOP-18107) Vectored IO support for large S3 files.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18107: --- Fix Version/s: 3.3.5 > Vectored IO support for large S3 files. >

[jira] [Updated] (HADOOP-18105) Implement a variant of ElasticByteBufferPool which uses weak references for garbage collection.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18105: --- Fix Version/s: 3.3.5 > Implement a variant of ElasticByteBufferPool which uses weak

[jira] [Updated] (HADOOP-18106) Handle memory fragmentation in S3 Vectored IO implementation.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18106: --- Fix Version/s: 3.3.5 > Handle memory fragmentation in S3 Vectored IO implementation. >

[jira] [Updated] (HADOOP-18227) Add input stream IOstats for vectored IO api in S3A.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18227: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Add input stream IOstats for

[jira] [Updated] (HADOOP-18355) Update previous index properly while validating overlapping ranges.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18355: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Update previous index properly

[jira] [Updated] (HADOOP-18392) Propagate vectored s3a input stream stats to file system stats.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18392: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Propagate vectored s3a input

[jira] [Updated] (HADOOP-18407) Improve vectored IO api spec.

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18407: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Improve vectored IO api spec.

[jira] [Updated] (HADOOP-18391) Improve VectoredReadUtils#readVectored() for direct buffers

2022-12-22 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18391: --- Fix Version/s: 3.3.5 (was: 3.4.0) > Improve

[jira] [Commented] (HADOOP-18073) Upgrade AWS SDK to v2

2022-12-12 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17646318#comment-17646318 ] Mukund Thakur commented on HADOOP-18073: Looks good to me. Please re-run all the tests here

[jira] [Updated] (HADOOP-18311) Upgrade dependencies to address several CVEs

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18311: --- Target Version/s: 3.3.9 [~svaughan]  Are we still planning to do this for 3.3.5 release as

[jira] [Updated] (HADOOP-18311) Upgrade dependencies to address several CVEs

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18311: --- Fix Version/s: (was: 3.3.5) > Upgrade dependencies to address several CVEs >

[jira] [Resolved] (HADOOP-18408) [ABFS]: ITestAbfsManifestCommitProtocol fails on nonHNS configuration

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18408. Resolution: Fixed > [ABFS]: ITestAbfsManifestCommitProtocol fails on nonHNS

[jira] [Comment Edited] (HADOOP-7370) Optimize pread on ChecksumFileSystem

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640787#comment-17640787 ] Mukund Thakur edited comment on HADOOP-7370 at 11/29/22 3:40 PM: -

[jira] [Resolved] (HADOOP-7370) Optimize pread on ChecksumFileSystem

2022-11-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-7370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-7370. --- Resolution: Won't Fix Vectored IO superceedes this feature.  > Optimize pread on

[jira] [Commented] (HADOOP-18482) ITestS3APrefetchingInputStream does not skip if no CSV test file available

2022-10-19 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620619#comment-17620619 ] Mukund Thakur commented on HADOOP-18482: No this is not required for 3.3.5 as prefetching is

[jira] [Commented] (HADOOP-18460) ITestS3AContractVectoredRead.testStopVectoredIoOperationsUnbuffer failing

2022-09-29 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611265#comment-17611265 ] Mukund Thakur commented on HADOOP-18460: {code:java} /** * Get the s3 object for S3 server for

[jira] [Resolved] (HADOOP-18463) Add an integration test to process data asynchronously during vectored read.

2022-09-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18463. Fix Version/s: 3.3.5 Resolution: Fixed > Add an integration test to process data

[jira] [Resolved] (HADOOP-18347) Restrict vectoredIO threadpool to reduce memory pressure

2022-09-28 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18347. Fix Version/s: 3.3.5 Resolution: Fixed > Restrict vectoredIO threadpool to reduce

[jira] [Commented] (HADOOP-18470) Release hadoop 3.3.5

2022-09-27 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610146#comment-17610146 ] Mukund Thakur commented on HADOOP-18470: https://github.com/apache/hadoop/tree/branch-3.3.5 >

[jira] [Assigned] (HADOOP-18470) Release hadoop 3.3.5

2022-09-27 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-18470: -- Assignee: Mukund Thakur > Release hadoop 3.3.5 > > >

[jira] [Created] (HADOOP-18470) Release hadoop 3.3.5

2022-09-27 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18470: -- Summary: Release hadoop 3.3.5 Key: HADOOP-18470 URL: https://issues.apache.org/jira/browse/HADOOP-18470 Project: Hadoop Common Issue Type: New Feature

[jira] [Commented] (HADOOP-18460) ITestS3AContractVectoredRead.testStopVectoredIoOperationsUnbuffer failing

2022-09-23 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17608894#comment-17608894 ] Mukund Thakur commented on HADOOP-18460: Actually no not over there but here

[jira] [Created] (HADOOP-18463) Add an integration test process data asynchronously during vectored read.

2022-09-21 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18463: -- Summary: Add an integration test process data asynchronously during vectored read. Key: HADOOP-18463 URL: https://issues.apache.org/jira/browse/HADOOP-18463

[jira] [Resolved] (HADOOP-18455) s3a prefetching Executor should be closed

2022-09-21 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18455. Resolution: Fixed > s3a prefetching Executor should be closed >

[jira] [Commented] (HADOOP-18455) s3a prefetching Executor should be closed

2022-09-21 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607936#comment-17607936 ] Mukund Thakur commented on HADOOP-18455: merged into trunk as of now.  > s3a prefetching

[jira] [Commented] (HADOOP-18460) ITestS3AContractVectoredRead.testStopVectoredIoOperationsUnbuffer failing

2022-09-20 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607393#comment-17607393 ] Mukund Thakur commented on HADOOP-18460: I think adding checkIfVectoredIOStopped() at 

[jira] [Comment Edited] (HADOOP-18460) ITestS3AContractVectoredRead.testStopVectoredIoOperationsUnbuffer failing

2022-09-20 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607393#comment-17607393 ] Mukund Thakur edited comment on HADOOP-18460 at 9/20/22 8:40 PM: -

[jira] [Commented] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602464#comment-17602464 ] Mukund Thakur commented on HADOOP-18439: pushed to branch-3.3 > Fix VectoredIO for

[jira] [Resolved] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18439. Resolution: Fixed > Fix VectoredIO for LocalFileSystem when checksum is enabled. >

[jira] [Updated] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18439: --- Fix Version/s: 3.3.9 > Fix VectoredIO for LocalFileSystem when checksum is enabled. >

[jira] [Assigned] (HADOOP-18347) Restrict vectoredIO threadpool to reduce memory pressure

2022-09-09 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur reassigned HADOOP-18347: -- Assignee: Mukund Thakur > Restrict vectoredIO threadpool to reduce memory pressure

[jira] [Commented] (HADOOP-18447) Vectored IO: Threadpool should be closed on interrupts or during close calls

2022-09-08 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601976#comment-17601976 ] Mukund Thakur commented on HADOOP-18447: Currently the threadpool is shared unbounded one but

[jira] [Commented] (HADOOP-18435) Remove usage of fs.s3a.executor.capacity

2022-09-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600957#comment-17600957 ] Mukund Thakur commented on HADOOP-18435: Yes it will be used in future for Vectored IO stuff.

[jira] [Updated] (HADOOP-18439) Fix VectoredIO for LocalFileSystem when checksum is enabled.

2022-09-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18439: --- Summary: Fix VectoredIO for LocalFileSystem when checksum is enabled. (was: Fix

[jira] [Updated] (HADOOP-18439) Fix VectoredIO for LocalFileSystem for small files.

2022-09-06 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18439: --- Description: While merging the ranges in CheckSumFs, they are rounded up based on the

  1   2   3   4   >