[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836697#comment-17836697 ] Dongjoon Hyun commented on HADOOP-18296: Thank you for sharing the direction. > Memory

[jira] [Commented] (HADOOP-18296) Memory fragmentation in ChecksumFileSystem Vectored IO implementation.

[ https://issues.apache.org/jira/browse/HADOOP-18296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836017#comment-17836017 ] Dongjoon Hyun commented on HADOOP-18296: According to the description, is this a memory leak?

[jira] [Resolved] (HADOOP-19141) Update VectorIO default values consistently

[ https://issues.apache.org/jira/browse/HADOOP-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved HADOOP-19141. Fix Version/s: 3.3.7 3.4.1 Resolution: Fixed > Update VectorIO

[jira] [Assigned] (HADOOP-19141) Update VectorIO default values consistently

[ https://issues.apache.org/jira/browse/HADOOP-19141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned HADOOP-19141: -- Assignee: Dongjoon Hyun > Update VectorIO default values consistently >

[jira] [Created] (HADOOP-19141) Update VectorIO default values consistently

Dongjoon Hyun created HADOOP-19141: -- Summary: Update VectorIO default values consistently Key: HADOOP-19141 URL: https://issues.apache.org/jira/browse/HADOOP-19141 Project: Hadoop Common

[jira] [Commented] (HADOOP-18830) S3A: Cut S3 Select

[ https://issues.apache.org/jira/browse/HADOOP-18830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833281#comment-17833281 ] Dongjoon Hyun commented on HADOOP-18830: Hi, can we remove `3.4.1` from the `Fixed Version`

[jira] [Commented] (HADOOP-19108) S3 Express: document use

[ https://issues.apache.org/jira/browse/HADOOP-19108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17825788#comment-17825788 ] Dongjoon Hyun commented on HADOOP-19108: Is this targeting Apache Hadoop 3.4.1? > S3 Express:

[jira] [Commented] (HADOOP-18765) Release 3.3.6

[ https://issues.apache.org/jira/browse/HADOOP-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735120#comment-17735120 ] Dongjoon Hyun commented on HADOOP-18765: Yes, you are right, [~weichiu]. In the community, we

[jira] [Created] (HADOOP-18727) Fix WriteOperations.listMultipartUploads function description

Dongjoon Hyun created HADOOP-18727: -- Summary: Fix WriteOperations.listMultipartUploads function description Key: HADOOP-18727 URL: https://issues.apache.org/jira/browse/HADOOP-18727 Project: Hadoop

[jira] [Updated] (HADOOP-18718) Fix several maven build warnings

[ https://issues.apache.org/jira/browse/HADOOP-18718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-18718: --- Description: {code} [WARNING] 'build.plugins.plugin.version' for

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716522#comment-17716522 ] Dongjoon Hyun commented on HADOOP-18590: I created HADOOP-18718 and made a PR to fix several

[jira] [Updated] (HADOOP-18718) Fix several maven build warnings

[ https://issues.apache.org/jira/browse/HADOOP-18718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-18718: --- Description: {code} [WARNING] 'build.plugins.plugin.version' for

[jira] [Updated] (HADOOP-18718) Fix several maven build warnings

[ https://issues.apache.org/jira/browse/HADOOP-18718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-18718: --- Description: {code} [WARNING] 'build.plugins.plugin.version' for

[jira] [Created] (HADOOP-18718) Fix several maven build warnings

Dongjoon Hyun created HADOOP-18718: -- Summary: Fix several maven build warnings Key: HADOOP-18718 URL: https://issues.apache.org/jira/browse/HADOOP-18718 Project: Hadoop Common Issue Type:

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716482#comment-17716482 ] Dongjoon Hyun commented on HADOOP-18590: Sure, [~ayushtkn] > Publish SBOM artifacts >

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716355#comment-17716355 ] Dongjoon Hyun commented on HADOOP-18590: Thank you for reporting. It seems that I missed

[jira] [Created] (HADOOP-18590) Publish SBOM artifacts

Dongjoon Hyun created HADOOP-18590: -- Summary: Publish SBOM artifacts Key: HADOOP-18590 URL: https://issues.apache.org/jira/browse/HADOOP-18590 Project: Hadoop Common Issue Type: Improvement

[jira] [Comment Edited] (HADOOP-18173) S3a copyFromLocalOperation doesn't support single file

[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523878#comment-17523878 ] Dongjoon Hyun edited comment on HADOOP-18173 at 4/18/22 7:57 PM: - Yes,

[jira] [Commented] (HADOOP-18173) S3a copyFromLocalOperation doesn't support single file

[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523878#comment-17523878 ] Dongjoon Hyun commented on HADOOP-18173: Yes, it was a API behavior regression which broke the

[jira] [Commented] (HADOOP-18173) S3a copyFromLocalOperation doesn't support single file

[ https://issues.apache.org/jira/browse/HADOOP-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514433#comment-17514433 ] Dongjoon Hyun commented on HADOOP-18173: This seems to be a regression of HADOOP-17139 > S3a

[jira] [Commented] (HADOOP-17939) Support building on Apple Silicon

[ https://issues.apache.org/jira/browse/HADOOP-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489824#comment-17489824 ] Dongjoon Hyun commented on HADOOP-17939: Thank you so much, [~ste...@apache.org]. > Support

[jira] [Commented] (HADOOP-18064) replace URL.toString() with URL.toURI().toString()

[ https://issues.apache.org/jira/browse/HADOOP-18064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468816#comment-17468816 ] Dongjoon Hyun commented on HADOOP-18064: Thank you for clarification, [~ste...@apache.org]. >

[jira] [Commented] (HADOOP-17922) Lookup old S3 encryption configs for JCEKS

[ https://issues.apache.org/jira/browse/HADOOP-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425306#comment-17425306 ] Dongjoon Hyun commented on HADOOP-17922: This seems to land at branch-3.3. Could you update the

[jira] [Commented] (HADOOP-17817) HADOOP-17817. S3A to raise IOE if both S3-CSE and S3Guard enabled

[ https://issues.apache.org/jira/browse/HADOOP-17817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425304#comment-17425304 ] Dongjoon Hyun commented on HADOOP-17817: This landed at branch-3.3. Could you update the Fix

[jira] [Commented] (HADOOP-17871) S3A CSE: minor tuning

[ https://issues.apache.org/jira/browse/HADOOP-17871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425305#comment-17425305 ] Dongjoon Hyun commented on HADOOP-17871: This landed at branch-3.3. Do we need to revise the

[jira] [Comment Edited] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425303#comment-17425303 ] Dongjoon Hyun edited comment on HADOOP-13887 at 10/7/21, 1:35 AM: --

[jira] [Commented] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425303#comment-17425303 ] Dongjoon Hyun commented on HADOOP-13887: This seems to land at branch-3.2. Could you update the

[jira] [Commented] (HADOOP-17934) NullPointerException when no HTTP response set on AbfsRestOperation

[ https://issues.apache.org/jira/browse/HADOOP-17934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425302#comment-17425302 ] Dongjoon Hyun commented on HADOOP-17934: Hi, [~elserj]. Maybe, `Fix Version` is `3.3.2`? >

[jira] [Updated] (HADOOP-17939) Support building on Apple Silicon

[ https://issues.apache.org/jira/browse/HADOOP-17939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17939: --- Status: Patch Available (was: Open) > Support building on Apple Silicon >

[jira] [Created] (HADOOP-17939) Support building on Apple Silicon

Dongjoon Hyun created HADOOP-17939: -- Summary: Support building on Apple Silicon Key: HADOOP-17939 URL: https://issues.apache.org/jira/browse/HADOOP-17939 Project: Hadoop Common Issue Type:

[jira] [Assigned] (HADOOP-16761) KMSClientProvider does not work with client using ticket logged in externally

[ https://issues.apache.org/jira/browse/HADOOP-16761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned HADOOP-16761: -- Assignee: Dongjoon Hyun (was: Xiaoyu Yao) > KMSClientProvider does not work with

[jira] [Updated] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

[ https://issues.apache.org/jira/browse/HADOOP-17869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17869: --- Affects Version/s: 3.3.0 > fs.s3a.connection.maximum should be bigger than

[jira] [Created] (HADOOP-17869) fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max

Dongjoon Hyun created HADOOP-17869: -- Summary: fs.s3a.connection.maximum should be bigger than fs.s3a.threads.max Key: HADOOP-17869 URL: https://issues.apache.org/jira/browse/HADOOP-17869 Project:

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373348#comment-17373348 ] Dongjoon Hyun commented on HADOOP-17755: Thank you for the details! > EOF reached error

[jira] [Comment Edited] (HADOOP-17755) EOF reached error reading ORC file on S3A

[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373239#comment-17373239 ] Dongjoon Hyun edited comment on HADOOP-17755 at 7/2/21, 5:39 AM: - Could

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373239#comment-17373239 ] Dongjoon Hyun commented on HADOOP-17755: Could you share the other Hadoop related configuration

[jira] [Commented] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

[ https://issues.apache.org/jira/browse/HADOOP-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238930#comment-17238930 ] Dongjoon Hyun commented on HADOOP-16080: Hi, All. Is there any update on this JIRA? Otherwise,

[jira] [Updated] (HADOOP-16080) hadoop-aws does not work with hadoop-client-api

[ https://issues.apache.org/jira/browse/HADOOP-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-16080: --- Affects Version/s: 3.2.0 > hadoop-aws does not work with hadoop-client-api >

[jira] [Created] (HADOOP-17370) Upgrade commons-compress to 1.20

Dongjoon Hyun created HADOOP-17370: -- Summary: Upgrade commons-compress to 1.20 Key: HADOOP-17370 URL: https://issues.apache.org/jira/browse/HADOOP-17370 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved HADOOP-17343. Resolution: Later > Upgrade aws-java-sdk to 1.11.892 >

[jira] [Assigned] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned HADOOP-17343: -- Assignee: (was: Dongjoon Hyun) > Upgrade aws-java-sdk to 1.11.892 >

[jira] [Updated] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

[ https://issues.apache.org/jira/browse/HADOOP-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17343: --- Affects Version/s: 3.4.0 > Upgrade aws-java-sdk to 1.11.892 >

[jira] [Created] (HADOOP-17343) Upgrade aws-java-sdk to 1.11.892

Dongjoon Hyun created HADOOP-17343: -- Summary: Upgrade aws-java-sdk to 1.11.892 Key: HADOOP-17343 URL: https://issues.apache.org/jira/browse/HADOOP-17343 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-17341) Upgrade commons-codec to 1.15

[ https://issues.apache.org/jira/browse/HADOOP-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17341: --- Description: This issue aims to upgrade commons-codec to 1.15 to bring the latest bug

[jira] [Created] (HADOOP-17341) Upgrade commons-codec to 1.15

Dongjoon Hyun created HADOOP-17341: -- Summary: Upgrade commons-codec to 1.15 Key: HADOOP-17341 URL: https://issues.apache.org/jira/browse/HADOOP-17341 Project: Hadoop Common Issue Type: Bug

[jira] [Commented] (HADOOP-13203) S3A: Support fadvise "random" mode for high performance readPositioned() reads

[ https://issues.apache.org/jira/browse/HADOOP-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219273#comment-17219273 ] Dongjoon Hyun commented on HADOOP-13203: Hi, [~ste...@apache.org].

[jira] [Updated] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17258: --- Description: In `trunk/branch-3.3/branch-3.2`, `MagicS3GuardCommitter.innerCommitTask` has

[jira] [Comment Edited] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196540#comment-17196540 ] Dongjoon Hyun edited comment on HADOOP-17258 at 9/15/20, 8:27 PM: -- The

[jira] [Commented] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196540#comment-17196540 ] Dongjoon Hyun commented on HADOOP-17258: The return value is `PendingSet` instead of `boolean`,

[jira] [Commented] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195853#comment-17195853 ] Dongjoon Hyun commented on HADOOP-17258: Also, cc [~chaosun] > MagicS3GuardCommitter fails

[jira] [Commented] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195850#comment-17195850 ] Dongjoon Hyun commented on HADOOP-17258: Thank you for commenting, [~ste...@apache.org]. Yes,

[jira] [Updated] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17258: --- Description: In `trunk/branch-3.3/branch-3.2`, `MagicS3GuardCommitter.innerCommitTask` has

[jira] [Updated] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17258: --- Description: `MagicS3GuardCommitter.innerCommitTask` has `false` at `pendingSet.save`.

[jira] [Updated] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated HADOOP-17258: --- Description: `MagicS3GuardCommitter.innerCommitTask` has `false` at `pendingSet.save`.

[jira] [Commented] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

[ https://issues.apache.org/jira/browse/HADOOP-17258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194052#comment-17194052 ] Dongjoon Hyun commented on HADOOP-17258: This happens frequently in a situation where some

[jira] [Created] (HADOOP-17258) MagicS3GuardCommitter fails with `pendingset` already exists

Dongjoon Hyun created HADOOP-17258: -- Summary: MagicS3GuardCommitter fails with `pendingset` already exists Key: HADOOP-17258 URL: https://issues.apache.org/jira/browse/HADOOP-17258 Project: Hadoop