[jira] [Updated] (HADOOP-19019) Parallel Maven Build Support for Apache Hadoop

2024-01-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-19019: - Fix Version/s: 3.5.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Res

[jira] [Assigned] (HADOOP-19019) Parallel Maven Build Support for Apache Hadoop

2024-01-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HADOOP-19019: Assignee: caijialiang > Parallel Maven Build Support for Apache Hadoop > ---

[jira] [Commented] (HADOOP-19019) Parallel Maven Build Support for Apache Hadoop

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809761#comment-17809761 ] ASF GitHub Bot commented on HADOOP-19019: - Hexiaoqiao commented on PR #6373: UR

[jira] [Commented] (HADOOP-19019) Parallel Maven Build Support for Apache Hadoop

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809760#comment-17809760 ] ASF GitHub Bot commented on HADOOP-19019: - Hexiaoqiao merged PR #6373: URL: htt

Re: [PR] HADOOP-19019: Parallel Maven Build Support for Apache Hadoop [hadoop]

2024-01-22 Thread via GitHub
Hexiaoqiao commented on PR #6373: URL: https://github.com/apache/hadoop/pull/6373#issuecomment-1905390687 Committed to trunk. Thanks @JiaLiangC and @steveloughran . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] HADOOP-19019: Parallel Maven Build Support for Apache Hadoop [hadoop]

2024-01-22 Thread via GitHub
Hexiaoqiao merged PR #6373: URL: https://github.com/apache/hadoop/pull/6373 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Commented] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809757#comment-17809757 ] ASF GitHub Bot commented on HADOOP-18883: - hadoop-yetus commented on PR #6484:

Re: [PR] HADOOP-18883. [ABFS]: Expect-100 JDK bug resolution: prevent multiple… [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6484: URL: https://github.com/apache/hadoop/pull/6484#issuecomment-1905377092 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] YARN-11644. LogAggregationService can't upload log in time when application finished [hadoop]

2024-01-22 Thread via GitHub
laysfire commented on PR #6452: URL: https://github.com/apache/hadoop/pull/6452#issuecomment-1905371148 @goiri @slfan1989 Would you mind help review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809753#comment-17809753 ] ASF GitHub Bot commented on HADOOP-18910: - hadoop-yetus commented on PR #6069:

Re: [PR] HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1905370470 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809745#comment-17809745 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on PR #6069:

Re: [PR] HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport [hadoop]

2024-01-22 Thread via GitHub
anujmodi2021 commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1905329385 AGGREGATED TEST RESULT HNS-OAuth [INFO] Results: [INFO] [WARNING] Tests run: 141, Failures: 0, Errors:

[jira] [Commented] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809738#comment-17809738 ] ASF GitHub Bot commented on HADOOP-18883: - saxenapranav commented on PR #6484:

Re: [PR] HADOOP-18883. [ABFS]: Expect-100 JDK bug resolution: prevent multiple… [hadoop]

2024-01-22 Thread via GitHub
saxenapranav commented on PR #6484: URL: https://github.com/apache/hadoop/pull/6484#issuecomment-1905307832 @steveloughran , requesting you to kindly review the backport PR please. Thank you so much. -- This is an automated message from the Apache Git Service. To respond to the message, p

[jira] [Commented] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809737#comment-17809737 ] ASF GitHub Bot commented on HADOOP-18883: - saxenapranav commented on PR #6022:

Re: [PR] HADOOP-18883. [ABFS]: Expect-100 JDK bug resolution: prevent multiple server calls [hadoop]

2024-01-22 Thread via GitHub
saxenapranav commented on PR #6022: URL: https://github.com/apache/hadoop/pull/6022#issuecomment-1905307123 Thank you so much @steveloughran for the review. Have raised a backport pr on branch-3.3: https://github.com/apache/hadoop/pull/6484. Thank you so much. -- This is an automated mes

[jira] [Commented] (HADOOP-18883) Expect-100 JDK bug resolution: prevent multiple server calls

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809736#comment-17809736 ] ASF GitHub Bot commented on HADOOP-18883: - saxenapranav commented on PR #6484:

Re: [PR] HADOOP-18883. [ABFS]: Expect-100 JDK bug resolution: prevent multiple… [hadoop]

2024-01-22 Thread via GitHub
saxenapranav commented on PR #6484: URL: https://github.com/apache/hadoop/pull/6484#issuecomment-1905305685 AGGREGATED TEST RESULT HNS-OAuth [INFO] Results: [INFO] [ERROR] Failures: [ERROR] TestAccountConf

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809734#comment-17809734 ] ASF GitHub Bot commented on HADOOP-19044: - hadoop-yetus commented on PR #6479:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1905274920 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Updated] (HADOOP-18023) Allow cp command to run with multi threads.

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18023: Affects Version/s: 3.3.2 3.2.3 3.4.0 > Allow cp com

[jira] [Updated] (HADOOP-18040) Use maven.test.failure.ignore instead of ignoreTestFailure

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18040: Affects Version/s: 3.24 3.3.2 2.10.2

[jira] [Updated] (HADOOP-18045) Disable TestDynamometerInfra

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18045: Affects Version/s: 3.3.2 3.4.0 > Disable TestDynamometerInfra > --

[jira] [Updated] (HADOOP-18052) Support Apple Silicon in start-build-env.sh

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18052: Affects Version/s: 3.3.2 3.4.0 > Support Apple Silicon in start-build-env.

[jira] [Updated] (HADOOP-18144) getTrashRoot/s in ViewFileSystem should return viewFS path, not targetFS path

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18144: Affects Version/s: 3.3.5 2.10.2 3.4.0 > getTrashRoo

[jira] [Updated] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18169: Component/s: fs > getDelegationTokens in ViewFs should also fetch the token from the fallback FS

[jira] [Updated] (HADOOP-18169) getDelegationTokens in ViewFs should also fetch the token from the fallback FS

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18169: Affects Version/s: 3.3.5 2.10.2 3.4.0 > getDelegati

[jira] [Updated] (HADOOP-18172) Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18172: Component/s: fs > Change scope of getRootFallbackLink for InodeTree to make them accessible > fr

[jira] [Updated] (HADOOP-18172) Change scope of getRootFallbackLink for InodeTree to make them accessible from outside package

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18172: Affects Version/s: 3.3.5 2.10.2 3.4.0 > Change scop

[jira] [Updated] (HADOOP-18191) Log retry count while handling exceptions in RetryInvocationHandler

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18191: Component/s: common io > Log retry count while handling exceptions in RetryInvoc

[jira] [Updated] (HADOOP-18191) Log retry count while handling exceptions in RetryInvocationHandler

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18191: Affects Version/s: 3.3.5 3.2.4 2.10.2

[jira] [Updated] (HADOOP-18288) Total requests and total requests per sec served by RPC servers

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18288: Component/s: rpc-server > Total requests and total requests per sec served by RPC servers > -

[jira] [Updated] (HADOOP-18300) Update google-gson to 2.9.0

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18300: Affects Version/s: 3.3.5 3.4.0 > Update google-gson to 2.9.0 > ---

[jira] [Updated] (HADOOP-18288) Total requests and total requests per sec served by RPC servers

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18288: Affects Version/s: 3.3.5 3.4.0 > Total requests and total requests per sec

[jira] [Updated] (HADOOP-18301) Upgrade commons-io to 2.11.0

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18301: Component/s: common > Upgrade commons-io to 2.11.0 > > >

[jira] [Updated] (HADOOP-18390) Fix out of sync import for HADOOP-18321

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18390: Component/s: common > Fix out of sync import for HADOOP-18321 > -

[jira] [Updated] (HADOOP-18397) Shutdown AWSSecurityTokenService when its resources are no longer in use

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18397: Affects Version/s: 3.3.5 3.4.0 > Shutdown AWSSecurityTokenService when its

[jira] [Updated] (HADOOP-18390) Fix out of sync import for HADOOP-18321

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18390: Affects Version/s: 3.3.5 3.4.0 > Fix out of sync import for HADOOP-18321 >

[jira] [Updated] (HADOOP-18400) Fix file split duplicating records from a succeeding split when reading BZip2 text files

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18400: Component/s: common > Fix file split duplicating records from a succeeding split when reading >

[jira] [Updated] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18444: Affects Version/s: 3.3.5 3.4.0 > Add Support for localized trash for ViewF

[jira] [Updated] (HADOOP-18444) Add Support for localized trash for ViewFileSystem in Trash.moveToAppropriateTrash

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18444: Component/s: fs > Add Support for localized trash for ViewFileSystem in > Trash.moveToAppropriat

[jira] [Updated] (HADOOP-18493) update jackson-databind 2.12.7.1 due to CVE fixes

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18493: Component/s: common > update jackson-databind 2.12.7.1 due to CVE fixes > ---

[jira] [Updated] (HADOOP-18493) update jackson-databind 2.12.7.1 due to CVE fixes

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18493: Affects Version/s: 3.3.5 3.4.0 > update jackson-databind 2.12.7.1 due to C

[jira] [Updated] (HADOOP-18620) Avoid using grizzly-http-* APIs

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18620: Component/s: common > Avoid using grizzly-http-* APIs > --- > >

[jira] [Updated] (HADOOP-18595) Fix "the the" and friends typos

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18595: Labels: pull-request-available (was: ) > Fix "the the" and friends typos > -

[jira] [Updated] (HADOOP-18592) Sasl connection failure should log remote address

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18592: Component/s: ipc > Sasl connection failure should log remote address > --

[jira] [Updated] (HADOOP-18620) Avoid using grizzly-http-* APIs

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18620: Affects Version/s: 3.3.6 3.4.0 > Avoid using grizzly-http-* APIs > ---

[jira] [Updated] (HADOOP-18714) Wrong StringUtils.join() called in AbstractContractRootDirectoryTest

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18714: Affects Version/s: 3.3.6 3.4.0 > Wrong StringUtils.join() called in Abstra

Re: [PR] HDFS-17346. Fix DirectoryScanner check mark the normal blocks as corrupt [hadoop]

2024-01-22 Thread via GitHub
haiyang1987 commented on PR #6476: URL: https://github.com/apache/hadoop/pull/6476#issuecomment-1905179233 Hi @Hexiaoqiao @tasanuma @zhangshuyan0 Can you also help review this PR when you are free time? Thanks. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-01-22 Thread via GitHub
haiyang1987 commented on PR #6464: URL: https://github.com/apache/hadoop/pull/6464#issuecomment-1905175821 > > Agree with you, it's better to use parameter to control corrupt block deletion. > > Thanks @smarthanwang for your response. @haiyang1987 Can you create a new ticket to suppo

[jira] [Comment Edited] (HADOOP-18718) Fix several maven build warnings

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808985#comment-17808985 ] Shilun Fan edited comment on HADOOP-18718 at 1/23/24 2:15 AM: ---

[jira] [Comment Edited] (HADOOP-18714) Wrong StringUtils.join() called in AbstractContractRootDirectoryTest

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808988#comment-17808988 ] Shilun Fan edited comment on HADOOP-18714 at 1/23/24 2:15 AM: ---

[jira] [Updated] (HADOOP-18714) Wrong StringUtils.join() called in AbstractContractRootDirectoryTest

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18714: Fix Version/s: 3.4.0 > Wrong StringUtils.join() called in AbstractContractRootDirectoryTest > ---

[jira] [Updated] (HADOOP-18718) Fix several maven build warnings

2024-01-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated HADOOP-18718: Fix Version/s: 3.4.0 > Fix several maven build warnings > > >

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809707#comment-17809707 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani commented on code in PR

Re: [PR] HADOOP-18980. S3A credential provider remapping: make extensible [hadoop]

2024-01-22 Thread via GitHub
virajjasani commented on PR #6406: URL: https://github.com/apache/hadoop/pull/6406#issuecomment-1905169078 @mukund-thakur could you please review this PR if you have bandwidth? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
virajjasani commented on code in PR #6479: URL: https://github.com/apache/hadoop/pull/6479#discussion_r1462646400 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java: ## @@ -1327,7 +1327,7 @@ private Constants() { * The special S3 region which ca

[jira] [Commented] (HADOOP-19024) change to bouncy castle jdk1.8 jars

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809705#comment-17809705 ] ASF GitHub Bot commented on HADOOP-19024: - slfan1989 commented on PR #6410: URL

Re: [PR] HADOOP-19024. Use bouncycastle jdk18 1.77 [hadoop]

2024-01-22 Thread via GitHub
slfan1989 commented on PR #6410: URL: https://github.com/apache/hadoop/pull/6410#issuecomment-1905157788 @pjfanning Is this a necessary fix for hadoop-3.4.0? If not, we can fix it in the next version(hadoop-3.4.1). -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] HDFS-17342. Fix DataNode may invalidates normal block causing missing block [hadoop]

2024-01-22 Thread via GitHub
ZanderXu commented on PR #6464: URL: https://github.com/apache/hadoop/pull/6464#issuecomment-1905151692 > Agree with you, it's better to use parameter to control corrupt block deletion. Thanks @smarthanwang for your response. @haiyang1987 Can you create a new ticket to support it?

[jira] [Commented] (HADOOP-18682) Move hadoop docker scripts under the main source code

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809684#comment-17809684 ] ASF GitHub Bot commented on HADOOP-18682: - hadoop-yetus commented on PR #6483:

Re: [PR] HADOOP-18682. Move hadoop docker scripts under the main source code [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6483: URL: https://github.com/apache/hadoop/pull/6483#issuecomment-1905040163 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809682#comment-17809682 ] ASF GitHub Bot commented on HADOOP-19044: - hadoop-yetus commented on PR #6479:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1905026871 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809673#comment-17809673 ] ASF GitHub Bot commented on HADOOP-19044: - mukund-thakur commented on code in P

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
mukund-thakur commented on code in PR #6479: URL: https://github.com/apache/hadoop/pull/6479#discussion_r1462527668 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java: ## @@ -1327,7 +1327,7 @@ private Constants() { * The special S3 region which

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809671#comment-17809671 ] ASF GitHub Bot commented on HADOOP-19044: - hadoop-yetus commented on PR #6479:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1904975466 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809668#comment-17809668 ] ASF GitHub Bot commented on HADOOP-19044: - hadoop-yetus commented on PR #6479:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1904962026 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809667#comment-17809667 ] ASF GitHub Bot commented on HADOOP-19015: - hadoop-yetus commented on PR #6487:

Re: [PR] HADOOP-19015. Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool. #6372 [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6487: URL: https://github.com/apache/hadoop/pull/6487#issuecomment-1904958114 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6407: URL: https://github.com/apache/hadoop/pull/6407#issuecomment-1904870927 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809654#comment-17809654 ] ASF GitHub Bot commented on HADOOP-14837: - hadoop-yetus commented on PR #6407:

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809655#comment-17809655 ] ASF GitHub Bot commented on HADOOP-14837: - hadoop-yetus commented on PR #6407:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6407: URL: https://github.com/apache/hadoop/pull/6407#issuecomment-1904868824 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809652#comment-17809652 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani commented on code in PR

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
virajjasani commented on code in PR #6479: URL: https://github.com/apache/hadoop/pull/6479#discussion_r1462447503 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/DefaultS3ClientFactory.java: ## @@ -294,9 +295,14 @@ private , ClientT> void builder.endpoin

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809643#comment-17809643 ] ASF GitHub Bot commented on HADOOP-19044: - mukund-thakur commented on PR #6479:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
mukund-thakur commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1904820855 > also I'd like @ahmarsuhail to review this as when it comes to region stuff and v2 sdk I'm still permanently confused about the corner cases. Could make it a job interview quest

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
mukund-thakur commented on code in PR #6479: URL: https://github.com/apache/hadoop/pull/6479#discussion_r1462409406 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/DefaultS3ClientFactory.java: ## @@ -354,20 +360,21 @@ private static URI getS3Endpoint(String end

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809641#comment-17809641 ] ASF GitHub Bot commented on HADOOP-19044: - mukund-thakur commented on code in P

[jira] [Commented] (HADOOP-18975) AWS SDK v2: extend support for FIPS endpoints

2024-01-22 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809636#comment-17809636 ] Viraj Jasani commented on HADOOP-18975: --- {quote}you must have set a global endpoi

Re: [PR] HDFS-17348. Enhance Log when checkLocations in RecoveryTaskStriped. [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6485: URL: https://github.com/apache/hadoop/pull/6485#issuecomment-1904744427 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809632#comment-17809632 ] ASF GitHub Bot commented on HADOOP-19044: - virajjasani commented on code in PR

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
virajjasani commented on code in PR #6479: URL: https://github.com/apache/hadoop/pull/6479#discussion_r1462371508 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3ACrossRegionAccess.java: ## @@ -0,0 +1,64 @@ +/* + * Licensed to the Apache Software Foundat

[jira] [Commented] (HADOOP-18610) ABFS OAuth2 Token Provider to support Azure Workload Identity for AKS

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809630#comment-17809630 ] ASF GitHub Bot commented on HADOOP-18610: - hadoop-yetus commented on PR #5953:

Re: [PR] HADOOP-18610. ABFS OAuth2 Token Provider support for Azure Workload Identity [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #5953: URL: https://github.com/apache/hadoop/pull/5953#issuecomment-1904738579 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19037) S3A: S3A: ITestS3AConfiguration failing with region problems

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809623#comment-17809623 ] ASF GitHub Bot commented on HADOOP-19037: - hadoop-yetus commented on PR #6486:

Re: [PR] HADOOP-19037. AWS SDK v2: ITestS3AConfiguration failing with region problems [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6486: URL: https://github.com/apache/hadoop/pull/6486#issuecomment-1904712966 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19044) AWS SDK V2 - Update S3A region logic

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809617#comment-17809617 ] ASF GitHub Bot commented on HADOOP-19044: - hadoop-yetus commented on PR #6479:

Re: [PR] HADOOP-19044. AWS SDK V2 - Update S3A region logic [hadoop]

2024-01-22 Thread via GitHub
hadoop-yetus commented on PR #6479: URL: https://github.com/apache/hadoop/pull/6479#issuecomment-1904681536 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809608#comment-17809608 ] ASF GitHub Bot commented on HADOOP-19015: - mukund-thakur commented on PR #6487:

Re: [PR] HADOOP-19015. Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool. #6372 [hadoop]

2024-01-22 Thread via GitHub
mukund-thakur commented on PR #6487: URL: https://github.com/apache/hadoop/pull/6487#issuecomment-1904640131 Should we merge this in branch-3.3 given we are seeing these issues more after V2 SDK? @steveloughran @ahmarsuhail -- This is an automated message from the Apache Git Service. To

[jira] [Commented] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2024-01-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809607#comment-17809607 ] ASF GitHub Bot commented on HADOOP-19015: - mukund-thakur opened a new pull requ

[PR] HADOOP-19015. Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool. #6372 [hadoop]

2024-01-22 Thread via GitHub
mukund-thakur opened a new pull request, #6487: URL: https://github.com/apache/hadoop/pull/6487 Just a backport to branch-3.3 because of merged conflicts. Let Yetus run the tests. ### Description of PR ### How was this patch tested? ### For code changes:

[jira] [Updated] (HADOOP-18975) AWS SDK v2: extend support for FIPS endpoints

2024-01-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18975: Fix Version/s: 3.5.0 3.4.1 > AWS SDK v2: extend support for FIPS endp

[jira] [Updated] (HADOOP-19033) S3A: disable checksum validation

2024-01-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19033: Fix Version/s: 3.4.1 > S3A: disable checksum validation > ---

[jira] [Resolved] (HADOOP-19015) Increase fs.s3a.connection.maximum to 500 to minimize risk of Timeout waiting for connection from pool

2024-01-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19015. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed > Increase fs.s3

  1   2   >