[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-04 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719636#comment-17719636 ] Viraj Jasani commented on HADOOP-18688: --- Thanks! PR is ready for review

[jira] [Updated] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18688: Labels: pull-request-available (was: ) > s3a audit info to include #of items in a

[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719635#comment-17719635 ] ASF GitHub Bot commented on HADOOP-18688: - virajjasani commented on PR #5621: URL:

[GitHub] [hadoop] virajjasani commented on pull request #5621: HADOOP-18688. S3A audit info to include num of items in delete ops

2023-05-04 Thread via GitHub
virajjasani commented on PR #5621: URL: https://github.com/apache/hadoop/pull/5621#issuecomment-1535711181 `us-west-2` ``` mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale -Dprefetch ``` --

[jira] [Commented] (HADOOP-18732) Exclude Jettison from jersery-json artifact in hadoop-yarn-common's pom.xml

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719625#comment-17719625 ] ASF GitHub Bot commented on HADOOP-18732: - devaspatikrishnatri opened a new pull request,

[jira] [Commented] (HADOOP-18732) Exclude Jettison from jersery-json artifact in hadoop-yarn-common's pom.xml

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719626#comment-17719626 ] ASF GitHub Bot commented on HADOOP-18732: - devaspatikrishnatri commented on PR #5623: URL:

[jira] [Updated] (HADOOP-18732) Exclude Jettison from jersery-json artifact in hadoop-yarn-common's pom.xml

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18732: Labels: pull-request-available (was: ) > Exclude Jettison from jersery-json artifact in

[GitHub] [hadoop] devaspatikrishnatri commented on pull request #5623: HADOOP-18732:Exclude jettison from jersery-json artifact as on older …

2023-05-04 Thread via GitHub
devaspatikrishnatri commented on PR #5623: URL: https://github.com/apache/hadoop/pull/5623#issuecomment-1535690226 @szilard-nemeth Could you please see this is it is okay? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] devaspatikrishnatri opened a new pull request, #5623: HADOOP-18732:Exclude jettison from jersery-json artifact as on older …

2023-05-04 Thread via GitHub
devaspatikrishnatri opened a new pull request, #5623: URL: https://github.com/apache/hadoop/pull/5623 …version is being pulled ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with

[jira] [Created] (HADOOP-18732) Exclude Jettison from jersery-json artifact in hadoop-yarn-common's pom.xml

2023-05-04 Thread Devaspati Krishnatri (Jira)
Devaspati Krishnatri created HADOOP-18732: - Summary: Exclude Jettison from jersery-json artifact in hadoop-yarn-common's pom.xml Key: HADOOP-18732 URL: https://issues.apache.org/jira/browse/HADOOP-18732

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5583: HDFS-16987. [BugFix] MarkBlockAsCorrupt should not mark a replica as corrupted if the DN has a newest replica

2023-05-04 Thread via GitHub
Hexiaoqiao commented on PR #5583: URL: https://github.com/apache/hadoop/pull/5583#issuecomment-1535684657 @ZanderXu thanks for your detailed comments. IIUC, the replica's GS is monotonically increasing at DataNode side, right? If that I think we could improve it rely on the basic rule at

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5622: HDFS-16999. Fix wrong use of processFirstBlockReport().

2023-05-04 Thread via GitHub
Hexiaoqiao commented on PR #5622: URL: https://github.com/apache/hadoop/pull/5622#issuecomment-1535670070 @zhangshuyan0 Thanks for your proposal and try to fix this issue. Just glance the PR, it propose to switch `processFirstBlockReport` to `processReport` when restart DataNode only,

[GitHub] [hadoop] ZanderXu commented on pull request #5583: HDFS-16987. [BugFix] MarkBlockAsCorrupt should not mark a replica as corrupted if the DN has a newest replica

2023-05-04 Thread via GitHub
ZanderXu commented on PR #5583: URL: https://github.com/apache/hadoop/pull/5583#issuecomment-1535657249 @Hexiaoqiao @ayushtkn Master, after deep thinking, maybe we can only fix this problem when processAllPendingDNMessages, because namenode doesn't know whether this report is consistent

[GitHub] [hadoop] hadoop-yetus commented on pull request #5591: HDFS-16991. fix testMkdirsRaceWithObserverRead

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5591: URL: https://github.com/apache/hadoop/pull/5591#issuecomment-1535655249 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] zhangshuyan0 opened a new pull request, #5622: HDFS-16999. Fix wrong use of processFirstBlockReport().

2023-05-04 Thread via GitHub
zhangshuyan0 opened a new pull request, #5622: URL: https://github.com/apache/hadoop/pull/5622 ### Description of PR `processFirstBlockReport()` is used to process first block report from datanode. It does not calculating `toRemove` list because it believes that there is no metadata

[GitHub] [hadoop] szilard-nemeth closed pull request #5380: YARN-11079. Make an AbstractParentQueue to store common ParentQueue and ManagedParentQueue functionality

2023-05-04 Thread via GitHub
szilard-nemeth closed pull request #5380: YARN-11079. Make an AbstractParentQueue to store common ParentQueue and ManagedParentQueue functionality URL: https://github.com/apache/hadoop/pull/5380 -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] szilard-nemeth commented on pull request #5380: YARN-11079. Make an AbstractParentQueue to store common ParentQueue and ManagedParentQueue functionality

2023-05-04 Thread via GitHub
szilard-nemeth commented on PR #5380: URL: https://github.com/apache/hadoop/pull/5380#issuecomment-1535613449 Thanks @susheel-gupta for the explanation, Makes sense. Latest patch LGTM, committed to trunk. -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HADOOP-18723) Add detail logs if distcp checksum mismatch

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719588#comment-17719588 ] ASF GitHub Bot commented on HADOOP-18723: - symious commented on code in PR #5603: URL:

[GitHub] [hadoop] symious commented on a diff in pull request #5603: HADOOP-18723. Add detail logs if distcp checksum mismatch

2023-05-04 Thread via GitHub
symious commented on code in PR #5603: URL: https://github.com/apache/hadoop/pull/5603#discussion_r1185646826 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java: ## @@ -596,6 +596,8 @@ public static CopyMapper.ChecksumComparison

[jira] [Assigned] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-04 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-18688: - Assignee: Viraj Jasani > s3a audit info to include #of items in a DeleteObjects

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719566#comment-17719566 ] ASF GitHub Bot commented on HADOOP-18671: - jojochuang opened a new pull request, #5620: URL:

[GitHub] [hadoop] jojochuang opened a new pull request, #5620: HADOOP-18671. Add recoverLease(), setSafeMode(), isFileClosed() as interfaces to hadoop-common (#5553)

2023-05-04 Thread via GitHub
jojochuang opened a new pull request, #5620: URL: https://github.com/apache/hadoop/pull/5620 The HDFS lease APIs have been replicated as interfaces in hadoop-common so other filesystems can also implement them. Applications which use the leasing APIs should migrate to the new interface

[jira] [Assigned] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

2023-05-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-18731: Assignee: Wei-Chiu Chuang > Backport HADOOP-18671 to branch-3.2 >

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719542#comment-17719542 ] ASF GitHub Bot commented on HADOOP-18671: - jojochuang opened a new pull request, #5619: URL:

[GitHub] [hadoop] jojochuang opened a new pull request, #5619: HADOOP-18671. Add recoverLease(), setSafeMode(), isFileClosed() as interfaces to hadoop-common (#5553)

2023-05-04 Thread via GitHub
jojochuang opened a new pull request, #5619: URL: https://github.com/apache/hadoop/pull/5619 The HDFS lease APIs have been replicated as interfaces in hadoop-common so other filesystems can also implement them. Applications which use the leasing APIs should migrate to the new interface

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719530#comment-17719530 ] ASF GitHub Bot commented on HADOOP-18724: - hadoop-yetus commented on PR #5611: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5611: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5611: URL: https://github.com/apache/hadoop/pull/5611#issuecomment-1535415371 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18706) The temporary files for disk-block buffer aren't unique enough to recover partial uploads. 

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719529#comment-17719529 ] ASF GitHub Bot commented on HADOOP-18706: - hadoop-yetus commented on PR #5563: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5563: HADOOP-18706: Improve S3ABlockOutputStream recovery

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5563: URL: https://github.com/apache/hadoop/pull/5563#issuecomment-1535407973 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18706) The temporary files for disk-block buffer aren't unique enough to recover partial uploads. 

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719516#comment-17719516 ] ASF GitHub Bot commented on HADOOP-18706: - cbevard1 commented on PR #5563: URL:

[jira] [Commented] (HADOOP-18723) Add detail logs if distcp checksum mismatch

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719515#comment-17719515 ] ASF GitHub Bot commented on HADOOP-18723: - ayushtkn commented on code in PR #5603: URL:

[GitHub] [hadoop] cbevard1 commented on pull request #5563: HADOOP-18706: Improve S3ABlockOutputStream recovery

2023-05-04 Thread via GitHub
cbevard1 commented on PR #5563: URL: https://github.com/apache/hadoop/pull/5563#issuecomment-1535323312 Shoot. That was in the last checkstyle, and I thought I bumped it out to 113. My IDE says it was indented to 113, but it wasn't. I should have run check style before committing. Anyways,

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5603: HADOOP-18723. Add detail logs if distcp checksum mismatch

2023-05-04 Thread via GitHub
ayushtkn commented on code in PR #5603: URL: https://github.com/apache/hadoop/pull/5603#discussion_r1185326966 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java: ## @@ -596,6 +596,8 @@ public static CopyMapper.ChecksumComparison

[jira] [Commented] (HADOOP-18706) The temporary files for disk-block buffer aren't unique enough to recover partial uploads. 

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719487#comment-17719487 ] ASF GitHub Bot commented on HADOOP-18706: - steveloughran commented on PR #5563: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5563: HADOOP-18706: Improve S3ABlockOutputStream recovery

2023-05-04 Thread via GitHub
steveloughran commented on PR #5563: URL: https://github.com/apache/hadoop/pull/5563#issuecomment-1535241489 thanks for the run. final bit of outstanding style. i know there are lots already, but new code should always start well, whenever possible ```

[jira] [Commented] (HADOOP-18727) Fix WriteOperations.listMultipartUploads function description

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719485#comment-17719485 ] ASF GitHub Bot commented on HADOOP-18727: - steveloughran commented on PR #5613: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5613: HADOOP-18727. Fix `WriteOperations.listMultipartUploads` function description

2023-05-04 Thread via GitHub
steveloughran commented on PR #5613: URL: https://github.com/apache/hadoop/pull/5613#issuecomment-1535237726 +in branch-3.3; recompiled first as a safety check -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Resolved] (HADOOP-18727) Fix WriteOperations.listMultipartUploads function description

2023-05-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18727. - Fix Version/s: 3.4.0 3.3.9 Assignee: Dongjoon Hyun

[jira] [Commented] (HADOOP-18028) High performance S3A input stream with prefetching & caching

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719484#comment-17719484 ] ASF GitHub Bot commented on HADOOP-18028: - steveloughran closed pull request #5605:

[GitHub] [hadoop] steveloughran closed pull request #5605: HADOOP-18028. High performance S3A input stream (#4752)

2023-05-04 Thread via GitHub
steveloughran closed pull request #5605: HADOOP-18028. High performance S3A input stream (#4752) URL: https://github.com/apache/hadoop/pull/5605 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719481#comment-17719481 ] ASF GitHub Bot commented on HADOOP-18724: - steveloughran commented on PR #5611: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5611: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem

2023-05-04 Thread via GitHub
steveloughran commented on PR #5611: URL: https://github.com/apache/hadoop/pull/5611#issuecomment-1535233676 testing * azure cardiff: -Dparallel-tests=abfs -DtestsThreadCount=6 * s3 london: -Dparallel-tests -DtestsThreadCount=8 -- This is an automated message from the Apache

[GitHub] [hadoop] hadoop-yetus commented on pull request #5403: YARN-11340. [Federation] Improve SQLFederationStateStore DataSource Config.

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5403: URL: https://github.com/apache/hadoop/pull/5403#issuecomment-1535201147 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ayushtkn commented on pull request #5200: HDFS-16865. RBF: The source path is always / after RBF proxied the complete, addBlock and getAdditionalDatanode RPC.

2023-05-04 Thread via GitHub
ayushtkn commented on PR #5200: URL: https://github.com/apache/hadoop/pull/5200#issuecomment-1535185336 @goiri does this makes sense? Will be holding this for you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HADOOP-18723) Add detail logs if distcp checksum mismatch

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719460#comment-17719460 ] ASF GitHub Bot commented on HADOOP-18723: - ayushtkn commented on code in PR #5603: URL:

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5603: HADOOP-18723. Add detail logs if distcp checksum mismatch

2023-05-04 Thread via GitHub
ayushtkn commented on code in PR #5603: URL: https://github.com/apache/hadoop/pull/5603#discussion_r1185336347 ## hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/mapred/TestCopyCommitter.java: ## @@ -569,6 +572,7 @@ private void

[GitHub] [hadoop] hadoop-yetus commented on pull request #5609: YARN-11470. FederationStateStoreFacade Cache Support Guava Cache.

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5609: URL: https://github.com/apache/hadoop/pull/5609#issuecomment-1535182179 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18723) Add detail logs if distcp checksum mismatch

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719448#comment-17719448 ] ASF GitHub Bot commented on HADOOP-18723: - ayushtkn commented on code in PR #5603: URL:

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5603: HADOOP-18723. Add detail logs if distcp checksum mismatch

2023-05-04 Thread via GitHub
ayushtkn commented on code in PR #5603: URL: https://github.com/apache/hadoop/pull/5603#discussion_r1185326966 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/util/DistCpUtils.java: ## @@ -596,6 +596,8 @@ public static CopyMapper.ChecksumComparison

[jira] [Commented] (HADOOP-18727) Fix WriteOperations.listMultipartUploads function description

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719446#comment-17719446 ] ASF GitHub Bot commented on HADOOP-18727: - dongjoon-hyun commented on PR #5613: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5613: HADOOP-18727. Fix `WriteOperations.listMultipartUploads` function description

2023-05-04 Thread via GitHub
dongjoon-hyun commented on PR #5613: URL: https://github.com/apache/hadoop/pull/5613#issuecomment-1535169783 Thank you, @steveloughran . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (HADOOP-18729) Fix mvnsite on Windows 10

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719440#comment-17719440 ] ASF GitHub Bot commented on HADOOP-18729: - hadoop-yetus commented on PR #5618: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5618: HADOOP-18729. Fix mvnsite on Windows 10

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5618: URL: https://github.com/apache/hadoop/pull/5618#issuecomment-1535156164 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5616: YARN-11477. [Federation] MemoryFederationStateStore Support Store ApplicationSubmitData.

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5616: URL: https://github.com/apache/hadoop/pull/5616#issuecomment-1535086637 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

2023-05-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18731: - Target Version/s: 3.2.5 (was: 3.3.6) > Backport HADOOP-18671 to branch-3.2 >

[GitHub] [hadoop] hadoop-yetus commented on pull request #5616: YARN-11477. [Federation] MemoryFederationStateStore Support Store ApplicationSubmitData.

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5616: URL: https://github.com/apache/hadoop/pull/5616#issuecomment-1535079525 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

2023-05-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18730: - Target Version/s: 3.3.6 > Backport HADOOP-18671 to branch-3.3 >

[jira] [Updated] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

2023-05-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18731: - Target Version/s: 3.3.6 > Backport HADOOP-18671 to branch-3.2 >

[jira] [Created] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

2023-05-04 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-18730: Summary: Backport HADOOP-18671 to branch-3.3 Key: HADOOP-18730 URL: https://issues.apache.org/jira/browse/HADOOP-18730 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

2023-05-04 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-18731: Summary: Backport HADOOP-18671 to branch-3.2 Key: HADOOP-18731 URL: https://issues.apache.org/jira/browse/HADOOP-18731 Project: Hadoop Common Issue

[jira] [Assigned] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

2023-05-04 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-18730: Assignee: Wei-Chiu Chuang > Backport HADOOP-18671 to branch-3.3 >

[GitHub] [hadoop] goiri merged pull request #5615: HDFS-16998. RBF: Add ops metrics for getSlowDatanodeReport in RouterClientActivity

2023-05-04 Thread via GitHub
goiri merged PR #5615: URL: https://github.com/apache/hadoop/pull/5615 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] slfan1989 commented on pull request #5403: YARN-11340. [Federation] Improve SQLFederationStateStore DataSource Config.

2023-05-04 Thread via GitHub
slfan1989 commented on PR #5403: URL: https://github.com/apache/hadoop/pull/5403#issuecomment-1534985923 @goiri Can you help to review this pr? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] slfan1989 commented on pull request #5616: YARN-11477. [Federation] MemoryFederationStateStore Support Store ApplicationSubmitData.

2023-05-04 Thread via GitHub
slfan1989 commented on PR #5616: URL: https://github.com/apache/hadoop/pull/5616#issuecomment-1534983094 @goiri Can you help to review this pr? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] hadoop-yetus commented on pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5552: URL: https://github.com/apache/hadoop/pull/5552#issuecomment-1534947516 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18706) The temporary files for disk-block buffer aren't unique enough to recover partial uploads. 

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719370#comment-17719370 ] ASF GitHub Bot commented on HADOOP-18706: - hadoop-yetus commented on PR #5563: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5563: HADOOP-18706: Improve S3ABlockOutputStream recovery

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5563: URL: https://github.com/apache/hadoop/pull/5563#issuecomment-1534918500 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] GauthamBanasandra opened a new pull request, #5618: HADOOP-18729. Fix mvnsite on Windows 10

2023-05-04 Thread via GitHub
GauthamBanasandra opened a new pull request, #5618: URL: https://github.com/apache/hadoop/pull/5618 * The mvnsite step invokes shelldocs script. This fails to run on Windows since this script is written in Bash, which Windows can't execute natively. * Thus, we must run this script

[jira] [Updated] (HADOOP-18729) Fix mvnsite on Windows 10

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18729: Labels: pull-request-available (was: ) > Fix mvnsite on Windows 10 >

[jira] [Commented] (HADOOP-18729) Fix mvnsite on Windows 10

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719352#comment-17719352 ] ASF GitHub Bot commented on HADOOP-18729: - GauthamBanasandra opened a new pull request, #5618:

[jira] [Created] (HADOOP-18729) Fix mvnsite on Windows 10

2023-05-04 Thread Gautham Banasandra (Jira)
Gautham Banasandra created HADOOP-18729: --- Summary: Fix mvnsite on Windows 10 Key: HADOOP-18729 URL: https://issues.apache.org/jira/browse/HADOOP-18729 Project: Hadoop Common Issue

[jira] [Commented] (HADOOP-18706) The temporary files for disk-block buffer aren't unique enough to recover partial uploads. 

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719318#comment-17719318 ] ASF GitHub Bot commented on HADOOP-18706: - cbevard1 commented on PR #5563: URL:

[GitHub] [hadoop] cbevard1 commented on pull request #5563: HADOOP-18706: Improve S3ABlockOutputStream recovery

2023-05-04 Thread via GitHub
cbevard1 commented on PR #5563: URL: https://github.com/apache/hadoop/pull/5563#issuecomment-1534755287 Done. Integration tests were run in us-east-2 with the following options: `-Dparallel-tests -DtestsThreadCount=16 -Dscale` -- This is an automated message from the Apache Git

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-05-04 Thread via GitHub
ayushtkn commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1184989929 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestNamenodeAuditlogWithDFSRouterPort.java: ## @@ -0,0 +1,91 @@

[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719306#comment-17719306 ] Steve Loughran commented on HADOOP-18688: - we need to make sure it gets into the referrer

[GitHub] [hadoop] LiuGuH commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-05-04 Thread via GitHub
LiuGuH commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1184952734 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestNamenodeAuditlogWithDFSRouterPort.java: ## @@ -0,0 +1,91 @@ +/**

[jira] [Commented] (HADOOP-17017) S3A client retries on SSL Auth exceptions triggered by "." bucket names

2023-05-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719296#comment-17719296 ] Steve Loughran commented on HADOOP-17017: - looks like an aws sdk message. in fact, looks like a

[jira] [Commented] (HADOOP-18727) Fix WriteOperations.listMultipartUploads function description

2023-05-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719290#comment-17719290 ] ASF GitHub Bot commented on HADOOP-18727: - steveloughran merged PR #5613: URL:

[GitHub] [hadoop] steveloughran merged pull request #5613: HADOOP-18727. Fix `WriteOperations.listMultipartUploads` function description

2023-05-04 Thread via GitHub
steveloughran merged PR #5613: URL: https://github.com/apache/hadoop/pull/5613 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-05-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18671: --- Assignee: Tak-Lon (Stephen) Wu > Add recoverLease(), setSafeMode(),

[GitHub] [hadoop] hadoop-yetus commented on pull request #5617: YARN-11487. WebAppProxyServlet log output request ip

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5617: URL: https://github.com/apache/hadoop/pull/5617#issuecomment-1534576078 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5552: URL: https://github.com/apache/hadoop/pull/5552#issuecomment-1534552305 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-05-04 Thread via GitHub
ayushtkn commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1184829824 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java: ## @@ -50,7 +50,8 @@ public final class CallerContext { public static

[GitHub] [hadoop] brumi1024 merged pull request #5614: YARN-11463. Node Labels root directory creation doesn't have a retry logic - addendum

2023-05-04 Thread via GitHub
brumi1024 merged PR #5614: URL: https://github.com/apache/hadoop/pull/5614 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5614: YARN-11463. Node Labels root directory creation doesn't have a retry logic - addendum

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5614: URL: https://github.com/apache/hadoop/pull/5614#issuecomment-1534437253 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5617: YARN-11487. WebAppProxyServlet log output request ip

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5617: URL: https://github.com/apache/hadoop/pull/5617#issuecomment-1534412516 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18687) Remove unnecessary dependency on json-smart

2023-05-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18687: Hadoop Flags: Incompatible change Release Note: json-smart is no longer dependency of

[GitHub] [hadoop] cxzl25 opened a new pull request, #5617: YARN-11487. WebAppProxyServlet log output request ip

2023-05-04 Thread via GitHub
cxzl25 opened a new pull request, #5617: URL: https://github.com/apache/hadoop/pull/5617 ### Description of PR Output the request ip of `WebAppProxyServlet` in the log. ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts

[GitHub] [hadoop] hadoop-yetus commented on pull request #5616: YARN-11477. [Federation] MemoryFederationStateStore Support Store ApplicationSubmitData.

2023-05-04 Thread via GitHub
hadoop-yetus commented on PR #5616: URL: https://github.com/apache/hadoop/pull/5616#issuecomment-1534246578 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] LiuGuH commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-05-04 Thread via GitHub
LiuGuH commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1184664573 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -453,15 +453,15 @@ private void logAuditEvent(boolean

[jira] [Commented] (HADOOP-17017) S3A client retries on SSL Auth exceptions triggered by "." bucket names

2023-05-04 Thread Smith Cruise (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719178#comment-17719178 ] Smith Cruise commented on HADOOP-17017: --- When I set  fs.s3a.path.style.access true Enable S3