Re: [PR] HDFS-17393. Remove unused FSNamesysteLock `cond` in FSNamesystem [hadoop]

hadoop-yetus commented on PR #6567: URL: https://github.com/apache/hadoop/pull/6567#issuecomment-1960866721 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17393. Remove unused FSNamesysteLock `cond` in FSNamesystem [hadoop]

hadoop-yetus commented on PR #6567: URL: https://github.com/apache/hadoop/pull/6567#issuecomment-1960863981 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17393. Remove unused FSNamesysteLock `cond` in FSNamesystem [hadoop]

ferhui commented on PR #6567: URL: https://github.com/apache/hadoop/pull/6567#issuecomment-1960858195 @tasanuma @slfan1989 Thanks for reviewing it. Merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] HDFS-17393. Remove unused FSNamesysteLock `cond` in FSNamesystem [hadoop]

ferhui merged PR #6567: URL: https://github.com/apache/hadoop/pull/6567 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17393. Remove unused FSNamesysteLock `cond` in FSNamesystem [hadoop]

ferhui commented on PR #6567: URL: https://github.com/apache/hadoop/pull/6567#issuecomment-1960854781 @ZanderXu Thanks for pushing it forward. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] HDFS-17395. [FGL] Use FSLock to protect ErasureCodingPolicy related operations [hadoop]

ZanderXu opened a new pull request, #6579: URL: https://github.com/apache/hadoop/pull/6579 NameNode supports dynamically change ErasureCodingPolicy, so these ErasureCodingPolicies should be protected by one lock, the current implementation uses the global lock. ErasureCodingPolicy

Re: [PR] HDFS-17393. [FGL] Remove unused `cond` in FSNamesystem [hadoop]

ZanderXu commented on PR #6567: URL: https://github.com/apache/hadoop/pull/6567#issuecomment-1960840610 Thanks @tasanuma @slfan1989 for your review, let me modify this ticket. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] HDFS-15869. Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang [hadoop]

ZanderXu commented on PR #2737: URL: https://github.com/apache/hadoop/pull/2737#issuecomment-1960838297 If I missed some other concerns, please let me know, we can find solutions together to push this ticket forward. -- This is an automated message from the Apache Git Service. To respond

Re: [PR] HDFS-15869. Network issue while FSEditLogAsync is executing RpcEdit.logSyncNotify can cause the namenode to hang [hadoop]

ZanderXu commented on PR #2737: URL: https://github.com/apache/hadoop/pull/2737#issuecomment-1960828209 Thanks for your works and discussions for this problem. I spent a long time to catch your ideas and concerns, it's so hard. I have some throughs and questions about this ticket.

[jira] [Updated] (HADOOP-19082) S3A: Update AWS SDK V2 to 2.24.6

[ https://issues.apache.org/jira/browse/HADOOP-19082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harshit Gupta updated HADOOP-19082: --- Summary: S3A: Update AWS SDK V2 to 2.24.6 (was: S3A: Update AWS SDK V2 to 2.24.1) > S3A:

[jira] [Updated] (HADOOP-19082) S3A: Update AWS SDK V2 to 2.24.6

[ https://issues.apache.org/jira/browse/HADOOP-19082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harshit Gupta updated HADOOP-19082: --- Description: Update the AWS SDK to 2.24.6 from 2.23.5 for latest updates in packaging

Re: [PR] HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. [hadoop]

slfan1989 commented on PR #6537: URL: https://github.com/apache/hadoop/pull/6537#issuecomment-1960795762 @shahrs87 I rolled back #6537. If you have any questions, feel free to contact me. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (HADOOP-19071) Update maven-surefire-plugin from 3.0.0 to 3.2.5

[ https://issues.apache.org/jira/browse/HADOOP-19071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819932#comment-17819932 ] ASF GitHub Bot commented on HADOOP-19071: - hadoop-yetus commented on PR #6578: URL:

Re: [PR] Revert "HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5." [hadoop]

hadoop-yetus commented on PR #6578: URL: https://github.com/apache/hadoop/pull/6578#issuecomment-1960794270 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] Revert "HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5." [hadoop]

slfan1989 merged PR #6578: URL: https://github.com/apache/hadoop/pull/6578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-19071) Update maven-surefire-plugin from 3.0.0 to 3.2.5

[ https://issues.apache.org/jira/browse/HADOOP-19071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819930#comment-17819930 ] ASF GitHub Bot commented on HADOOP-19071: - slfan1989 opened a new pull request, #6578: URL:

[PR] Revert "HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5." [hadoop]

slfan1989 opened a new pull request, #6578: URL: https://github.com/apache/hadoop/pull/6578 Reverts apache/hadoop#6537 The upgrade of maven-surefire-plugin is currently found to cause some unit tests not to be executed. Currently, some pr reports oom problems. I will roll back this

Re: [PR] HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. [hadoop]

slfan1989 commented on PR #6537: URL: https://github.com/apache/hadoop/pull/6537#issuecomment-1960784052 @ayushtkn @tasanuma @steveloughran I don't want to roll back this change. I would like to continue pushing for this upgrade. I have noticed several pull requests that seem to

Re: [PR] YARN-11657. Remove protobuf-2.5 as dependency of hadoop-yarn modules [hadoop]

ayushtkn commented on code in PR #6575: URL: https://github.com/apache/hadoop/pull/6575#discussion_r1500242344 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/pom.xml: ## @@ -72,6 +72,7 @@ com.google.protobuf

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819919#comment-17819919 ] ASF GitHub Bot commented on HADOOP-19065: - slfan1989 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

slfan1989 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960754327 While I'd like to do this after releasing hadoop-3.4.0, @tasanuma makes a valid point. Since we already support protobuf 3.21.12 in hadoop-thirdparty 1.2.0, we should try to make this

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819916#comment-17819916 ] ASF GitHub Bot commented on HADOOP-19065: - slfan1989 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

slfan1989 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960750221 > I temporarily don't support porting this to the [hadoop-3](https://issues.apache.org/jira/browse/HADOOP-3).4.0 branch. I've spent a lot of time setting up the compilation environment,

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819915#comment-17819915 ] ASF GitHub Bot commented on HADOOP-19065: - huangzhaobo99 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

huangzhaobo99 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960749738 > > @slfan1989 Discussed in JIRA: https://issues.apache.org/jira/browse/HADOOP-19065 cc @steveloughran > > I temporarily don't support porting this to the

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819911#comment-17819911 ] ASF GitHub Bot commented on HADOOP-19065: - slfan1989 commented on PR #6526: URL:

Re: [PR] HADOOP-19065. Improve Protocol Buffers installation [hadoop]

slfan1989 commented on PR #6526: URL: https://github.com/apache/hadoop/pull/6526#issuecomment-1960746836 @huangzhaobo99 Do you have any actual environment to use these dockerfiles? This involves many operating systems, and I am not sure whether it can really be executed normally. cc:

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819910#comment-17819910 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on PR #6069: URL:

Re: [PR] HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport [hadoop]

anujmodi2021 commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1960744484 > Seeing these failures in branch-3.4 after backporting this and #5881. These failures are happening even without these changes. @anujmodi2021 Can you figure out what other commits

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819909#comment-17819909 ] ASF GitHub Bot commented on HADOOP-19065: - slfan1989 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

slfan1989 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960740564 > @slfan1989 Discussed in JIRA: https://issues.apache.org/jira/browse/HADOOP-19065 cc @steveloughran I temporarily don't support porting this to the hadoop-3.4.0 branch. I've

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819908#comment-17819908 ] ASF GitHub Bot commented on HADOOP-19065: - huangzhaobo99 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

huangzhaobo99 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960738479 > -1 > > You don't need to submit such changes. After the release of [hadoop-3](https://issues.apache.org/jira/browse/HADOOP-3).4.0, I will uniformly adjust the release

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819907#comment-17819907 ] ASF GitHub Bot commented on HADOOP-19065: - slfan1989 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

slfan1989 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960734820 You don't need to submit such changes. After the release of hadoop-3.4.0, I will uniformly adjust the release compilation script. -- This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819906#comment-17819906 ] ASF GitHub Bot commented on HADOOP-19065: - hadoop-yetus commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

hadoop-yetus commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960717190 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819905#comment-17819905 ] ASF GitHub Bot commented on HADOOP-19065: - hadoop-yetus commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

hadoop-yetus commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960716062 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11626. Optimize ResourceManager's operations on Zookeeper metadata [hadoop]

hadoop-yetus commented on PR #6577: URL: https://github.com/apache/hadoop/pull/6577#issuecomment-1960704380 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17390. [FGL] FSDirectory supports this fine-grained locking [hadoop]

hadoop-yetus commented on PR #6573: URL: https://github.com/apache/hadoop/pull/6573#issuecomment-1960700492 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[PR] YARN-11626. Optimize ResourceManager's operations on Zookeeper metadata [hadoop]

XbaoWu opened a new pull request, #6577: URL: https://github.com/apache/hadoop/pull/6577 ### Description of PR For more information about this PR, please refer to the following issue： [YARN-11626](https://issues.apache.org/jira/browse/YARN-11626) Optimization of the

Re: [PR] HDFS-17390. [FGL] FSDirectory supports this fine-grained locking [hadoop]

hadoop-yetus commented on PR #6573: URL: https://github.com/apache/hadoop/pull/6573#issuecomment-1960683405 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819880#comment-17819880 ] ASF GitHub Bot commented on HADOOP-19065: - huangzhaobo99 commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

huangzhaobo99 commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960655451 Message error, pushed twice, ignored. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819875#comment-17819875 ] huangzhaobo commented on HADOOP-19065: -- [~ste...@apache.org] Thanks for merging. It has been

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819874#comment-17819874 ] ASF GitHub Bot commented on HADOOP-19065: - hadoop-yetus commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 [hadoop]

hadoop-yetus commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960647331 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819873#comment-17819873 ] ASF GitHub Bot commented on HADOOP-19065: - hadoop-yetus commented on PR #6576: URL:

Re: [PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 (#6576) [hadoop]

hadoop-yetus commented on PR #6576: URL: https://github.com/apache/hadoop/pull/6576#issuecomment-1960644949 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819872#comment-17819872 ] ASF GitHub Bot commented on HADOOP-19065: - huangzhaobo99 opened a new pull request, #6576: URL:

[PR] HADOOP-19065. Update Protocol Buffers installation to 3.21.12 (#6526) [hadoop]

huangzhaobo99 opened a new pull request, #6576: URL: https://github.com/apache/hadoop/pull/6576 ### Description of PR JIRA: https://issues.apache.org/jira/browse/HADOOP-19065 Instructions and docker script for installing protobuf updated from 3.7.1 to 3.21.12 -- This is an

[jira] [Commented] (HADOOP-19085) Compatibility Benchmark over HCFS Implementations

[ https://issues.apache.org/jira/browse/HADOOP-19085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819869#comment-17819869 ] Kai Zheng commented on HADOOP-19085: Just did a quick glance at the code. [~han.liu] Let's do in

[jira] [Commented] (HADOOP-19085) Compatibility Benchmark over HCFS Implementations

[ https://issues.apache.org/jira/browse/HADOOP-19085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819866#comment-17819866 ] Kai Zheng commented on HADOOP-19085: Got it. Thanks Steve for the refresh, :). > Compatibility

Re: [PR] HDFS-17299. Adding rack failure tolerance when creating a new file [hadoop]

hadoop-yetus commented on PR #6566: URL: https://github.com/apache/hadoop/pull/6566#issuecomment-1960584739 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

Re: [PR] HDFS-17299. Adding rack failure tolerance when creating a new file [hadoop]

hadoop-yetus commented on PR #6566: URL: https://github.com/apache/hadoop/pull/6566#issuecomment-1960345982 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819814#comment-17819814 ] ASF GitHub Bot commented on HADOOP-18910: - mukund-thakur commented on PR #6069: URL:

Re: [PR] HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport [hadoop]

mukund-thakur commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1960305686 Seeing these failures in branch-3.4 after backporting this and https://github.com/apache/hadoop/pull/5881. These failures are happening even without these changes. @anujmodi2021

[jira] [Commented] (HADOOP-19084) prune dependency exports of hadoop-* modules

[ https://issues.apache.org/jira/browse/HADOOP-19084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819799#comment-17819799 ] ASF GitHub Bot commented on HADOOP-19084: - hadoop-yetus commented on PR #6574: URL:

Re: [PR] HADOOP-19084. Pruning some of the transitive dependencies of imports [hadoop]

hadoop-yetus commented on PR #6574: URL: https://github.com/apache/hadoop/pull/6574#issuecomment-1960252788 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] YARN-11657. Remove protobuf-2.5 as dependency of hadoop-yarn modules [hadoop]

hadoop-yetus commented on PR #6575: URL: https://github.com/apache/hadoop/pull/6575#issuecomment-1960180302 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19082) S3A: Update AWS SDK V2 to 2.24.1

[ https://issues.apache.org/jira/browse/HADOOP-19082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819772#comment-17819772 ] ASF GitHub Bot commented on HADOOP-19082: - ahmarsuhail commented on PR #6568: URL:

Re: [PR] HADOOP-19082: Update AWS SDK V2 to 2.24.1 [hadoop]

ahmarsuhail commented on PR #6568: URL: https://github.com/apache/hadoop/pull/6568#issuecomment-1960081655 @HarshitGupta11 could you upgrade to the latest version, or at least `2.24.6` instead? We found an issue with the S3 async client not implement abort which is fixed in `2.24.6`. This

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819769#comment-17819769 ] ASF GitHub Bot commented on HADOOP-18708: - hadoop-yetus commented on PR #6164: URL:

Re: [PR] HADOOP-18708. AWS SDK V2 - Implement CSE [hadoop]

hadoop-yetus commented on PR #6164: URL: https://github.com/apache/hadoop/pull/6164#issuecomment-1960056471 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819758#comment-17819758 ] ASF GitHub Bot commented on HADOOP-18708: - hadoop-yetus commented on PR #6164: URL:

Re: [PR] HADOOP-18708. AWS SDK V2 - Implement CSE [hadoop]

hadoop-yetus commented on PR #6164: URL: https://github.com/apache/hadoop/pull/6164#issuecomment-1959985965 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819753#comment-17819753 ] ASF GitHub Bot commented on HADOOP-18910: - mukund-thakur merged PR #6069: URL:

Re: [PR] HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport [hadoop]

mukund-thakur merged PR #6069: URL: https://github.com/apache/hadoop/pull/6069 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819748#comment-17819748 ] ASF GitHub Bot commented on HADOOP-18708: - hadoop-yetus commented on PR #6164: URL:

Re: [PR] HADOOP-18708. AWS SDK V2 - Implement CSE [hadoop]

hadoop-yetus commented on PR #6164: URL: https://github.com/apache/hadoop/pull/6164#issuecomment-1959943001 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17299. Adding rack failure tolerance when creating a new file [hadoop]

hadoop-yetus commented on PR #6566: URL: https://github.com/apache/hadoop/pull/6566#issuecomment-1959924123 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Commented] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819735#comment-17819735 ] Steve Loughran commented on HADOOP-19065: - merged to trunk. [~huangzhaobo99] can you create a

[jira] [Assigned] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19065: --- Assignee: huangzhaobo > Update Protocol Buffers installation to 3.21.12 >

[jira] [Resolved] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19065. - Fix Version/s: 3.5.0 Resolution: Fixed > Update Protocol Buffers installation

[jira] [Updated] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19065: Description: Update docs and docker script to cover downloading the 3.21.12 protobuf

[jira] [Updated] (HADOOP-19065) Update Protocol Buffers installation to 3.21.12

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19065: Summary: Update Protocol Buffers installation to 3.21.12 (was: Improve Protocol

Re: [PR] HADOOP-19065. Improve Protocol Buffers installation [hadoop]

steveloughran merged PR #6526: URL: https://github.com/apache/hadoop/pull/6526 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-19065) Improve Protocol Buffers installation

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19065: Summary: Improve Protocol Buffers installation (was: Improve Protocol Buffers install

[jira] [Updated] (HADOOP-19065) Improve Protocol Buffers install instructions.

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19065: Component/s: build > Improve Protocol Buffers install instructions. >

[jira] [Updated] (HADOOP-19065) Improve Protocol Buffers install instructions.

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19065: Affects Version/s: 3.4.0 > Improve Protocol Buffers install instructions. >

[jira] [Commented] (HADOOP-19082) S3A: Update AWS SDK V2 to 2.24.1

[ https://issues.apache.org/jira/browse/HADOOP-19082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819732#comment-17819732 ] ASF GitHub Bot commented on HADOOP-19082: - steveloughran commented on PR #6568: URL:

Re: [PR] HADOOP-19082: Update AWS SDK V2 to 2.24.1 [hadoop]

steveloughran commented on PR #6568: URL: https://github.com/apache/hadoop/pull/6568#issuecomment-1959881685 +1 pending you state which s3 endpoint you ran the tests and what the parameters to your test run were. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] YARN-11657. Remove protobuf-2.5 as dependency of hadoop-yarn modules [hadoop]

steveloughran commented on PR #6575: URL: https://github.com/apache/hadoop/pull/6575#issuecomment-1959871746 comes in because of ``` [INFO] +- org.apache.hbase:hbase-common:jar:1.7.1:compile [INFO] | +- org.apache.hbase:hbase-protocol:jar:1.7.1:compile [INFO] | +-

Re: [PR] YARN-11657. Remove protobuf-2.5 as dependency of hadoop-yarn modules [hadoop]

steveloughran commented on PR #6575: URL: https://github.com/apache/hadoop/pull/6575#issuecomment-1959869568 doing a build shows it is still coming in to timeline service. that's because it is talking to hbase...to fix that we'd need to move to an hbase client which was more current.

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819725#comment-17819725 ] ASF GitHub Bot commented on HADOOP-18708: - ahmarsuhail commented on PR #6164: URL:

Re: [PR] HADOOP-18708. AWS SDK V2 - Implement CSE [hadoop]

ahmarsuhail commented on PR #6164: URL: https://github.com/apache/hadoop/pull/6164#issuecomment-1959863096 Tested in eu-west-1, with `fs.s3a.encryption.algorithm` = CSE-KMS, `fs.s3a.encryption.enabled` = true, and `fs.s3a.scale.test.enabled` = true. Seeing a few failures: ```

[PR] YARN-11657. Remove protobuf-2.5 as dependency of hadoop-yarn modules [hadoop]

steveloughran opened a new pull request, #6575: URL: https://github.com/apache/hadoop/pull/6575 ### How was this patch tested? hadoop release support verifies that protobuf-2.5 isn't published as a dependency of any artifact. ### For code changes: - [X] Does

[jira] [Updated] (HADOOP-19084) prune dependency exports of hadoop-* modules

[ https://issues.apache.org/jira/browse/HADOOP-19084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19084: Labels: pull-request-available (was: ) > prune dependency exports of hadoop-* modules >

[jira] [Commented] (HADOOP-19084) prune dependency exports of hadoop-* modules

[ https://issues.apache.org/jira/browse/HADOOP-19084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819718#comment-17819718 ] ASF GitHub Bot commented on HADOOP-19084: - steveloughran opened a new pull request, #6574: URL:

[PR] HADOOP-19084. Pruning some of the transitive dependencies of imports [hadoop]

steveloughran opened a new pull request, #6574: URL: https://github.com/apache/hadoop/pull/6574 In particular -zookeeper -other libraries referencing logging This doesn't seem to fix the problem were dependencies on hadoop-common and hadoop-client API pull in conflicting

[jira] [Created] (HADOOP-19086) move commons-logging to 1.2

Steve Loughran created HADOOP-19086: --- Summary: move commons-logging to 1.2 Key: HADOOP-19086 URL: https://issues.apache.org/jira/browse/HADOOP-19086 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-19053) Release Hadoop-Thirdparty 1.2.0

[ https://issues.apache.org/jira/browse/HADOOP-19053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19053: Description: Release hadoop-thirdparty 1.2.0 JAR This contains * > Release

[jira] [Commented] (HADOOP-19065) Improve Protocol Buffers install instructions.

[ https://issues.apache.org/jira/browse/HADOOP-19065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819711#comment-17819711 ] ASF GitHub Bot commented on HADOOP-19065: - hadoop-yetus commented on PR #6526: URL:

Re: [PR] HADOOP-19065. Improve Protocol Buffers install instructions. [hadoop]

hadoop-yetus commented on PR #6526: URL: https://github.com/apache/hadoop/pull/6526#issuecomment-1959783233 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819709#comment-17819709 ] ASF GitHub Bot commented on HADOOP-18708: - hadoop-yetus commented on PR #6164: URL:

Re: [PR] HADOOP-18708. AWS SDK V2 - Implement CSE [hadoop]

hadoop-yetus commented on PR #6164: URL: https://github.com/apache/hadoop/pull/6164#issuecomment-1959777145 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18708) AWS SDK V2 - Implement CSE

[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819703#comment-17819703 ] ASF GitHub Bot commented on HADOOP-18708: - hadoop-yetus commented on PR #6164: URL:

Re: [PR] HADOOP-18708. AWS SDK V2 - Implement CSE [hadoop]

hadoop-yetus commented on PR #6164: URL: https://github.com/apache/hadoop/pull/6164#issuecomment-1959763107 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19071) Update maven-surefire-plugin from 3.0.0 to 3.2.5

[ https://issues.apache.org/jira/browse/HADOOP-19071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819692#comment-17819692 ] ASF GitHub Bot commented on HADOOP-19071: - ayushtkn commented on PR #6537: URL:

  1   2   >