This is an automated email from the ASF dual-hosted git repository.
roryqi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/uniffle.git
The following commit(s) were added to refs/heads/master by this push:
new b45e986d4 [#2490] feat(spark): Display memory usage of all consumers
under low-memory conditions (#2491)
b45e986d4 is described below
commit b45e986d44712dfdadd123e4c953a78fd088ac35
Author: Junfan Zhang <[email protected]>
AuthorDate: Tue May 27 16:47:38 2025 +0800
[#2490] feat(spark): Display memory usage of all consumers under low-memory
conditions (#2491)
### What changes were proposed in this pull request?
Display memory usage of all consumers under low-memory conditions
### Why are the changes needed?
for #2490
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing tests
---
.../main/java/org/apache/spark/shuffle/writer/WriteBufferManager.java | 1 +
1 file changed, 1 insertion(+)
diff --git
a/client-spark/common/src/main/java/org/apache/spark/shuffle/writer/WriteBufferManager.java
b/client-spark/common/src/main/java/org/apache/spark/shuffle/writer/WriteBufferManager.java
index 8b0862b81..f2a980cb3 100644
---
a/client-spark/common/src/main/java/org/apache/spark/shuffle/writer/WriteBufferManager.java
+++
b/client-spark/common/src/main/java/org/apache/spark/shuffle/writer/WriteBufferManager.java
@@ -489,6 +489,7 @@ public class WriteBufferManager extends MemoryConsumer {
allocatedBytes.addAndGet(gotMem);
retry++;
if (retry > requireMemoryRetryMax) {
+ taskMemoryManager.showMemoryUsage();
String message =
"Can't get memory to cache shuffle data, request["
+ askExecutorMemory