(incubator-uniffle) branch master updated: [#2192] feat(spark3): Explicitly set rss.enabled as true to make ShuffleDataIO valid (#2193)

[zuston]

This is an automated email from the ASF dual-hosted git repository.

zuston pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-uniffle.git


The following commit(s) were added to refs/heads/master by this push:
     new e6e7819cd [#2192] feat(spark3): Explicitly set rss.enabled as true to 
make ShuffleDataIO valid (#2193)
e6e7819cd is described below

commit e6e7819cd4a730934c02005394b8238f0567712a
Author: Zhen Wang <643348...@qq.com>
AuthorDate: Wed Oct 16 16:46:59 2024 +0800

    [#2192] feat(spark3): Explicitly set rss.enabled as true to make 
ShuffleDataIO valid (#2193)
    
    ### What changes were proposed in this pull request?
    
    set rss.enabled to true in RssShuffleManager
    
    ### Why are the changes needed?
    
    Fix: #2192
    
    ### Does this PR introduce _any_ user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    Neen't
---
 .../spark3/src/main/java/org/apache/spark/shuffle/RssShuffleManager.java | 1 +
 1 file changed, 1 insertion(+)

diff --git 
a/client-spark/spark3/src/main/java/org/apache/spark/shuffle/RssShuffleManager.java
 
b/client-spark/spark3/src/main/java/org/apache/spark/shuffle/RssShuffleManager.java
index eb724484d..70369f503 100644
--- 
a/client-spark/spark3/src/main/java/org/apache/spark/shuffle/RssShuffleManager.java
+++ 
b/client-spark/spark3/src/main/java/org/apache/spark/shuffle/RssShuffleManager.java
@@ -174,6 +174,7 @@ public class RssShuffleManager extends 
RssShuffleManagerBase {
     // External shuffle service is not supported when using remote shuffle 
service
     sparkConf.set("spark.shuffle.service.enabled", "false");
     sparkConf.set("spark.dynamicAllocation.shuffleTracking.enabled", "false");
+    sparkConf.set(RssSparkConfig.RSS_ENABLED.key(), "true");
     LOG.info("Disable external shuffle service in RssShuffleManager.");
     sparkConf.set("spark.sql.adaptive.localShuffleReader.enabled", "false");
     LOG.info("Disable local shuffle reader in RssShuffleManager.");