jerqi commented on code in PR #208:
URL: https://github.com/apache/incubator-uniffle/pull/208#discussion_r967658203
##########
client-spark/spark3/src/main/java/org/apache/spark/shuffle/DelegationRssShuffleManager.java:
##########
@@ -99,13 +103,17 @@ private boolean tryAccessCluster() {
long retryInterval =
sparkConf.get(RssSparkConfig.RSS_CLIENT_ACCESS_RETRY_INTERVAL_MS);
int retryTimes =
sparkConf.get(RssSparkConfig.RSS_CLIENT_ACCESS_RETRY_TIMES);
+ int assignmentShuffleNodesNum =
sparkConf.get(RssSparkConfig.RSS_CLIENT_ASSIGNMENT_SHUFFLE_SERVER_NUMBER);
Review Comment:
Why do we only modify spark3?
##########
common/src/main/java/org/apache/uniffle/common/util/Constants.java:
##########
@@ -43,4 +43,6 @@ public class Constants {
public static final String CONF_REMOTE_STORAGE_PATH = ".remote.storage.path";
public static final String RSS_CLIENT_CONF_REMOTE_STORAGE_PATH =
RSS_CLIENT_CONF_COMMON_PREFIX + CONF_REMOTE_STORAGE_PATH;
+
+ public static final String ACCESS_INFO_REQUIRED_SHUFFLE_NODES_NUM =
"access_info_required_shuffle_nodes_num";
Review Comment:
Why do we need this config option?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
