Chandni Singh created SPARK-39471: ------------------------------------- Summary: ExternalShuffleService port is extracted from the confs everytime a block manager gets registered Key: SPARK-39471 URL: https://issues.apache.org/jira/browse/SPARK-39471 Project: Spark Issue Type: Bug Components: Spark Core Affects Versions: 3.2.0 Reporter: Chandni Singh
We are extracting the shuffle service port from the spark and hadoop configuration with every blockmanager registeration. This could be avoided by using the cached external service port. Also, we should avoid calling addMerger when push-based shuffle is disabled. -- This message was sent by Atlassian Jira (v8.20.7#820007) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org