[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-20 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r975069710 ## core/src/main/scala/org/apache/spark/internal/config/package.scala: ## @@ -2309,7 +2309,18 @@ package object config { " shuffle is enabled.")

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-18 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r973869591 ## core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala: ## @@ -4443,36 +4443,115 @@ class DAGSchedulerSuite extends SparkFunSuite with

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-12 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r969118491 ## core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala: ## @@ -4440,6 +4443,37 @@ class DAGSchedulerSuite extends SparkFunSuite with

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-12 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r969117695 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2242,70 +2249,94 @@ private[spark] class DAGScheduler( val numMergers =

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-03 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r962112740 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2242,70 +2252,110 @@ private[spark] class DAGScheduler( val numMergers =

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-03 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r962111737 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2242,70 +2252,110 @@ private[spark] class DAGScheduler( val numMergers =

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-03 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r962110338 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -282,13 +286,19 @@ private[spark] class DAGScheduler( None } - // Use

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-03 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r962110217 ## core/src/main/scala/org/apache/spark/internal/config/package.scala: ## @@ -2309,7 +2309,16 @@ package object config { " shuffle is enabled.")

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-03 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r962110234 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -282,13 +286,19 @@ private[spark] class DAGScheduler( None } - // Use

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-09-01 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r960777861 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2242,60 +2251,57 @@ private[spark] class DAGScheduler( val numMergers =

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-31 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r959685431 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2242,60 +2251,57 @@ private[spark] class DAGScheduler( val numMergers =

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-31 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r959664178 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2242,60 +2251,57 @@ private[spark] class DAGScheduler( val numMergers =

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-28 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r956839303 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2259,37 +2259,51 @@ private[spark] class DAGScheduler( }

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-26 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r955858394 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2259,37 +2259,51 @@ private[spark] class DAGScheduler( }

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-25 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r955564176 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -282,13 +286,19 @@ private[spark] class DAGScheduler( None } - // Use

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-25 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r954566063 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -282,13 +286,19 @@ private[spark] class DAGScheduler( None } - // Use

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-24 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r954467609 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2259,37 +2259,51 @@ private[spark] class DAGScheduler( }

[GitHub] [spark] wankunde commented on a diff in pull request #37533: [SPARK-40096]Fix finalize shuffle stage slow due to connection creation slow

2022-08-24 Thread GitBox
wankunde commented on code in PR #37533: URL: https://github.com/apache/spark/pull/37533#discussion_r953503909 ## core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala: ## @@ -2259,37 +2266,58 @@ private[spark] class DAGScheduler( }