[GitHub] [spark] manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService

manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService URL: https://github.com/apache/spark/pull/27998#issuecomment-604770550 @Ngone51 PR description has been updated. This

[GitHub] [spark] manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService

manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService URL: https://github.com/apache/spark/pull/27998#issuecomment-604182314 @xuanyuanking @tgravescs Here are detailed timelines of our investigation. 1. We found connections on

[GitHub] [spark] manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService

manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService URL: https://github.com/apache/spark/pull/27998#issuecomment-603832106 Yes, that's what we saw on our cluster. Those channels were idle as clients had closed and not used anymore.

[GitHub] [spark] manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService

manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService URL: https://github.com/apache/spark/pull/27998#issuecomment-603665180 cc @vanzin @xuanyuanking @tgravescs who have worked on this module