[jira] [Assigned] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

[ https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45576: --- Assignee: Hasnain Lakhani > [CORE] Remove unnecessary debug logs in Reloadi

[jira] [Assigned] (SPARK-45534) Use `java.lang.ref.Cleaner` instead of `finalize` for `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-45534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45534: --- Assignee: Min Zhao > Use `java.lang.ref.Cleaner` instead of `finalize` for

[jira] [Resolved] (SPARK-45534) Use `java.lang.ref.Cleaner` instead of `finalize` for `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-45534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45534. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 433

[jira] [Created] (SPARK-45613) Expose DeterministicLevel as a DeveloperApi

Mridul Muralidharan created SPARK-45613: --- Summary: Expose DeterministicLevel as a DeveloperApi Key: SPARK-45613 URL: https://issues.apache.org/jira/browse/SPARK-45613 Project: Spark Iss

[jira] [Resolved] (SPARK-45541) [CORE] Add SSLFactory

[ https://issues.apache.org/jira/browse/SPARK-45541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45541. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 433

[jira] [Resolved] (SPARK-45545) [CORE] Pass SSLOptions wherever we create a SparkTransportConf

[ https://issues.apache.org/jira/browse/SPARK-45545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45545. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 433

[jira] [Assigned] (SPARK-45545) [CORE] Pass SSLOptions wherever we create a SparkTransportConf

[ https://issues.apache.org/jira/browse/SPARK-45545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45545: --- Assignee: Hasnain Lakhani > [CORE] Pass SSLOptions wherever we create a Spa

[jira] [Assigned] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45544: --- Assignee: Hasnain Lakhani > [CORE] Integrate SSL support into TransportCont

[jira] [Resolved] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45544. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 435

[jira] [Resolved] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45730. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 435

[jira] [Assigned] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45730: --- Assignee: Hasnain Lakhani > [CORE] Make ReloadingX509TrustManagerSuite less

[jira] [Assigned] (SPARK-45431) [DOCS] Document SSL RPC feature

[ https://issues.apache.org/jira/browse/SPARK-45431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45431: --- Assignee: Hasnain Lakhani > [DOCS] Document SSL RPC feature > -

[jira] [Resolved] (SPARK-45431) [DOCS] Document SSL RPC feature

[ https://issues.apache.org/jira/browse/SPARK-45431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45431. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 432

[jira] [Resolved] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44937. - Fix Version/s: (was: 3.4.2) (was: 3.5.1)

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-44937: Epic Name: ssl/tls for rpc and shuffle > [umbrella] Add SSL/TLS support for RPC an

[jira] [Resolved] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45911. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 438

[jira] [Assigned] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45911: --- Assignee: Hasnain Lakhani > [CORE] Make TLS1.3 the default for RPC SSL supp

[jira] [Commented] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786076#comment-17786076 ] Mridul Muralidharan commented on SPARK-44937: - Thanks [~dongjoon] ! Missed o

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786077#comment-17786077 ] Mridul Muralidharan commented on SPARK-30602: - @MasterDDT, currently there i

[jira] [Comment Edited] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786077#comment-17786077 ] Mridul Muralidharan edited comment on SPARK-30602 at 11/14/23 8:50 PM: ---

[jira] [Resolved] (SPARK-45762) Shuffle managers defined in user jars are not available for some launch modes

[ https://issues.apache.org/jira/browse/SPARK-45762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45762. - Resolution: Fixed Issue resolved by pull request 43627 [https://github.com/apach

[jira] [Assigned] (SPARK-45762) Shuffle managers defined in user jars are not available for some launch modes

[ https://issues.apache.org/jira/browse/SPARK-45762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45762: --- Assignee: Alessandro Bellina > Shuffle managers defined in user jars are no

[jira] [Assigned] (SPARK-40622) Result of a single task in collect() must fit in 2GB

[ https://issues.apache.org/jira/browse/SPARK-40622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40622: --- Assignee: Ziqi Liu > Result of a single task in collect() must fit in 2GB >

[jira] [Resolved] (SPARK-40622) Result of a single task in collect() must fit in 2GB

[ https://issues.apache.org/jira/browse/SPARK-40622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40622. - Fix Version/s: 3.4.0 Resolution: Fixed > Result of a single task in colle

[jira] [Assigned] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40979: --- Assignee: Zhongwei Zhu > Keep removed executor info in decommission state >

[jira] [Resolved] (SPARK-40979) Keep removed executor info in decommission state

[ https://issues.apache.org/jira/browse/SPARK-40979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40979. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 384

[jira] [Assigned] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

[ https://issues.apache.org/jira/browse/SPARK-40872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40872: --- Assignee: gaoyajun02 > Fallback to original shuffle block when a push-merge

[jira] [Resolved] (SPARK-40872) Fallback to original shuffle block when a push-merged shuffle chunk is zero-size

[ https://issues.apache.org/jira/browse/SPARK-40872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40872. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 383

[jira] [Resolved] (SPARK-40987) Avoid creating a directory when deleting a block, causing DAGScheduler to not work

[ https://issues.apache.org/jira/browse/SPARK-40987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40987. - Fix Version/s: 3.3.2 3.2.3 3.4.0 Res

[jira] [Assigned] (SPARK-40987) Avoid creating a directory when deleting a block, causing DAGScheduler to not work

[ https://issues.apache.org/jira/browse/SPARK-40987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40987: --- Assignee: dzcxzl > Avoid creating a directory when deleting a block, causin

[jira] [Assigned] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41187: --- Assignee: wineternity > [Core] LiveExecutor MemoryLeak in AppStatusListener

[jira] [Resolved] (SPARK-41187) [Core] LiveExecutor MemoryLeak in AppStatusListener when ExecutorLost happen

[ https://issues.apache.org/jira/browse/SPARK-41187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41187. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > [Core]

[jira] [Assigned] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41360: --- Assignee: wuyi > Avoid BlockManager re-registration if the executor has bee

[jira] [Resolved] (SPARK-41360) Avoid BlockManager re-registration if the executor has been lost

[ https://issues.apache.org/jira/browse/SPARK-41360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41360. - Fix Version/s: 3.2.4 3.3.2 3.4.0 Res

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646477#comment-17646477 ] Mridul Muralidharan commented on SPARK-41497: - Agree - there appears to be a

[jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646477#comment-17646477 ] Mridul Muralidharan edited comment on SPARK-41497 at 12/13/22 7:41 AM: ---

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646825#comment-17646825 ] Mridul Muralidharan commented on SPARK-41497: - > For example, a task is cons

[jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646825#comment-17646825 ] Mridul Muralidharan edited comment on SPARK-41497 at 12/13/22 9:20 PM: ---

[jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646825#comment-17646825 ] Mridul Muralidharan edited comment on SPARK-41497 at 12/13/22 9:20 PM: ---

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646962#comment-17646962 ] Mridul Muralidharan commented on SPARK-41497: - Agree, if we can determine th

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646972#comment-17646972 ] Mridul Muralidharan commented on SPARK-41497: - [~Ngone51] Agree, that is wha

[jira] [Comment Edited] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646972#comment-17646972 ] Mridul Muralidharan edited comment on SPARK-41497 at 12/14/22 8:03 AM: ---

[jira] [Resolved] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41192. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 387

[jira] [Assigned] (SPARK-41192) Task finished before speculative task scheduled leads to holding idle executors

[ https://issues.apache.org/jira/browse/SPARK-41192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41192: --- Assignee: Yazhi Wang > Task finished before speculative task scheduled lead

[jira] [Assigned] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41469: --- Assignee: wuyi > Task rerun on decommissioned executor can be avoided if sh

[jira] [Resolved] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41469. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 390

[jira] [Created] (SPARK-41792) Shuffle merge finalization removes the wrong finalization state from the DB

Mridul Muralidharan created SPARK-41792: --- Summary: Shuffle merge finalization removes the wrong finalization state from the DB Key: SPARK-41792 URL: https://issues.apache.org/jira/browse/SPARK-41792

[jira] [Updated] (SPARK-41792) Shuffle merge finalization removes the wrong finalization state from the DB

[ https://issues.apache.org/jira/browse/SPARK-41792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-41792: Affects Version/s: (was: 3.3.0) > Shuffle merge finalization removes the wrong

[jira] [Resolved] (SPARK-41792) Shuffle merge finalization removes the wrong finalization state from the DB

[ https://issues.apache.org/jira/browse/SPARK-41792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41792. - Fix Version/s: 3.4.0 Assignee: Mridul Muralidharan Resolution: Fi

[jira] [Commented] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17654590#comment-17654590 ] Mridul Muralidharan commented on SPARK-41497: - Sounds good [~Ngone51], thank

[jira] [Resolved] (SPARK-36620) Client side related push-based shuffle metrics

[ https://issues.apache.org/jira/browse/SPARK-36620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-36620. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 361

[jira] [Assigned] (SPARK-36620) Client side related push-based shuffle metrics

[ https://issues.apache.org/jira/browse/SPARK-36620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-36620: --- Assignee: Thejdeep Gudivada > Client side related push-based shuffle metric

[jira] [Commented] (SPARK-41953) Shuffle output location refetch during shuffle migration in decommission

[ https://issues.apache.org/jira/browse/SPARK-41953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656480#comment-17656480 ] Mridul Muralidharan commented on SPARK-41953: - A few things: * Looking at

[jira] [Comment Edited] (SPARK-41953) Shuffle output location refetch during shuffle migration in decommission

[ https://issues.apache.org/jira/browse/SPARK-41953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656480#comment-17656480 ] Mridul Muralidharan edited comment on SPARK-41953 at 1/10/23 7:48 AM:

[jira] [Assigned] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-33573: --- Assignee: Minchu Yang > Server side metrics related to push-based shuffle >

[jira] [Resolved] (SPARK-33573) Server side metrics related to push-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-33573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-33573. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 376

[jira] [Resolved] (SPARK-40480) Remove push-based shuffle data after query finished

[ https://issues.apache.org/jira/browse/SPARK-40480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40480. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 379

[jira] [Assigned] (SPARK-40480) Remove push-based shuffle data after query finished

[ https://issues.apache.org/jira/browse/SPARK-40480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-40480: --- Assignee: Wan Kun > Remove push-based shuffle data after query finished > -

[jira] [Assigned] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41415: --- Assignee: Aravind Patnam > SASL Request Retries > > >

[jira] [Resolved] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41415. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 389

[jira] [Assigned] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41415: --- Assignee: Aravind Patnam (was: Aravind Patnam) > SASL Request Retries > --

[jira] [Assigned] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42090: --- Assignee: Ted Yu > Introduce sasl retry count in RetryingBlockTransferor >

[jira] [Resolved] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42090. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 396

[jira] [Updated] (SPARK-41415) SASL Request Retries

[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-41415: Fix Version/s: 3.2.4 3.3.2 > SASL Request Retries > ---

[jira] [Assigned] (SPARK-42149) Remove the env `SPARK_USE_CONC_INCR_GC` used to enable CMS GC for Yarn AM

[ https://issues.apache.org/jira/browse/SPARK-42149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42149: --- Assignee: Yang Jie > Remove the env `SPARK_USE_CONC_INCR_GC` used to enable

[jira] [Resolved] (SPARK-42149) Remove the env `SPARK_USE_CONC_INCR_GC` used to enable CMS GC for Yarn AM

[ https://issues.apache.org/jira/browse/SPARK-42149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42149. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 396

[jira] [Updated] (SPARK-42090) Introduce sasl retry count in RetryingBlockTransferor

[ https://issues.apache.org/jira/browse/SPARK-42090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-42090: Fix Version/s: 3.2.4 3.3.2 > Introduce sasl retry count in Retr

[jira] [Resolved] (SPARK-42366) Log shuffle data corruption diagnose cause

[ https://issues.apache.org/jira/browse/SPARK-42366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-42366. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 399

[jira] [Assigned] (SPARK-42366) Log shuffle data corruption diagnose cause

[ https://issues.apache.org/jira/browse/SPARK-42366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-42366: --- Assignee: dzcxzl > Log shuffle data corruption diagnose cause > ---

[jira] [Comment Edited] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516411#comment-16516411 ] Mridul Muralidharan edited comment on SPARK-24375 at 6/18/18 10:15 PM: ---

[jira] [Commented] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516411#comment-16516411 ] Mridul Muralidharan commented on SPARK-24375: - [~jiangxb1987] A couple of c

[jira] [Comment Edited] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16516411#comment-16516411 ] Mridul Muralidharan edited comment on SPARK-24375 at 6/18/18 10:17 PM: ---

[jira] [Created] (SPARK-24755) Executor loss can cause task to be not resubmitted

Mridul Muralidharan created SPARK-24755: --- Summary: Executor loss can cause task to be not resubmitted Key: SPARK-24755 URL: https://issues.apache.org/jira/browse/SPARK-24755 Project: Spark

[jira] [Updated] (SPARK-24755) Executor loss can cause task to be not resubmitted

[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24755: Description: As part of SPARK-22074, when an executor is lost, TSM.executorLost cu

[jira] [Updated] (SPARK-24755) Executor loss can cause task to not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24755: Summary: Executor loss can cause task to not be resubmitted (was: Executor loss c

[jira] [Updated] (SPARK-24755) Executor loss can cause task to not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24755: Description: As part of SPARK-22074, when an executor is lost, TSM.executorLost cu

[jira] [Commented] (SPARK-24755) Executor loss can cause task to not be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-24755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16536016#comment-16536016 ] Mridul Muralidharan commented on SPARK-24755: - Go for it - thanks [~hthuynh2

[jira] [Commented] (SPARK-24615) Accelerator-aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16551198#comment-16551198 ] Mridul Muralidharan commented on SPARK-24615: - [~tgraves] This was indeed a

[jira] [Commented] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568664#comment-16568664 ] Mridul Muralidharan commented on SPARK-24375: - {quote} It's not desired beha

[jira] [Commented] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569363#comment-16569363 ] Mridul Muralidharan commented on SPARK-24375: - {quote} We've thought hard on

[jira] [Comment Edited] (SPARK-24375) Design sketch: support barrier scheduling in Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-24375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569363#comment-16569363 ] Mridul Muralidharan edited comment on SPARK-24375 at 8/5/18 4:42 AM: -

[jira] [Updated] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-24948: Fix Version/s: 2.4.0 > SHS filters wrongly some applications due to permission che

[jira] [Resolved] (SPARK-24948) SHS filters wrongly some applications due to permission check

[ https://issues.apache.org/jira/browse/SPARK-24948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-24948. - Resolution: Fixed > SHS filters wrongly some applications due to permission chec

[jira] [Created] (SPARK-23717) Leverage docker support in Hadoop 3

Mridul Muralidharan created SPARK-23717: --- Summary: Leverage docker support in Hadoop 3 Key: SPARK-23717 URL: https://issues.apache.org/jira/browse/SPARK-23717 Project: Spark Issue Type:

[jira] [Created] (SPARK-23718) Document using docker in host networking mode in hadoop 3

Mridul Muralidharan created SPARK-23718: --- Summary: Document using docker in host networking mode in hadoop 3 Key: SPARK-23718 URL: https://issues.apache.org/jira/browse/SPARK-23718 Project: Spark

[jira] [Updated] (SPARK-23718) Document using docker in host networking mode in hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-23718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-23718: Issue Type: Task (was: Improvement) > Document using docker in host networking mod

[jira] [Updated] (SPARK-23718) Document using docker in host networking mode in hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-23718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-23718: Issue Type: Improvement (was: Documentation) > Document using docker in host netwo

[jira] [Created] (SPARK-23719) Use correct hostname in non-host networking mode in hadoop 3 docker support

Mridul Muralidharan created SPARK-23719: --- Summary: Use correct hostname in non-host networking mode in hadoop 3 docker support Key: SPARK-23719 URL: https://issues.apache.org/jira/browse/SPARK-23719

[jira] [Updated] (SPARK-23718) Document using docker in host networking mode in hadoop 3

[ https://issues.apache.org/jira/browse/SPARK-23718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-23718: Issue Type: Documentation (was: Task) > Document using docker in host networking m

[jira] [Created] (SPARK-23720) Leverage shuffle service when running in non-host networking mode in hadoop 3 docker support

Mridul Muralidharan created SPARK-23720: --- Summary: Leverage shuffle service when running in non-host networking mode in hadoop 3 docker support Key: SPARK-23720 URL: https://issues.apache.org/jira/browse/SPA

[jira] [Created] (SPARK-23721) Use actual node's hostname for host and rack locality computation

Mridul Muralidharan created SPARK-23721: --- Summary: Use actual node's hostname for host and rack locality computation Key: SPARK-23721 URL: https://issues.apache.org/jira/browse/SPARK-23721 Proje

[jira] [Updated] (SPARK-23721) Enhance BlockManagerId to include container's underlying host name

[ https://issues.apache.org/jira/browse/SPARK-23721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-23721: Summary: Enhance BlockManagerId to include container's underlying host name (was:

[jira] [Updated] (SPARK-23721) Enhance BlockManagerId to include container's underlying host machie hostname

[ https://issues.apache.org/jira/browse/SPARK-23721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-23721: Summary: Enhance BlockManagerId to include container's underlying host machie hostn

[jira] [Updated] (SPARK-23721) Enhance BlockManagerId to include container's underlying host machine hostname

[ https://issues.apache.org/jira/browse/SPARK-23721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-23721: Summary: Enhance BlockManagerId to include container's underlying host machine host

[jira] [Assigned] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-21549: --- Assignee: Sergey Zhemzhitsky > Spark fails to complete job correctly in case

[jira] [Resolved] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-22866. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 2005

[jira] [Updated] (SPARK-22866) Kubernetes dockerfile path needs update

[ https://issues.apache.org/jira/browse/SPARK-22866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-22866: Fix Version/s: (was: 3.0.0) 2.3.0 > Kubernetes dockerfile pa

[jira] [Resolved] (SPARK-22465) Cogroup of two disproportionate RDDs could lead into 2G limit BUG

[ https://issues.apache.org/jira/browse/SPARK-22465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-22465. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 2000

[jira] [Commented] (SPARK-22903) AlreadyBeingCreatedException in stage retry caused by wrong attemptNumber

[ https://issues.apache.org/jira/browse/SPARK-22903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306583#comment-16306583 ] Mridul Muralidharan commented on SPARK-22903: - [~imranr] I agree that SPARK-2

[jira] [Resolved] (SPARK-25594) OOM in long running applications even with UI disabled

[ https://issues.apache.org/jira/browse/SPARK-25594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-25594. - Resolution: Won't Fix > OOM in long running applications even with UI disabled >

<    1   2   3   4   5   6   7   >