[jira] [Assigned] (SPARK-49502) Avoid NPE in SparkEnv.get.shuffleManager.unregisterShuffle

[ https://issues.apache.org/jira/browse/SPARK-49502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-49502: --- Assignee: dzcxzl > Avoid NPE in SparkEnv.get.shuffleManager.unregisterShuff

[jira] [Resolved] (SPARK-49217) Support separate buffer size configuration in UnsafeShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-49217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-49217. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 477

[jira] [Assigned] (SPARK-49217) Support separate buffer size configuration in UnsafeShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-49217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-49217: --- Assignee: dzcxzl > Support separate buffer size configuration in UnsafeShuf

[jira] [Assigned] (SPARK-49268) Log IO exceptions in SHS history provider

[ https://issues.apache.org/jira/browse/SPARK-49268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-49268: --- Assignee: Rob Reeves > Log IO exceptions in SHS history provider >

[jira] [Resolved] (SPARK-49268) Log IO exceptions in SHS history provider

[ https://issues.apache.org/jira/browse/SPARK-49268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-49268. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 477

[jira] [Resolved] (SPARK-48928) Log Warning for Calling .unpersist() on Locally Checkpointed RDDs

[ https://issues.apache.org/jira/browse/SPARK-48928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-48928. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 473

[jira] [Resolved] (SPARK-47910) Memory leak when interrupting shuffle write using zstd compression

[ https://issues.apache.org/jira/browse/SPARK-47910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-47910. - Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue res

[jira] [Assigned] (SPARK-47910) Memory leak when interrupting shuffle write using zstd compression

[ https://issues.apache.org/jira/browse/SPARK-47910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-47910: --- Assignee: JacobZheng > Memory leak when interrupting shuffle write using zs

[jira] [Updated] (SPARK-47919) credulousTrustStoreManagers should return empty array for accepted issuers

[ https://issues.apache.org/jira/browse/SPARK-47919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-47919: Priority: Minor (was: Major) > credulousTrustStoreManagers should return empty ar

[jira] [Created] (SPARK-47919) credulousTrustStoreManagers should return empty array for accepted issuers

Mridul Muralidharan created SPARK-47919: --- Summary: credulousTrustStoreManagers should return empty array for accepted issuers Key: SPARK-47919 URL: https://issues.apache.org/jira/browse/SPARK-47919

[jira] [Comment Edited] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838474#comment-17838474 ] Mridul Muralidharan edited comment on SPARK-47172 at 4/18/24 5:47 AM:

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17838474#comment-17838474 ] Mridul Muralidharan commented on SPARK-47172: - We do not backport features t

[jira] [Commented] (SPARK-47172) Upgrade Transport block cipher mode to GCM

[ https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837927#comment-17837927 ] Mridul Muralidharan commented on SPARK-47172: - Given we have addressed SPARK

[jira] [Assigned] (SPARK-47253) Allow LiveEventBus to stop without the completely draining of event queue

[ https://issues.apache.org/jira/browse/SPARK-47253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-47253: --- Assignee: TakawaAkirayo > Allow LiveEventBus to stop without the completely

[jira] [Resolved] (SPARK-47253) Allow LiveEventBus to stop without the completely draining of event queue

[ https://issues.apache.org/jira/browse/SPARK-47253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-47253. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 453

[jira] [Updated] (SPARK-47318) AuthEngine key exchange needs additional KDF round

[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-47318: Affects Version/s: 3.5.0 3.4.0 > AuthEngine key exchange n

[jira] [Resolved] (SPARK-47318) AuthEngine key exchange needs additional KDF round

[ https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-47318. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 454

[jira] [Comment Edited] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835587#comment-17835587 ] Mridul Muralidharan edited comment on SPARK-47759 at 4/10/24 4:08 AM:

[jira] [Comment Edited] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835587#comment-17835587 ] Mridul Muralidharan edited comment on SPARK-47759 at 4/10/24 4:08 AM:

[jira] [Commented] (SPARK-47759) Apps being stuck after JavaUtils.timeStringAs fails to parse a legitimate time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17835587#comment-17835587 ] Mridul Muralidharan commented on SPARK-47759: - In order to validate, I would

[jira] [Assigned] (SPARK-45375) [CORE] Mark connection as timedOut in TransportClient.close

[ https://issues.apache.org/jira/browse/SPARK-45375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45375: --- Assignee: Hasnain Lakhani > [CORE] Mark connection as timedOut in Transport

[jira] [Comment Edited] (SPARK-45374) [CORE] Add test keys for SSL functionality

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828087#comment-17828087 ] Mridul Muralidharan edited comment on SPARK-45374 at 3/18/24 8:28 PM:

[jira] [Assigned] (SPARK-45374) [CORE] Add test keys for SSL functionality

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45374: --- Assignee: Hasnain Lakhani > [CORE] Add test keys for SSL functionality > --

[jira] [Comment Edited] (SPARK-45374) [CORE] Add test keys for SSL functionality

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828087#comment-17828087 ] Mridul Muralidharan edited comment on SPARK-45374 at 3/18/24 8:05 PM:

[jira] [Commented] (SPARK-45374) [CORE] Add test keys for SSL functionality

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828087#comment-17828087 ] Mridul Muralidharan commented on SPARK-45374: - Missed your query, you can li

[jira] [Updated] (SPARK-47146) Possible thread leak when doing sort merge join

[ https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-47146: Fix Version/s: 3.5.2 3.4.3 > Possible thread leak when doing so

[jira] [Commented] (SPARK-47146) Possible thread leak when doing sort merge join

[ https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823832#comment-17823832 ] Mridul Muralidharan commented on SPARK-47146: - Backported to 3.5 and 3.4 in

[jira] [Assigned] (SPARK-47146) Possible thread leak when doing sort merge join

[ https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-47146: --- Assignee: JacobZheng > Possible thread leak when doing sort merge join > --

[jira] [Resolved] (SPARK-47146) Possible thread leak when doing sort merge join

[ https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-47146. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 453

[jira] [Resolved] (SPARK-46512) Optimize shuffle reading when both sort and combine are used.

[ https://issues.apache.org/jira/browse/SPARK-46512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46512. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 445

[jira] [Assigned] (SPARK-46512) Optimize shuffle reading when both sort and combine are used.

[ https://issues.apache.org/jira/browse/SPARK-46512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46512: --- Assignee: Chenyu Zheng > Optimize shuffle reading when both sort and combin

[jira] [Assigned] (SPARK-46733) Simplify the ContextCleaner|BlockManager by the exit operation only depend on interrupt thread

[ https://issues.apache.org/jira/browse/SPARK-46733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46733: --- Assignee: Jiaan Geng > Simplify the ContextCleaner|BlockManager by the exit

[jira] [Resolved] (SPARK-46733) Simplify the ContextCleaner|BlockManager by the exit operation only depend on interrupt thread

[ https://issues.apache.org/jira/browse/SPARK-46733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46733. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 447

[jira] [Commented] (SPARK-46623) Replace SimpleDateFormat with DateTimeFormatter

[ https://issues.apache.org/jira/browse/SPARK-46623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17808080#comment-17808080 ] Mridul Muralidharan commented on SPARK-46623: - Issue resolved by pull reques

[jira] [Resolved] (SPARK-46623) Replace SimpleDateFormat with DateTimeFormatter

[ https://issues.apache.org/jira/browse/SPARK-46623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46623. - Fix Version/s: 4.0.0 Assignee: Jiaan Geng Resolution: Fixed > Re

[jira] [Resolved] (SPARK-46696) In ResourceProfileManager, function calls should occur after variable declarations.

[ https://issues.apache.org/jira/browse/SPARK-46696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46696. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 447

[jira] [Assigned] (SPARK-46696) In ResourceProfileManager, function calls should occur after variable declarations.

[ https://issues.apache.org/jira/browse/SPARK-46696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46696: --- Assignee: liangyongyuan > In ResourceProfileManager, function calls should

[jira] [Assigned] (SPARK-46399) Add exit status to the Application End event for the use of Spark Listener

[ https://issues.apache.org/jira/browse/SPARK-46399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46399: --- Assignee: Reza Safi > Add exit status to the Application End event for the

[jira] [Resolved] (SPARK-46399) Add exit status to the Application End event for the use of Spark Listener

[ https://issues.apache.org/jira/browse/SPARK-46399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46399. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 443

[jira] [Resolved] (SPARK-46132) [CORE] Support key password for JKS keys for RPC SSL

[ https://issues.apache.org/jira/browse/SPARK-46132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46132. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 442

[jira] [Assigned] (SPARK-46132) [CORE] Support key password for JKS keys for RPC SSL

[ https://issues.apache.org/jira/browse/SPARK-46132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46132: --- Assignee: Hasnain Lakhani > [CORE] Support key password for JKS keys for RP

[jira] [Updated] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-46058: Labels: pull-request-available (was: pull-request-available releasenotes) > [CORE

[jira] [Updated] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-46058: Labels: pull-request-available releasenotes (was: pull-request-available) > [CORE

[jira] [Resolved] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46058. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 439

[jira] [Assigned] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46058: --- Assignee: Hasnain Lakhani > [CORE] Add separate flag for privateKeyPassword

[jira] [Assigned] (SPARK-45762) Shuffle managers defined in user jars are not available for some launch modes

[ https://issues.apache.org/jira/browse/SPARK-45762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45762: --- Assignee: Alessandro Bellina > Shuffle managers defined in user jars are no

[jira] [Resolved] (SPARK-45762) Shuffle managers defined in user jars are not available for some launch modes

[ https://issues.apache.org/jira/browse/SPARK-45762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45762. - Resolution: Fixed Issue resolved by pull request 43627 [https://github.com/apach

[jira] [Comment Edited] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786077#comment-17786077 ] Mridul Muralidharan edited comment on SPARK-30602 at 11/14/23 8:50 PM: ---

[jira] [Commented] (SPARK-30602) SPIP: Support push-based shuffle to improve shuffle efficiency

[ https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786077#comment-17786077 ] Mridul Muralidharan commented on SPARK-30602: - @MasterDDT, currently there i

[jira] [Commented] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17786076#comment-17786076 ] Mridul Muralidharan commented on SPARK-44937: - Thanks [~dongjoon] ! Missed o

[jira] [Assigned] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45911: --- Assignee: Hasnain Lakhani > [CORE] Make TLS1.3 the default for RPC SSL supp

[jira] [Resolved] (SPARK-45911) [CORE] Make TLS1.3 the default for RPC SSL support

[ https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45911. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 438

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-44937: Epic Name: ssl/tls for rpc and shuffle > [umbrella] Add SSL/TLS support for RPC an

[jira] [Resolved] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44937. - Fix Version/s: (was: 3.4.2) (was: 3.5.1)

[jira] [Resolved] (SPARK-45431) [DOCS] Document SSL RPC feature

[ https://issues.apache.org/jira/browse/SPARK-45431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45431. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 432

[jira] [Assigned] (SPARK-45431) [DOCS] Document SSL RPC feature

[ https://issues.apache.org/jira/browse/SPARK-45431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45431: --- Assignee: Hasnain Lakhani > [DOCS] Document SSL RPC feature > -

[jira] [Assigned] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45730: --- Assignee: Hasnain Lakhani > [CORE] Make ReloadingX509TrustManagerSuite less

[jira] [Resolved] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45730. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 435

[jira] [Resolved] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45544. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 435

[jira] [Assigned] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45544: --- Assignee: Hasnain Lakhani > [CORE] Integrate SSL support into TransportCont

[jira] [Assigned] (SPARK-45545) [CORE] Pass SSLOptions wherever we create a SparkTransportConf

[ https://issues.apache.org/jira/browse/SPARK-45545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45545: --- Assignee: Hasnain Lakhani > [CORE] Pass SSLOptions wherever we create a Spa

[jira] [Resolved] (SPARK-45545) [CORE] Pass SSLOptions wherever we create a SparkTransportConf

[ https://issues.apache.org/jira/browse/SPARK-45545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45545. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 433

[jira] [Resolved] (SPARK-45541) [CORE] Add SSLFactory

[ https://issues.apache.org/jira/browse/SPARK-45541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45541. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 433

[jira] [Created] (SPARK-45613) Expose DeterministicLevel as a DeveloperApi

Mridul Muralidharan created SPARK-45613: --- Summary: Expose DeterministicLevel as a DeveloperApi Key: SPARK-45613 URL: https://issues.apache.org/jira/browse/SPARK-45613 Project: Spark Iss

[jira] [Resolved] (SPARK-45534) Use `java.lang.ref.Cleaner` instead of `finalize` for `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-45534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45534. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 433

[jira] [Assigned] (SPARK-45534) Use `java.lang.ref.Cleaner` instead of `finalize` for `RemoteBlockPushResolver`

[ https://issues.apache.org/jira/browse/SPARK-45534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45534: --- Assignee: Min Zhao > Use `java.lang.ref.Cleaner` instead of `finalize` for

[jira] [Assigned] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

[ https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45576: --- Assignee: Hasnain Lakhani > [CORE] Remove unnecessary debug logs in Reloadi

[jira] [Resolved] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

[ https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45576. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 434

[jira] [Resolved] (SPARK-45429) [CORE] Add helper classes for RPC SSL communication

[ https://issues.apache.org/jira/browse/SPARK-45429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45429. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 432

[jira] [Assigned] (SPARK-45429) [CORE] Add helper classes for RPC SSL communication

[ https://issues.apache.org/jira/browse/SPARK-45429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45429: --- Assignee: Hasnain Lakhani > [CORE] Add helper classes for RPC SSL communica

[jira] [Resolved] (SPARK-45427) [CORE] Add RPC SSL settings to SSLOptions and SparkTransportConf

[ https://issues.apache.org/jira/browse/SPARK-45427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45427. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 432

[jira] [Assigned] (SPARK-45427) [CORE] Add RPC SSL settings to SSLOptions and SparkTransportConf

[ https://issues.apache.org/jira/browse/SPARK-45427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45427: --- Assignee: Hasnain Lakhani > [CORE] Add RPC SSL settings to SSLOptions and S

[jira] [Assigned] (SPARK-45426) [CORE] Add support for a ReloadingTrustManager

[ https://issues.apache.org/jira/browse/SPARK-45426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45426: --- Assignee: Hasnain Lakhani > [CORE] Add support for a ReloadingTrustManager

[jira] [Resolved] (SPARK-45426) [CORE] Add support for a ReloadingTrustManager

[ https://issues.apache.org/jira/browse/SPARK-45426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45426. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 432

[jira] [Assigned] (SPARK-45408) [CORE] Add RPC SSL settings to TransportConf

[ https://issues.apache.org/jira/browse/SPARK-45408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45408: --- Assignee: Hasnain Lakhani > [CORE] Add RPC SSL settings to TransportConf >

[jira] [Resolved] (SPARK-45408) [CORE] Add RPC SSL settings to TransportConf

[ https://issues.apache.org/jira/browse/SPARK-45408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45408. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 432

[jira] [Resolved] (SPARK-45283) Make StatusTrackerSuite less fragile

[ https://issues.apache.org/jira/browse/SPARK-45283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45283. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 431

[jira] [Assigned] (SPARK-45283) Make StatusTrackerSuite less fragile

[ https://issues.apache.org/jira/browse/SPARK-45283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45283: --- Assignee: Bo Xiong > Make StatusTrackerSuite less fragile > ---

[jira] [Assigned] (SPARK-45376) [CORE] Add netty-tcnative-boringssl-static dependency

[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45376: --- Assignee: Hasnain Lakhani > [CORE] Add netty-tcnative-boringssl-static depe

[jira] [Resolved] (SPARK-45376) [CORE] Add netty-tcnative-boringssl-static dependency

[ https://issues.apache.org/jira/browse/SPARK-45376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45376. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 431

[jira] [Assigned] (SPARK-45250) Support stage level task resource profile for yarn cluster when dynamic allocation disabled

[ https://issues.apache.org/jira/browse/SPARK-45250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45250: --- Assignee: Bobby Wang > Support stage level task resource profile for yarn c

[jira] [Resolved] (SPARK-45250) Support stage level task resource profile for yarn cluster when dynamic allocation disabled

[ https://issues.apache.org/jira/browse/SPARK-45250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45250. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 430

[jira] [Resolved] (SPARK-45378) [CORE] Add convertToNettyForSsl to ManagedBuffer

[ https://issues.apache.org/jira/browse/SPARK-45378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45378. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 431

[jira] [Assigned] (SPARK-45378) [CORE] Add convertToNettyForSsl to ManagedBuffer

[ https://issues.apache.org/jira/browse/SPARK-45378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45378: --- Assignee: Hasnain Lakhani > [CORE] Add convertToNettyForSsl to ManagedBuffe

[jira] [Updated] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-45227: Fix Version/s: 3.3.4 > Fix a subtle thread-safety issue with CoarseGrainedExecutor

[jira] [Closed] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan closed SPARK-45227. --- > Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an > executo

[jira] [Assigned] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45227: --- Assignee: Bo Xiong > Fix a subtle thread-safety issue with CoarseGrainedExe

[jira] [Resolved] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45227. - Resolution: Fixed > Fix a subtle thread-safety issue with CoarseGrainedExecutorB

[jira] [Updated] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-45227: Fix Version/s: 3.4.2 4.0.0 3.5.1 > Fix a sub

[jira] [Assigned] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45057: --- Assignee: Zhongwei Zhu > Deadlock caused by rdd replication level of 2 > --

[jira] [Resolved] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45057. - Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Resolved] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44937. - Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Assigned] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44937: --- Assignee: Hasnain Lakhani > Add SSL/TLS support for RPC and Shuffle communi

[jira] [Resolved] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44756. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 424

[jira] [Assigned] (SPARK-44756) Executor hangs when RetryingBlockTransferor fails to initiate retry

[ https://issues.apache.org/jira/browse/SPARK-44756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44756: --- Assignee: Harunobu Daikoku > Executor hangs when RetryingBlockTransferor fa

[jira] [Resolved] (SPARK-44306) Group FileStatus with few RPC calls within Yarn Client

[ https://issues.apache.org/jira/browse/SPARK-44306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44306. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 423

[jira] [Assigned] (SPARK-44306) Group FileStatus with few RPC calls within Yarn Client

[ https://issues.apache.org/jira/browse/SPARK-44306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44306: --- Assignee: SHU WANG > Group FileStatus with few RPC calls within Yarn Client

[jira] [Resolved] (SPARK-44845) spark job copies jars repeatedly if fs.defaultFS and application jar are same url

[ https://issues.apache.org/jira/browse/SPARK-44845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44845. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 425

[jira] [Assigned] (SPARK-44845) spark job copies jars repeatedly if fs.defaultFS and application jar are same url

[ https://issues.apache.org/jira/browse/SPARK-44845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44845: --- Assignee: zheju_he > spark job copies jars repeatedly if fs.defaultFS and a

[jira] [Assigned] (SPARK-44238) Introduce a new readFrom method with byte array input for BloomFilter

[ https://issues.apache.org/jira/browse/SPARK-44238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44238: --- Assignee: Yang Jie > Introduce a new readFrom method with byte array input

  1   2   3   4   5   6   7   >