[jira] [Updated] (SPARK-45377) [CORE] Handle InputStream in NettyLogger

[ https://issues.apache.org/jira/browse/SPARK-45377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45377: --- Labels: pull-request-available (was: ) > [CORE] Handle InputStream in NettyLogger >

[jira] [Updated] (SPARK-45378) [CORE] Add convertToNettyForSsl to ManagedBuffer

[ https://issues.apache.org/jira/browse/SPARK-45378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45378: --- Labels: pull-request-available (was: ) > [CORE] Add convertToNettyForSsl to ManagedBuffer

[jira] [Closed] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan closed SPARK-45227. --- > Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an >

[jira] [Assigned] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45227: --- Assignee: Bo Xiong > Fix a subtle thread-safety issue with

[jira] [Resolved] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45227. - Resolution: Fixed > Fix a subtle thread-safety issue with

[jira] [Updated] (SPARK-45227) Fix a subtle thread-safety issue with CoarseGrainedExecutorBackend where an executor process randomly gets stuck

[ https://issues.apache.org/jira/browse/SPARK-45227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-45227: Fix Version/s: 3.4.2 4.0.0 3.5.1 > Fix a

[jira] [Assigned] (SPARK-45276) Replace Java 8 and Java 11 installed in the Dockerfile with Java

[ https://issues.apache.org/jira/browse/SPARK-45276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45276: Assignee: BingKun Pan > Replace Java 8 and Java 11 installed in the Dockerfile with Java >

[jira] [Resolved] (SPARK-45276) Replace Java 8 and Java 11 installed in the Dockerfile with Java

[ https://issues.apache.org/jira/browse/SPARK-45276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45276. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43076

[jira] [Assigned] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45057: --- Assignee: Zhongwei Zhu > Deadlock caused by rdd replication level of 2 >

[jira] [Resolved] (SPARK-45057) Deadlock caused by rdd replication level of 2

[ https://issues.apache.org/jira/browse/SPARK-45057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45057. - Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Created] (SPARK-45378) [CORE] Add convertToNettyForSsl to ManagedBuffer

Hasnain Lakhani created SPARK-45378: --- Summary: [CORE] Add convertToNettyForSsl to ManagedBuffer Key: SPARK-45378 URL: https://issues.apache.org/jira/browse/SPARK-45378 Project: Spark Issue

[jira] [Created] (SPARK-45377) [CORE] Handle InputStream in NettyLogger

Hasnain Lakhani created SPARK-45377: --- Summary: [CORE] Handle InputStream in NettyLogger Key: SPARK-45377 URL: https://issues.apache.org/jira/browse/SPARK-45377 Project: Spark Issue Type:

[jira] [Created] (SPARK-45376) [CORE] Add netty-tcnative-boringssl-static dependency

Hasnain Lakhani created SPARK-45376: --- Summary: [CORE] Add netty-tcnative-boringssl-static dependency Key: SPARK-45376 URL: https://issues.apache.org/jira/browse/SPARK-45376 Project: Spark

[jira] [Created] (SPARK-45375) [CORE] Mark connection as timedOut in TransportClient.close

Hasnain Lakhani created SPARK-45375: --- Summary: [CORE] Mark connection as timedOut in TransportClient.close Key: SPARK-45375 URL: https://issues.apache.org/jira/browse/SPARK-45375 Project: Spark

[jira] [Resolved] (SPARK-45374) [CORE] Add test SSL keys

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani resolved SPARK-45374. - Resolution: Fixed Fixed by [https://github.com/apache/spark/pull/43163] [~mridul] /

[jira] [Updated] (SPARK-44895) Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class

[ https://issues.apache.org/jira/browse/SPARK-44895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44895: - Priority: Minor (was: Major) > Considering 'daemon', 'priority' from higher JDKs for

[jira] [Resolved] (SPARK-45375) [CORE] Mark connection as timedOut in TransportClient.close

[ https://issues.apache.org/jira/browse/SPARK-45375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani resolved SPARK-45375. - Resolution: Fixed Resolved by [https://github.com/apache/spark/pull/43162] [~mridul]

[jira] [Updated] (SPARK-45374) [CORE] Add test keys for SSL functionality

[ https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani updated SPARK-45374: Summary: [CORE] Add test keys for SSL functionality (was: [CORE] Add test SSL keys) >

[jira] [Created] (SPARK-45374) [CORE] Add test SSL keys

Hasnain Lakhani created SPARK-45374: --- Summary: [CORE] Add test SSL keys Key: SPARK-45374 URL: https://issues.apache.org/jira/browse/SPARK-45374 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani updated SPARK-44937: Issue Type: Epic (was: New Feature) > [umbrella] Add SSL/TLS support for RPC and Shuffle

[jira] [Updated] (SPARK-44937) [umbrella] Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani updated SPARK-44937: Summary: [umbrella] Add SSL/TLS support for RPC and Shuffle communications (was: Add

[jira] [Reopened] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hasnain Lakhani reopened SPARK-44937: - > Add SSL/TLS support for RPC and Shuffle communications >

[jira] [Resolved] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44937. - Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Assigned] (SPARK-44937) Add SSL/TLS support for RPC and Shuffle communications

[ https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-44937: --- Assignee: Hasnain Lakhani > Add SSL/TLS support for RPC and Shuffle

[jira] [Resolved] (SPARK-44895) Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class

[ https://issues.apache.org/jira/browse/SPARK-44895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44895. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43095

[jira] [Assigned] (SPARK-44895) Considering 'daemon', 'priority' from higher JDKs for ThreadStackTrace class

[ https://issues.apache.org/jira/browse/SPARK-44895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44895: Assignee: Kent Yao > Considering 'daemon', 'priority' from higher JDKs for

[jira] [Updated] (SPARK-42205) Remove logging of Accumulables in Task/Stage start events in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-42205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42205: --- Labels: pull-request-available (was: ) > Remove logging of Accumulables in Task/Stage

[jira] [Resolved] (SPARK-45362) Project out PARTITION BY expressions before 'eval' method consumes input rows

[ https://issues.apache.org/jira/browse/SPARK-45362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-45362. --- Fix Version/s: 4.0.0 Assignee: Daniel Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-45373) Minimizing calls to HiveMetaStore layer for getting partitions, when tables are repeated

[ https://issues.apache.org/jira/browse/SPARK-45373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770220#comment-17770220 ] Asif commented on SPARK-45373: -- Will be generating a PR for this. > Minimizing calls to HiveMetaStore

[jira] [Created] (SPARK-45373) Minimizing calls to HiveMetaStore layer for getting partitions, when tables are repeated

Asif created SPARK-45373: Summary: Minimizing calls to HiveMetaStore layer for getting partitions, when tables are repeated Key: SPARK-45373 URL: https://issues.apache.org/jira/browse/SPARK-45373 Project:

[jira] [Updated] (SPARK-43049) Use CLOB instead of VARCHAR(255) for StringType for Oracle jdbc

[ https://issues.apache.org/jira/browse/SPARK-43049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43049: --- Labels: pull-request-available (was: ) > Use CLOB instead of VARCHAR(255) for StringType

[jira] [Assigned] (SPARK-45365) Allow the daily tests of branch-3.4 to use the new test group tags

[ https://issues.apache.org/jira/browse/SPARK-45365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-45365: Assignee: Yang Jie > Allow the daily tests of branch-3.4 to use the new test group tags >

[jira] [Resolved] (SPARK-45365) Allow the daily tests of branch-3.4 to use the new test group tags

[ https://issues.apache.org/jira/browse/SPARK-45365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-45365. -- Fix Version/s: 4.0.0 Resolution: Fixed > Allow the daily tests of branch-3.4 to use the new

[jira] [Updated] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-36112: --- Labels: pull-request-available (was: ) > Enable DecorrelateInnerQuery for IN/EXISTS

[jira] [Updated] (SPARK-45372) Handle ClassNotFoundException when load extension

[ https://issues.apache.org/jira/browse/SPARK-45372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45372: --- Labels: pull-request-available (was: ) > Handle ClassNotFoundException when load extension

[jira] [Updated] (SPARK-45372) Handle ClassNotFoundException when load extension

[ https://issues.apache.org/jira/browse/SPARK-45372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-45372: - Summary: Handle ClassNotFoundException when load extension (was: Handle ClassNotFound when

[jira] [Created] (SPARK-45372) Handle ClassNotFound when load extension

Zhongwei Zhu created SPARK-45372: Summary: Handle ClassNotFound when load extension Key: SPARK-45372 URL: https://issues.apache.org/jira/browse/SPARK-45372 Project: Spark Issue Type:

[jira] [Created] (SPARK-45371) FIx shading problem in Spark Connect

Herman van Hövell created SPARK-45371: - Summary: FIx shading problem in Spark Connect Key: SPARK-45371 URL: https://issues.apache.org/jira/browse/SPARK-45371 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-45266) Refactor ResolveFunctions analyzer rule to delay making lateral join when table arguments are used

[ https://issues.apache.org/jira/browse/SPARK-45266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-45266. --- Fix Version/s: 4.0.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Resolved] (SPARK-45360) Initialize spark session builder configuration from SPARK_REMOTE

[ https://issues.apache.org/jira/browse/SPARK-45360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-45360. --- Fix Version/s: 4.0.0 3.5.1 Assignee: Yihong He

[jira] [Updated] (SPARK-45330) Upgrade ammonite to 2.5.11

[ https://issues.apache.org/jira/browse/SPARK-45330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45330: - Summary: Upgrade ammonite to 2.5.11 (was: Upgrade ammonite to 2.6.0) > Upgrade ammonite to 2.5.11 >

[jira] [Updated] (SPARK-45330) Upgrade ammonite to 2.6.0

[ https://issues.apache.org/jira/browse/SPARK-45330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45330: --- Labels: pull-request-available (was: ) > Upgrade ammonite to 2.6.0 >

[jira] [Assigned] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45364: Assignee: BingKun Pan > Clean up the unnecessary Scala 2.12 logical in SparkBuild >

[jira] [Updated] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45364: - Priority: Trivial (was: Minor) > Clean up the unnecessary Scala 2.12 logical in SparkBuild >

[jira] [Resolved] (SPARK-45364) Clean up the unnecessary Scala 2.12 logical in SparkBuild

[ https://issues.apache.org/jira/browse/SPARK-45364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45364. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43158

[jira] [Updated] (SPARK-45370) Fix python test when ansi mode enabled

[ https://issues.apache.org/jira/browse/SPARK-45370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45370: --- Labels: pull-request-available (was: ) > Fix python test when ansi mode enabled >

[jira] [Updated] (SPARK-45134) Data duplication may occur when fallback to origin shuffle block

[ https://issues.apache.org/jira/browse/SPARK-45134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45134: --- Labels: pull-request-available (was: ) > Data duplication may occur when fallback to

[jira] [Created] (SPARK-45370) Fix python test when ansi mode enabled

BingKun Pan created SPARK-45370: --- Summary: Fix python test when ansi mode enabled Key: SPARK-45370 URL: https://issues.apache.org/jira/browse/SPARK-45370 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45369) Push down limit through generate

[ https://issues.apache.org/jira/browse/SPARK-45369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45369: --- Labels: pull-request-available (was: ) > Push down limit through generate >

[jira] [Created] (SPARK-45369) Push down limit through generate

Yuming Wang created SPARK-45369: --- Summary: Push down limit through generate Key: SPARK-45369 URL: https://issues.apache.org/jira/browse/SPARK-45369 Project: Spark Issue Type: Improvement