[jira] [Assigned] (SPARK-45210) Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

[ https://issues.apache.org/jira/browse/SPARK-45210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45210: Assignee: Hyukjin Kwon > Switch languages consistently across docs for all code snippets

[jira] [Resolved] (SPARK-45210) Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

[ https://issues.apache.org/jira/browse/SPARK-45210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45210. -- Fix Version/s: 3.3.4 3.4.2 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-44910) Encoders.bean does not support superclasses with generic type arguments

[ https://issues.apache.org/jira/browse/SPARK-44910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44910: -- Fix Version/s: 3.4.2 > Encoders.bean does not support superclasses with generic type

[jira] [Commented] (SPARK-44910) Encoders.bean does not support superclasses with generic type arguments

[ https://issues.apache.org/jira/browse/SPARK-44910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766640#comment-17766640 ] Dongjoon Hyun commented on SPARK-44910: --- This landed at branch-3.4 via

[jira] [Assigned] (SPARK-44910) Encoders.bean does not support superclasses with generic type arguments

[ https://issues.apache.org/jira/browse/SPARK-44910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44910: - Assignee: Giambattista Bloisi > Encoders.bean does not support superclasses with

[jira] [Resolved] (SPARK-44910) Encoders.bean does not support superclasses with generic type arguments

[ https://issues.apache.org/jira/browse/SPARK-44910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44910. --- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by

[jira] [Resolved] (SPARK-43654) Enable InternalFrameParityTests.test_from_pandas

[ https://issues.apache.org/jira/browse/SPARK-43654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43654. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42956

[jira] [Assigned] (SPARK-43654) Enable InternalFrameParityTests.test_from_pandas

[ https://issues.apache.org/jira/browse/SPARK-43654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43654: - Assignee: Haejoon Lee > Enable InternalFrameParityTests.test_from_pandas >

[jira] [Updated] (SPARK-45212) Install independent Python linter dependencies for branch-3.5

[ https://issues.apache.org/jira/browse/SPARK-45212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45212: - Description: Python linter failed in branch -3.5 daily test: *

[jira] [Updated] (SPARK-45212) Install independent Python linter dependencies for branch-3.5

[ https://issues.apache.org/jira/browse/SPARK-45212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45212: - Description: branch -3.5  > Install independent Python linter dependencies for branch-3.5 >

[jira] [Created] (SPARK-45212) Install independent Python linter dependencies for branch-3.5

Yang Jie created SPARK-45212: Summary: Install independent Python linter dependencies for branch-3.5 Key: SPARK-45212 URL: https://issues.apache.org/jira/browse/SPARK-45212 Project: Spark Issue

[jira] [Updated] (SPARK-45211) Scala 2.13 daily test failed

[ https://issues.apache.org/jira/browse/SPARK-45211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45211: - Affects Version/s: 3.5.1 > Scala 2.13 daily test failed > - > >

[jira] [Commented] (SPARK-44862) Adding metric tracking number of jobs running on a cluster

[ https://issues.apache.org/jira/browse/SPARK-44862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766633#comment-17766633 ] Ruifeng Zheng commented on SPARK-44862: --- I think the added metric should be included

[jira] [Updated] (SPARK-44862) Adding metric tracking number of jobs running on a cluster

[ https://issues.apache.org/jira/browse/SPARK-44862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44862: -- Attachment: image-2023-09-19-11-21-55-416.png > Adding metric tracking number of jobs running

[jira] [Created] (SPARK-45211) Scala 2.13 daily test failed

Yang Jie created SPARK-45211: Summary: Scala 2.13 daily test failed Key: SPARK-45211 URL: https://issues.apache.org/jira/browse/SPARK-45211 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-45202) lint-js only covers core module

[ https://issues.apache.org/jira/browse/SPARK-45202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45202. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42982

[jira] [Assigned] (SPARK-45202) lint-js only covers core module

[ https://issues.apache.org/jira/browse/SPARK-45202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45202: Assignee: Kent Yao > lint-js only covers core module > --- > >

[jira] [Created] (SPARK-45210) Switch languages consistently across docs for all code snippets (Spark 3.4 and below)

Hyukjin Kwon created SPARK-45210: Summary: Switch languages consistently across docs for all code snippets (Spark 3.4 and below) Key: SPARK-45210 URL: https://issues.apache.org/jira/browse/SPARK-45210

[jira] [Created] (SPARK-45209) Flame Graph Support For Executor Thread Dump Page

Kent Yao created SPARK-45209: Summary: Flame Graph Support For Executor Thread Dump Page Key: SPARK-45209 URL: https://issues.apache.org/jira/browse/SPARK-45209 Project: Spark Issue Type:

[jira] [Updated] (SPARK-44742) Add Spark version drop down to the PySpark doc site

[ https://issues.apache.org/jira/browse/SPARK-44742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44742: - Fix Version/s: 3.5.1 (was: 3.5.0) > Add Spark version drop down to the

[jira] [Created] (SPARK-45208) Kubernetes Configuration in Spark Community Website doesn't have horizontal scrollbar

Qian Sun created SPARK-45208: Summary: Kubernetes Configuration in Spark Community Website doesn't have horizontal scrollbar Key: SPARK-45208 URL: https://issues.apache.org/jira/browse/SPARK-45208

[jira] [Updated] (SPARK-44820) Switch languages consistently across docs for all code snippets

[ https://issues.apache.org/jira/browse/SPARK-44820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44820: - Fix Version/s: 4.0.0 3.5.0 > Switch languages consistently across docs for

[jira] [Updated] (SPARK-45167) Python Spark Connect client does not call `releaseAll`

[ https://issues.apache.org/jira/browse/SPARK-45167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45167: - Fix Version/s: 3.5.1 > Python Spark Connect client does not call `releaseAll` >

[jira] [Resolved] (SPARK-45065) Support Pandas 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-45065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45065. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42793

[jira] [Assigned] (SPARK-45065) Support Pandas 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-45065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45065: - Assignee: Haejoon Lee > Support Pandas 2.1.0 > > >

[jira] [Created] (SPARK-45207) Implement FetchErrorDetails RPC

Yihong He created SPARK-45207: - Summary: Implement FetchErrorDetails RPC Key: SPARK-45207 URL: https://issues.apache.org/jira/browse/SPARK-45207 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-45188) Update error messages related to parameterized sql()

[ https://issues.apache.org/jira/browse/SPARK-45188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45188. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42957

[jira] [Commented] (SPARK-45183) ExecutorPodsLifecycleManager delete a pod multi times.

[ https://issues.apache.org/jira/browse/SPARK-45183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766582#comment-17766582 ] Dongjoon Hyun commented on SPARK-45183: --- Thank you for creating a JIRA, but Apache Spark 3.2.0 is

[jira] [Updated] (SPARK-45081) Encoders.bean does no longer work with read-only properties

[ https://issues.apache.org/jira/browse/SPARK-45081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45081: -- Fix Version/s: 3.4.2 > Encoders.bean does no longer work with read-only properties >

[jira] [Commented] (SPARK-45081) Encoders.bean does no longer work with read-only properties

[ https://issues.apache.org/jira/browse/SPARK-45081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766577#comment-17766577 ] Dongjoon Hyun commented on SPARK-45081: --- This is backported to branch-3.4 via

[jira] [Resolved] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45153. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42909

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45153: - Assignee: Haejoon Lee > Rebalance testing time for `pyspark-pandas-connect-part1` >

[jira] [Updated] (SPARK-45078) The ArrayInsert function should make explicit casting when element type not equals derived component type

[ https://issues.apache.org/jira/browse/SPARK-45078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45078: -- Fix Version/s: 3.4.2 > The ArrayInsert function should make explicit casting when element

[jira] [Commented] (SPARK-45078) The ArrayInsert function should make explicit casting when element type not equals derived component type

[ https://issues.apache.org/jira/browse/SPARK-45078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766551#comment-17766551 ] Dongjoon Hyun commented on SPARK-45078: --- This is resolved via

[jira] [Resolved] (SPARK-45203) join tests in KeyGroupedPartitioningSuite should use merge join hint

[ https://issues.apache.org/jira/browse/SPARK-45203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45203. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42983

[jira] [Assigned] (SPARK-45203) join tests in KeyGroupedPartitioningSuite should use merge join hint

[ https://issues.apache.org/jira/browse/SPARK-45203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45203: - Assignee: Wenchen Fan > join tests in KeyGroupedPartitioningSuite should use merge

[jira] [Created] (SPARK-45206) Shutting down SparkConnectClient can have outstanding ReleaseExecute

Juliusz Sompolski created SPARK-45206: - Summary: Shutting down SparkConnectClient can have outstanding ReleaseExecute Key: SPARK-45206 URL: https://issues.apache.org/jira/browse/SPARK-45206

[jira] [Resolved] (SPARK-45137) Unsupported map and array constructors by `sql()` in connect clients

[ https://issues.apache.org/jira/browse/SPARK-45137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45137. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42931

[jira] [Assigned] (SPARK-45137) Unsupported map and array constructors by `sql()` in connect clients

[ https://issues.apache.org/jira/browse/SPARK-45137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-45137: Assignee: Max Gekk > Unsupported map and array constructors by `sql()` in connect clients >

[jira] [Created] (SPARK-45205) Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278

Qiang Yang created SPARK-45205: -- Summary: Since version 3.2.0, Spark SQL has taken longer to execute "show paritions",probably because of changes introduced by SPARK-35278 Key: SPARK-45205 URL:

[jira] [Comment Edited] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

[ https://issues.apache.org/jira/browse/SPARK-45201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766471#comment-17766471 ] Sebastian Daberdaku edited comment on SPARK-45201 at 9/18/23 4:47 PM:

[jira] [Commented] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

[ https://issues.apache.org/jira/browse/SPARK-45201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766471#comment-17766471 ] Sebastian Daberdaku commented on SPARK-45201: - Out of completeness, this is what my

[jira] [Commented] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

[ https://issues.apache.org/jira/browse/SPARK-45201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766470#comment-17766470 ] Sebastian Daberdaku commented on SPARK-45201: - I also added a Dockerfile which builds Spark

[jira] [Created] (SPARK-45204) Extend CommandPlugins to be trackable

Robert Dillitz created SPARK-45204: -- Summary: Extend CommandPlugins to be trackable Key: SPARK-45204 URL: https://issues.apache.org/jira/browse/SPARK-45204 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

[ https://issues.apache.org/jira/browse/SPARK-45201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Daberdaku updated SPARK-45201: Attachment: Dockerfile > NoClassDefFoundError: InternalFutureFailureAccess when

[jira] [Resolved] (SPARK-45196) Refine docstring of `array/array_contains/arrays_overlap`

[ https://issues.apache.org/jira/browse/SPARK-45196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45196. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42972

[jira] [Assigned] (SPARK-45196) Refine docstring of `array/array_contains/arrays_overlap`

[ https://issues.apache.org/jira/browse/SPARK-45196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45196: - Assignee: Yang Jie > Refine docstring of `array/array_contains/arrays_overlap` >

[jira] [Resolved] (SPARK-43629) Enable RDD dependent tests with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43629. --- Fix Version/s: 4.0.0 Assignee: Haejoon Lee Resolution: Fixed This is

[jira] [Resolved] (SPARK-43628) Enable SparkContext-related tests with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43628. --- Fix Version/s: 4.0.0 Assignee: Haejoon Lee Resolution: Fixed > Enable

[jira] [Commented] (SPARK-43628) Enable SparkContext-related tests with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766460#comment-17766460 ] Dongjoon Hyun commented on SPARK-43628: --- This is resolved via

[jira] [Created] (SPARK-45203) join tests in KeyGroupedPartitioningSuite should use merge join hint

Wenchen Fan created SPARK-45203: --- Summary: join tests in KeyGroupedPartitioningSuite should use merge join hint Key: SPARK-45203 URL: https://issues.apache.org/jira/browse/SPARK-45203 Project: Spark

[jira] [Assigned] (SPARK-45148) Upgrade ScalaTest to the 3.2.17 series.

[ https://issues.apache.org/jira/browse/SPARK-45148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45148: Assignee: Yang Jie > Upgrade ScalaTest to the 3.2.17 series. >

[jira] [Resolved] (SPARK-45148) Upgrade ScalaTest to the 3.2.17 series.

[ https://issues.apache.org/jira/browse/SPARK-45148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45148. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42906

[jira] [Created] (SPARK-45202) lint-js only covers core module

Kent Yao created SPARK-45202: Summary: lint-js only covers core module Key: SPARK-45202 URL: https://issues.apache.org/jira/browse/SPARK-45202 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Description: I've been using Spark core 3.2.2 and was upgrading to 3.4.0   On execution of

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Description: I've been using Spark core 3.2.2 and was upgrading to 3.4.0   On execution of

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Description: /I've been using Spark core 3.2.2 and was upgrading to 3.4.0   On execution of

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Attachment: (was: image-2023-09-18-18-41-46-612.png) > Ignore/Disable Spark's default

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Description: /I've been using Spark core 3.2.2 and was upgrading to 3.4.0   On execution of

[jira] [Commented] (SPARK-43919) Extract JSON functionality out of Row

[ https://issues.apache.org/jira/browse/SPARK-43919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766400#comment-17766400 ] Thomas Graves commented on SPARK-43919: ---  This is missing description, comments, and link to the

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Attachment: image-2023-09-18-18-41-46-612.png > Ignore/Disable Spark's default log4j profile

[jira] [Updated] (SPARK-45200) Ignore/Disable Spark's default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitin Dominic updated SPARK-45200: -- Description: I've been using Spark core 3.2.2 and was upgrading to 3.4.0   On execution of

[jira] [Commented] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

[ https://issues.apache.org/jira/browse/SPARK-45201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766368#comment-17766368 ] Sebastian Daberdaku commented on SPARK-45201: - I also tried building and then running Spark

[jira] [Created] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0

Sebastian Daberdaku created SPARK-45201: --- Summary: NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0 Key: SPARK-45201 URL: https://issues.apache.org/jira/browse/SPARK-45201

[jira] [Updated] (SPARK-45195) Update Example with docker official image

[ https://issues.apache.org/jira/browse/SPARK-45195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45195: - Priority: Minor (was: Major) > Update Example with docker official image >

[jira] [Resolved] (SPARK-45195) Update Example with docker official image

[ https://issues.apache.org/jira/browse/SPARK-45195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45195. -- Fix Version/s: 4.0.0 Assignee: Ruifeng Zheng Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-45197) Make StandaloneRestServer add JavaModuleOptions to drivers

[ https://issues.apache.org/jira/browse/SPARK-45197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45197: - Assignee: Dongjoon Hyun > Make StandaloneRestServer add JavaModuleOptions to drivers >

[jira] [Resolved] (SPARK-45197) Make StandaloneRestServer add JavaModuleOptions to drivers

[ https://issues.apache.org/jira/browse/SPARK-45197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45197. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42975

[jira] [Created] (SPARK-45200) Ignore/Disable Spark's default log4j profile

Jitin Dominic created SPARK-45200: - Summary: Ignore/Disable Spark's default log4j profile Key: SPARK-45200 URL: https://issues.apache.org/jira/browse/SPARK-45200 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45199) Release cast from attribute in filter to support predicate push down

[ https://issues.apache.org/jira/browse/SPARK-45199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45199: --- Labels: pull-request-available (was: ) > Release cast from attribute in filter to support

[jira] [Updated] (SPARK-45199) Release cast from attribute in filter to support predicate push down

[ https://issues.apache.org/jira/browse/SPARK-45199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wechar updated SPARK-45199: --- Description: When a {{cast clause}} was used in a column in a filter, it will not be able to push down. We

[jira] [Created] (SPARK-45199) Release cast from attribute in filter to support predicate push down

Wechar created SPARK-45199: -- Summary: Release cast from attribute in filter to support predicate push down Key: SPARK-45199 URL: https://issues.apache.org/jira/browse/SPARK-45199 Project: Spark

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45153: -- Assignee: (was: Apache Spark) > Rebalance testing time for

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45153: -- Assignee: Apache Spark > Rebalance testing time for `pyspark-pandas-connect-part1` >

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45153: -- Assignee: (was: Apache Spark) > Rebalance testing time for

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45153: -- Assignee: Apache Spark > Rebalance testing time for `pyspark-pandas-connect-part1` >

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45153: -- Assignee: (was: Apache Spark) > Rebalance testing time for

[jira] [Assigned] (SPARK-45153) Rebalance testing time for `pyspark-pandas-connect-part1`

[ https://issues.apache.org/jira/browse/SPARK-45153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45153: -- Assignee: Apache Spark > Rebalance testing time for `pyspark-pandas-connect-part1` >

[jira] [Assigned] (SPARK-45193) Refactor `test_mode` to be compatible with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45193: - Assignee: Ruifeng Zheng > Refactor `test_mode` to be compatible with Spark Connect >

[jira] [Resolved] (SPARK-45193) Refactor `test_mode` to be compatible with Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45193. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42970

[jira] [Updated] (SPARK-45198) problem using broadcast join with parquet/iceberg tables

[ https://issues.apache.org/jira/browse/SPARK-45198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Uvarov updated SPARK-45198: - Attachment: T2-Details-for-Query.png T1-Details-for-Query.png > problem using

[jira] [Updated] (SPARK-45198) problem using broadcast join with parquet/iceberg tables

[ https://issues.apache.org/jira/browse/SPARK-45198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Uvarov updated SPARK-45198: - Description: We have 2 Parquet tables: load_test_full_warehouse.gen_document_type and

[jira] [Created] (SPARK-45198) problem using broadcast join with parquet/iceberg tables

Anton Uvarov created SPARK-45198: Summary: problem using broadcast join with parquet/iceberg tables Key: SPARK-45198 URL: https://issues.apache.org/jira/browse/SPARK-45198 Project: Spark

[jira] [Updated] (SPARK-45197) Make StandaloneRestServer add JavaModuleOptions to drivers

[ https://issues.apache.org/jira/browse/SPARK-45197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45197: --- Labels: pull-request-available (was: ) > Make StandaloneRestServer add JavaModuleOptions

[jira] [Created] (SPARK-45197) Make StandaloneRestServer add JavaModuleOptions to drivers

Dongjoon Hyun created SPARK-45197: - Summary: Make StandaloneRestServer add JavaModuleOptions to drivers Key: SPARK-45197 URL: https://issues.apache.org/jira/browse/SPARK-45197 Project: Spark

[jira] [Updated] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

[ https://issues.apache.org/jira/browse/SPARK-45154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oumar Nour updated SPARK-45154: --- Description: Hello, I have an engine running on spark2 using a DecisionTreeClassifier model using

[jira] [Resolved] (SPARK-44788) XML: Add pyspark.sql.functions

[ https://issues.apache.org/jira/browse/SPARK-44788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44788. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42938

[jira] [Assigned] (SPARK-44788) XML: Add pyspark.sql.functions

[ https://issues.apache.org/jira/browse/SPARK-44788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44788: Assignee: Sandip Agarwala > XML: Add pyspark.sql.functions >

[jira] [Assigned] (SPARK-44823) Update black to 23.7.0 and fix erroneous check

[ https://issues.apache.org/jira/browse/SPARK-44823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44823: Assignee: BingKun Pan > Update black to 23.7.0 and fix erroneous check >

[jira] [Resolved] (SPARK-44823) Update black to 23.7.0 and fix erroneous check

[ https://issues.apache.org/jira/browse/SPARK-44823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44823. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42507

[jira] [Updated] (SPARK-45196) Refine docstring of `array/array_contains/arrays_overlap`

[ https://issues.apache.org/jira/browse/SPARK-45196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45196: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Created] (SPARK-45196) Refine docstring of `array/array_contains/arrays_overlap`

Yang Jie created SPARK-45196: Summary: Refine docstring of `array/array_contains/arrays_overlap` Key: SPARK-45196 URL: https://issues.apache.org/jira/browse/SPARK-45196 Project: Spark Issue

[jira] [Created] (SPARK-45195) Update Example with docker official image

Ruifeng Zheng created SPARK-45195: - Summary: Update Example with docker official image Key: SPARK-45195 URL: https://issues.apache.org/jira/browse/SPARK-45195 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45195) Update Example with docker official image

[ https://issues.apache.org/jira/browse/SPARK-45195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766216#comment-17766216 ] Ruifeng Zheng commented on SPARK-45195: --- https://github.com/apache/spark-website/pull/477 >