[jira] [Assigned] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42829: Assignee: Apache Spark > Added Identifier to the cached RDD operator on the Stages page

[jira] [Commented] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703039#comment-17703039 ] Apache Spark commented on SPARK-42829: -- User 'yliou' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42829: Assignee: (was: Apache Spark) > Added Identifier to the cached RDD operator on the

[jira] [Commented] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703038#comment-17703038 ] Yian Liou commented on SPARK-42829: --- Opened PR at [https://github.com/apache/spark/pull/40502] and

[jira] [Resolved] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42864. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40500

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703026#comment-17703026 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703017#comment-17703017 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703018#comment-17703018 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42864: Assignee: Apache Spark (was: Ruifeng Zheng) > Review and fix issues in MLlib API docs >

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42864: Assignee: Ruifeng Zheng (was: Apache Spark) > Review and fix issues in MLlib API docs >

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42864: - Assignee: Ruifeng Zheng > Review and fix issues in MLlib API docs >

[jira] [Resolved] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42875. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40497

[jira] [Assigned] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42875: - Assignee: Takuya Ueshin > Fix toPandas to handle timezone and map types properly. >

[jira] [Created] (SPARK-42877) Implement DataFrame.foreach

Xinrong Meng created SPARK-42877: Summary: Implement DataFrame.foreach Key: SPARK-42877 URL: https://issues.apache.org/jira/browse/SPARK-42877 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42876) DataType's physicalDataType should be private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42876: Assignee: Rui Wang (was: Apache Spark) > DataType's physicalDataType should be

[jira] [Assigned] (SPARK-42876) DataType's physicalDataType should be private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42876: Assignee: Apache Spark (was: Rui Wang) > DataType's physicalDataType should be

[jira] [Commented] (SPARK-42876) DataType's physicalDataType should be private[sql]

[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702978#comment-17702978 ] Apache Spark commented on SPARK-42876: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-42876) DataType's physicalDataType should be private[sql]

Rui Wang created SPARK-42876: Summary: DataType's physicalDataType should be private[sql] Key: SPARK-42876 URL: https://issues.apache.org/jira/browse/SPARK-42876 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yian Liou updated SPARK-42829: -- Attachment: Screen Shot 2023-03-20 at 3.55.40 PM.png > Added Identifier to the cached RDD operator on

[jira] [Commented] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702929#comment-17702929 ] Puneet commented on SPARK-42411: Should be able to create a PR hopefully by next week.  > Better

[jira] [Assigned] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42875: Assignee: Apache Spark > Fix toPandas to handle timezone and map types properly. >

[jira] [Commented] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702922#comment-17702922 ] Apache Spark commented on SPARK-42875: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702921#comment-17702921 ] Apache Spark commented on SPARK-42875: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42875: Assignee: (was: Apache Spark) > Fix toPandas to handle timezone and map types

[jira] [Resolved] (SPARK-36180) Support TimestampNTZ type in Hive

[ https://issues.apache.org/jira/browse/SPARK-36180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36180. Resolution: Won't Fix > Support TimestampNTZ type in Hive >

[jira] [Resolved] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36045. Resolution: Won't Do > TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[jira] [Commented] (SPARK-35662) Support Timestamp without time zone data type

[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702920#comment-17702920 ] Gengliang Wang commented on SPARK-35662: [~beliefer] [~ivan.sadikov] [~gurwls223] [~sarutak]

[jira] [Assigned] (SPARK-42870) Move `toCatalystValue` to connect-common

[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42870: Assignee: Ruifeng Zheng > Move `toCatalystValue` to connect-common >

[jira] [Resolved] (SPARK-42870) Move `toCatalystValue` to connect-common

[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42870. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40485

[jira] [Created] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

Takuya Ueshin created SPARK-42875: - Summary: Fix toPandas to handle timezone and map types properly. Key: SPARK-42875 URL: https://issues.apache.org/jira/browse/SPARK-42875 Project: Spark

[jira] [Updated] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42702: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Support parameterized CTE >

[jira] [Commented] (SPARK-42702) Support parameterized CTE

[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702898#comment-17702898 ] Dongjoon Hyun commented on SPARK-42702: --- I changed the Fixed Version to 3.4.1 because there is no

[jira] [Updated] (SPARK-42818) Implement DataFrameReader/Writer.jdbc

[ https://issues.apache.org/jira/browse/SPARK-42818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42818: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Implement

[jira] [Updated] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42767: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Add check condition to start

[jira] [Resolved] (SPARK-42812) client_type is missing from AddArtifactsRequest proto message

[ https://issues.apache.org/jira/browse/SPARK-42812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42812. --- Fix Version/s: 3.4.1 Assignee: Venkata Sai Akhil Gudesa Resolution: Fixed >

[jira] [Updated] (SPARK-42817) Spark driver logs are filled with Initializing service data for shuffle service using name

[ https://issues.apache.org/jira/browse/SPARK-42817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42817: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Spark driver logs are filled with

[jira] [Updated] (SPARK-42826) Add migration notes for update to supported pandas version.

[ https://issues.apache.org/jira/browse/SPARK-42826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42826: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Add migration notes for update to

[jira] [Updated] (SPARK-42020) createDataFrame with UDT

[ https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42020: -- Fix Version/s: 3.4.1 (was: 3.4.0) > createDataFrame with UDT >

[jira] [Updated] (SPARK-41843) Implement SparkSession.udf

[ https://issues.apache.org/jira/browse/SPARK-41843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41843: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Implement SparkSession.udf >

[jira] [Updated] (SPARK-42848) Implement DataFrame.registerTempTable

[ https://issues.apache.org/jira/browse/SPARK-42848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42848: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Implement

[jira] [Updated] (SPARK-41818) Support DataFrameWriter.saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41818: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Support

[jira] [Updated] (SPARK-42824) Provide a clear error message for unsupported JVM attributes.

[ https://issues.apache.org/jira/browse/SPARK-42824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42824: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Provide a clear error message for

[jira] [Updated] (SPARK-42778) QueryStageExec should respect supportsRowBased

[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42778: -- Fix Version/s: 3.4.1 (was: 3.4.0) > QueryStageExec should respect

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42247: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Standardize `returnType` property

[jira] [Updated] (SPARK-42852) Revert NamedLambdaVariable related changes from EquivalentExpressions

[ https://issues.apache.org/jira/browse/SPARK-42852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42852: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Revert NamedLambdaVariable related

[jira] [Resolved] (SPARK-41585) The Spark exclude node functionality for YARN should work independently of dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-41585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-41585. --- Fix Version/s: 3.5.0 Target Version/s: 3.5.0 Assignee: Luca Canali

[jira] [Commented] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

[ https://issues.apache.org/jira/browse/SPARK-41971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702892#comment-17702892 ] Niket Jain commented on SPARK-41971: Can I work on this issue? > `toPandas` should support

[jira] [Commented] (SPARK-42874) Enable new golden file test framework for analysis for all input files

[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702888#comment-17702888 ] Apache Spark commented on SPARK-42874: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42874) Enable new golden file test framework for analysis for all input files

[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42874: Assignee: Apache Spark > Enable new golden file test framework for analysis for all

[jira] [Assigned] (SPARK-42874) Enable new golden file test framework for analysis for all input files

[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42874: Assignee: (was: Apache Spark) > Enable new golden file test framework for analysis

[jira] [Created] (SPARK-42874) Enable new golden file test framework for analysis for all input files

Daniel created SPARK-42874: -- Summary: Enable new golden file test framework for analysis for all input files Key: SPARK-42874 URL: https://issues.apache.org/jira/browse/SPARK-42874 Project: Spark

[jira] [Resolved] (SPARK-35662) Support Timestamp without time zone data type

[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35662. Fix Version/s: 3.4.0 Resolution: Fixed > Support Timestamp without time zone data

[jira] [Assigned] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42839: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Assigned] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42839: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2003 >

[jira] [Commented] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702841#comment-17702841 ] Apache Spark commented on SPARK-42839: -- User 'ruilibuaa' has created a pull request for this issue:

[jira] [Updated] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42773: - Priority: Trivial (was: Major) > Minor grammatical change to "Supports Spark Connect" message

[jira] [Updated] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI RUI updated SPARK-42839: --- Attachment: Screenshot from 2023-03-21 00-20-11.png > Assign a name to the error class

[jira] [Commented] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702838#comment-17702838 ] LI RUI commented on SPARK-42839: Hey, Max~ I am trying to complete this task. I have submitted a commit

[jira] [Created] (SPARK-42873) Define Spark SQL types as keywords

Max Gekk created SPARK-42873: Summary: Define Spark SQL types as keywords Key: SPARK-42873 URL: https://issues.apache.org/jira/browse/SPARK-42873 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42791) Create golden file test framework for analysis

[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702811#comment-17702811 ] Apache Spark commented on SPARK-42791: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42872) Spark SQL reads unnecessary nested fields

Jiri Humpolicek created SPARK-42872: --- Summary: Spark SQL reads unnecessary nested fields Key: SPARK-42872 URL: https://issues.apache.org/jira/browse/SPARK-42872 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42790) Abstract the excluded method for better test for JDBC docker tests.

[ https://issues.apache.org/jira/browse/SPARK-42790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42790. -- Fix Version/s: 3.5.0 Assignee: jiaan.geng Resolution: Fixed Resolved by

[jira] [Assigned] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41006: Assignee: Apache Spark > ConfigMap has the same name when launching two pods on the same

[jira] [Commented] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702710#comment-17702710 ] Apache Spark commented on SPARK-41006: -- User 'DHKold' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41006: Assignee: (was: Apache Spark) > ConfigMap has the same name when launching two pods

[jira] [Assigned] (SPARK-42536) Upgrade log4j2 to 2.20.0

[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42536: Assignee: (was: Apache Spark) > Upgrade log4j2 to 2.20.0 >

[jira] [Assigned] (SPARK-42536) Upgrade log4j2 to 2.20.0

[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42536: Assignee: Apache Spark > Upgrade log4j2 to 2.20.0 > > >

[jira] [Commented] (SPARK-42536) Upgrade log4j2 to 2.20.0

[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702667#comment-17702667 ] Apache Spark commented on SPARK-42536: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42871) Upgrade slf4j to 2.0.7

[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702662#comment-17702662 ] Apache Spark commented on SPARK-42871: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-42536) Upgrade log4j2 to 2.20.0

[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42536: - Description: [https://logging.apache.org/log4j/2.x/release-notes/2.20.0.html] (was: Need wait upgrade

[jira] [Assigned] (SPARK-42871) Upgrade slf4j to 2.0.7

[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42871: Assignee: (was: Apache Spark) > Upgrade slf4j to 2.0.7 > -- > >

[jira] [Assigned] (SPARK-42871) Upgrade slf4j to 2.0.7

[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42871: Assignee: Apache Spark > Upgrade slf4j to 2.0.7 > -- > >

[jira] [Commented] (SPARK-42871) Upgrade slf4j to 2.0.7

[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702661#comment-17702661 ] Apache Spark commented on SPARK-42871: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42871) Upgrade slf4j to 2.0.7

Yang Jie created SPARK-42871: Summary: Upgrade slf4j to 2.0.7 Key: SPARK-42871 URL: https://issues.apache.org/jira/browse/SPARK-42871 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702658#comment-17702658 ] Apache Spark commented on SPARK-42851: -- User 'peter-toth' has created a pull request for this

[jira] [Commented] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702657#comment-17702657 ] Apache Spark commented on SPARK-42851: -- User 'peter-toth' has created a pull request for this

[jira] [Resolved] (SPARK-42720) Refactor the withSequenceColumn

[ https://issues.apache.org/jira/browse/SPARK-42720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42720. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40456

[jira] [Assigned] (SPARK-42720) Refactor the withSequenceColumn

[ https://issues.apache.org/jira/browse/SPARK-42720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42720: Assignee: Hyukjin Kwon > Refactor the withSequenceColumn >

[jira] [Assigned] (SPARK-42791) Create golden file test framework for analysis

[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42791: --- Assignee: Daniel > Create golden file test framework for analysis >

[jira] [Resolved] (SPARK-42791) Create golden file test framework for analysis

[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42791. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40449

[jira] [Commented] (SPARK-42340) Implement GroupedData.applyInPandas

[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702632#comment-17702632 ] Apache Spark commented on SPARK-42340: -- User 'xinrong-meng' has created a pull request for this

[jira] [Resolved] (SPARK-42340) Implement GroupedData.applyInPandas

[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42340. -- Assignee: Xinrong Meng Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42340: - Fix Version/s: 3.5.0 > Implement GroupedData.applyInPandas >

[jira] [Assigned] (SPARK-42870) Move `toCatalystValue` to connect-common

[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42870: Assignee: (was: Apache Spark) > Move `toCatalystValue` to connect-common >

[jira] [Commented] (SPARK-42870) Move `toCatalystValue` to connect-common

[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702598#comment-17702598 ] Apache Spark commented on SPARK-42870: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42870) Move `toCatalystValue` to connect-common

[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42870: Assignee: Apache Spark > Move `toCatalystValue` to connect-common >

[jira] [Created] (SPARK-42870) Move `toCatalystValue` to connect-common

Ruifeng Zheng created SPARK-42870: - Summary: Move `toCatalystValue` to connect-common Key: SPARK-42870 URL: https://issues.apache.org/jira/browse/SPARK-42870 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query

[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Description:   CREATE TABLE test_noindex_table(`name` STRING,`age` INT,`city` STRING)

[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query

[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Description:   SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr AS

[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query

[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Attachment: image-2023-03-20-18-00-40-578.png > can not analyze window exp on sub query >

[jira] [Created] (SPARK-42869) can not analyze window exp on sub query

GuangWeiHong created SPARK-42869: Summary: can not analyze window exp on sub query Key: SPARK-42869 URL: https://issues.apache.org/jira/browse/SPARK-42869 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702556#comment-17702556 ] Li Ying commented on SPARK-38973: - [~csingh] Should this bugfix be merged into 3.2.x branches? > When

[jira] [Commented] (SPARK-42868) Support eliminate sorts in AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-42868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17702545#comment-17702545 ] Apache Spark commented on SPARK-42868: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42868) Support eliminate sorts in AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-42868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42868: Assignee: Apache Spark > Support eliminate sorts in AQE Optimizer >

[jira] [Assigned] (SPARK-42868) Support eliminate sorts in AQE Optimizer

[ https://issues.apache.org/jira/browse/SPARK-42868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42868: Assignee: (was: Apache Spark) > Support eliminate sorts in AQE Optimizer >

[jira] [Updated] (SPARK-42852) Revert NamedLambdaVariable related changes from EquivalentExpressions

[ https://issues.apache.org/jira/browse/SPARK-42852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-42852: --- Affects Version/s: (was: 3.3.2) > Revert NamedLambdaVariable related changes from

[jira] [Resolved] (SPARK-42827) Support `functions#array_prepend`

[ https://issues.apache.org/jira/browse/SPARK-42827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42827. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40481

[jira] [Assigned] (SPARK-42827) Support `functions#array_prepend`

[ https://issues.apache.org/jira/browse/SPARK-42827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42827: - Assignee: Yang Jie > Support `functions#array_prepend` >

[jira] [Created] (SPARK-42868) Support eliminate sorts in AQE Optimizer

Yuming Wang created SPARK-42868: --- Summary: Support eliminate sorts in AQE Optimizer Key: SPARK-42868 URL: https://issues.apache.org/jira/browse/SPARK-42868 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-42864: Assignee: (was: Ruifeng Zheng) > Review and fix issues in MLlib API docs >

  1   2   >