[jira] [Commented] (SPARK-42878) Named Table should support options

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703050#comment-17703050 ] Apache Spark commented on SPARK-42878: -- User 'amaliujia' has created a pull request

[jira] [Assigned] (SPARK-40822) Use stable derived-column-alias algorithm, suitable for CREATE VIEW

2023-03-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40822: Assignee: Max Gekk > Use stable derived-column-alias algorithm, suitable for CREATE VIEW > -

[jira] [Resolved] (SPARK-40822) Use stable derived-column-alias algorithm, suitable for CREATE VIEW

2023-03-20 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40822. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40126 [https://github.com

[jira] [Assigned] (SPARK-42878) Named Table should support options

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42878: Assignee: Apache Spark (was: Rui Wang) > Named Table should support options > --

[jira] [Assigned] (SPARK-42878) Named Table should support options

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42878: Assignee: Rui Wang (was: Apache Spark) > Named Table should support options > --

[jira] [Commented] (SPARK-42878) Named Table should support options

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703048#comment-17703048 ] Apache Spark commented on SPARK-42878: -- User 'amaliujia' has created a pull request

[jira] [Created] (SPARK-42878) Named Table should support options

2023-03-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-42878: Summary: Named Table should support options Key: SPARK-42878 URL: https://issues.apache.org/jira/browse/SPARK-42878 Project: Spark Issue Type: Task Compone

[jira] [Assigned] (SPARK-42830) Link skipped stages on Spark UI

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42830: Assignee: (was: Apache Spark) > Link skipped stages on Spark UI > ---

[jira] [Assigned] (SPARK-42830) Link skipped stages on Spark UI

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42830: Assignee: Apache Spark > Link skipped stages on Spark UI > --

[jira] [Commented] (SPARK-42830) Link skipped stages on Spark UI

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703046#comment-17703046 ] Apache Spark commented on SPARK-42830: -- User 'yliou' has created a pull request for

[jira] [Assigned] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42829: Assignee: Apache Spark > Added Identifier to the cached RDD operator on the Stages page

[jira] [Commented] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703039#comment-17703039 ] Apache Spark commented on SPARK-42829: -- User 'yliou' has created a pull request for

[jira] [Assigned] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42829: Assignee: (was: Apache Spark) > Added Identifier to the cached RDD operator on the St

[jira] [Commented] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-20 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703038#comment-17703038 ] Yian Liou commented on SPARK-42829: --- Opened PR at [https://github.com/apache/spark/pul

[jira] [Resolved] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42864. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40500 [https://gi

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703026#comment-17703026 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703017#comment-17703017 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703018#comment-17703018 ] Apache Spark commented on SPARK-42864: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42864: Assignee: Apache Spark (was: Ruifeng Zheng) > Review and fix issues in MLlib API docs >

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42864: Assignee: Ruifeng Zheng (was: Apache Spark) > Review and fix issues in MLlib API docs >

[jira] [Assigned] (SPARK-42864) Review and fix issues in MLlib API docs

2023-03-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42864: - Assignee: Ruifeng Zheng > Review and fix issues in MLlib API docs > ---

[jira] [Resolved] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42875. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40497 [https://

[jira] [Assigned] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42875: - Assignee: Takuya Ueshin > Fix toPandas to handle timezone and map types properly. > ---

[jira] [Created] (SPARK-42877) Implement DataFrame.foreach

2023-03-20 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42877: Summary: Implement DataFrame.foreach Key: SPARK-42877 URL: https://issues.apache.org/jira/browse/SPARK-42877 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42876) DataType's physicalDataType should be private[sql]

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42876: Assignee: Rui Wang (was: Apache Spark) > DataType's physicalDataType should be private[s

[jira] [Assigned] (SPARK-42876) DataType's physicalDataType should be private[sql]

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42876: Assignee: Apache Spark (was: Rui Wang) > DataType's physicalDataType should be private[s

[jira] [Commented] (SPARK-42876) DataType's physicalDataType should be private[sql]

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702978#comment-17702978 ] Apache Spark commented on SPARK-42876: -- User 'amaliujia' has created a pull request

[jira] [Created] (SPARK-42876) DataType's physicalDataType should be private[sql]

2023-03-20 Thread Rui Wang (Jira)
Rui Wang created SPARK-42876: Summary: DataType's physicalDataType should be private[sql] Key: SPARK-42876 URL: https://issues.apache.org/jira/browse/SPARK-42876 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-20 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yian Liou updated SPARK-42829: -- Attachment: Screen Shot 2023-03-20 at 3.55.40 PM.png > Added Identifier to the cached RDD operator on

[jira] [Commented] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes

2023-03-20 Thread Puneet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702929#comment-17702929 ] Puneet commented on SPARK-42411: Should be able to create a PR hopefully by next week. 

[jira] [Assigned] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42875: Assignee: Apache Spark > Fix toPandas to handle timezone and map types properly. > --

[jira] [Commented] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702922#comment-17702922 ] Apache Spark commented on SPARK-42875: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702921#comment-17702921 ] Apache Spark commented on SPARK-42875: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42875: Assignee: (was: Apache Spark) > Fix toPandas to handle timezone and map types properl

[jira] [Resolved] (SPARK-36180) Support TimestampNTZ type in Hive

2023-03-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36180. Resolution: Won't Fix > Support TimestampNTZ type in Hive > --

[jira] [Resolved] (SPARK-36045) TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

2023-03-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36045. Resolution: Won't Do > TO_UTC_TIMESTAMP and FROM_UTC_TIMESTAMP should return TimestampNTZ

[jira] [Commented] (SPARK-35662) Support Timestamp without time zone data type

2023-03-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702920#comment-17702920 ] Gengliang Wang commented on SPARK-35662: [~beliefer] [~ivan.sadikov] [~gurwls223

[jira] [Assigned] (SPARK-42870) Move `toCatalystValue` to connect-common

2023-03-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42870: Assignee: Ruifeng Zheng > Move `toCatalystValue` to connect-common >

[jira] [Resolved] (SPARK-42870) Move `toCatalystValue` to connect-common

2023-03-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42870. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40485 [https://gi

[jira] [Created] (SPARK-42875) Fix toPandas to handle timezone and map types properly.

2023-03-20 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42875: - Summary: Fix toPandas to handle timezone and map types properly. Key: SPARK-42875 URL: https://issues.apache.org/jira/browse/SPARK-42875 Project: Spark Iss

[jira] [Updated] (SPARK-42702) Support parameterized CTE

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42702: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Support parameterized CTE > ---

[jira] [Commented] (SPARK-42702) Support parameterized CTE

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702898#comment-17702898 ] Dongjoon Hyun commented on SPARK-42702: --- I changed the Fixed Version to 3.4.1 beca

[jira] [Updated] (SPARK-42818) Implement DataFrameReader/Writer.jdbc

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42818: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Implement DataFrameReader/Writer.jd

[jira] [Updated] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42767: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Add check condition to start connec

[jira] [Resolved] (SPARK-42812) client_type is missing from AddArtifactsRequest proto message

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42812. --- Fix Version/s: 3.4.1 Assignee: Venkata Sai Akhil Gudesa Resolution: Fixed >

[jira] [Updated] (SPARK-42817) Spark driver logs are filled with Initializing service data for shuffle service using name

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42817: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Spark driver logs are filled with I

[jira] [Updated] (SPARK-42826) Add migration notes for update to supported pandas version.

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42826: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Add migration notes for update to s

[jira] [Updated] (SPARK-42020) createDataFrame with UDT

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42020: -- Fix Version/s: 3.4.1 (was: 3.4.0) > createDataFrame with UDT >

[jira] [Updated] (SPARK-41843) Implement SparkSession.udf

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41843: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Implement SparkSession.udf > --

[jira] [Updated] (SPARK-42848) Implement DataFrame.registerTempTable

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42848: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Implement DataFrame.registerTempTab

[jira] [Updated] (SPARK-41818) Support DataFrameWriter.saveAsTable

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41818: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Support DataFrameWriter.saveAsTable

[jira] [Updated] (SPARK-42824) Provide a clear error message for unsupported JVM attributes.

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42824: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Provide a clear error message for u

[jira] [Updated] (SPARK-42778) QueryStageExec should respect supportsRowBased

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42778: -- Fix Version/s: 3.4.1 (was: 3.4.0) > QueryStageExec should respect suppo

[jira] [Updated] (SPARK-42247) Standardize `returnType` property of UserDefinedFunction

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42247: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Standardize `returnType` property o

[jira] [Updated] (SPARK-42852) Revert NamedLambdaVariable related changes from EquivalentExpressions

2023-03-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42852: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Revert NamedLambdaVariable related

[jira] [Resolved] (SPARK-41585) The Spark exclude node functionality for YARN should work independently of dynamic allocation

2023-03-20 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-41585. --- Fix Version/s: 3.5.0 Target Version/s: 3.5.0 Assignee: Luca Canali

[jira] [Commented] (SPARK-41971) `toPandas` should support duplicate filed names when arrow-optimization is on

2023-03-20 Thread Niket Jain (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702892#comment-17702892 ] Niket Jain commented on SPARK-41971: Can I work on this issue? > `toPandas` should

[jira] [Commented] (SPARK-42874) Enable new golden file test framework for analysis for all input files

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702888#comment-17702888 ] Apache Spark commented on SPARK-42874: -- User 'dtenedor' has created a pull request

[jira] [Assigned] (SPARK-42874) Enable new golden file test framework for analysis for all input files

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42874: Assignee: Apache Spark > Enable new golden file test framework for analysis for all input

[jira] [Assigned] (SPARK-42874) Enable new golden file test framework for analysis for all input files

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42874: Assignee: (was: Apache Spark) > Enable new golden file test framework for analysis fo

[jira] [Created] (SPARK-42874) Enable new golden file test framework for analysis for all input files

2023-03-20 Thread Daniel (Jira)
Daniel created SPARK-42874: -- Summary: Enable new golden file test framework for analysis for all input files Key: SPARK-42874 URL: https://issues.apache.org/jira/browse/SPARK-42874 Project: Spark I

[jira] [Resolved] (SPARK-35662) Support Timestamp without time zone data type

2023-03-20 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35662. Fix Version/s: 3.4.0 Resolution: Fixed > Support Timestamp without time zone data t

[jira] [Assigned] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42839: Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TEMP_2

[jira] [Assigned] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42839: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2003 > -

[jira] [Commented] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702841#comment-17702841 ] Apache Spark commented on SPARK-42839: -- User 'ruilibuaa' has created a pull request

[jira] [Updated] (SPARK-42773) Minor grammatical change to "Supports Spark Connect" message

2023-03-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42773: - Priority: Trivial (was: Major) > Minor grammatical change to "Supports Spark Connect" message >

[jira] [Updated] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

2023-03-20 Thread LI RUI (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI RUI updated SPARK-42839: --- Attachment: Screenshot from 2023-03-21 00-20-11.png > Assign a name to the error class _LEGACY_ERROR_TEMP_20

[jira] [Commented] (SPARK-42839) Assign a name to the error class _LEGACY_ERROR_TEMP_2003

2023-03-20 Thread LI RUI (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702838#comment-17702838 ] LI RUI commented on SPARK-42839: Hey, Max~ I am trying to complete this task. I have sub

[jira] [Created] (SPARK-42873) Define Spark SQL types as keywords

2023-03-20 Thread Max Gekk (Jira)
Max Gekk created SPARK-42873: Summary: Define Spark SQL types as keywords Key: SPARK-42873 URL: https://issues.apache.org/jira/browse/SPARK-42873 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42791) Create golden file test framework for analysis

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702811#comment-17702811 ] Apache Spark commented on SPARK-42791: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-42872) Spark SQL reads unnecessary nested fields

2023-03-20 Thread Jiri Humpolicek (Jira)
Jiri Humpolicek created SPARK-42872: --- Summary: Spark SQL reads unnecessary nested fields Key: SPARK-42872 URL: https://issues.apache.org/jira/browse/SPARK-42872 Project: Spark Issue Type: I

[jira] [Resolved] (SPARK-42790) Abstract the excluded method for better test for JDBC docker tests.

2023-03-20 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42790. -- Fix Version/s: 3.5.0 Assignee: jiaan.geng Resolution: Fixed Resolved by https:

[jira] [Assigned] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41006: Assignee: Apache Spark > ConfigMap has the same name when launching two pods on the same

[jira] [Commented] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702710#comment-17702710 ] Apache Spark commented on SPARK-41006: -- User 'DHKold' has created a pull request fo

[jira] [Assigned] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41006: Assignee: (was: Apache Spark) > ConfigMap has the same name when launching two pods o

[jira] [Assigned] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42536: Assignee: (was: Apache Spark) > Upgrade log4j2 to 2.20.0 > >

[jira] [Assigned] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42536: Assignee: Apache Spark > Upgrade log4j2 to 2.20.0 > > >

[jira] [Commented] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702667#comment-17702667 ] Apache Spark commented on SPARK-42536: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702662#comment-17702662 ] Apache Spark commented on SPARK-42871: -- User 'LuciferYang' has created a pull reque

[jira] [Updated] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42536: - Description: [https://logging.apache.org/log4j/2.x/release-notes/2.20.0.html] (was: Need wait upgrade

[jira] [Assigned] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42871: Assignee: (was: Apache Spark) > Upgrade slf4j to 2.0.7 > -- > >

[jira] [Assigned] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42871: Assignee: Apache Spark > Upgrade slf4j to 2.0.7 > -- > >

[jira] [Commented] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702661#comment-17702661 ] Apache Spark commented on SPARK-42871: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42871: Summary: Upgrade slf4j to 2.0.7 Key: SPARK-42871 URL: https://issues.apache.org/jira/browse/SPARK-42871 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702658#comment-17702658 ] Apache Spark commented on SPARK-42851: -- User 'peter-toth' has created a pull reques

[jira] [Commented] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702657#comment-17702657 ] Apache Spark commented on SPARK-42851: -- User 'peter-toth' has created a pull reques

[jira] [Resolved] (SPARK-42720) Refactor the withSequenceColumn

2023-03-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42720. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40456 [https://gi

[jira] [Assigned] (SPARK-42720) Refactor the withSequenceColumn

2023-03-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42720: Assignee: Hyukjin Kwon > Refactor the withSequenceColumn > --

[jira] [Assigned] (SPARK-42791) Create golden file test framework for analysis

2023-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42791: --- Assignee: Daniel > Create golden file test framework for analysis > ---

[jira] [Resolved] (SPARK-42791) Create golden file test framework for analysis

2023-03-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42791. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40449 [https://gith

[jira] [Commented] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702632#comment-17702632 ] Apache Spark commented on SPARK-42340: -- User 'xinrong-meng' has created a pull requ

[jira] [Resolved] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42340. -- Assignee: Xinrong Meng Resolution: Fixed Fixed in https://github.com/apache/spark/pull/4

[jira] [Updated] (SPARK-42340) Implement GroupedData.applyInPandas

2023-03-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42340: - Fix Version/s: 3.5.0 > Implement GroupedData.applyInPandas > ---

[jira] [Assigned] (SPARK-42870) Move `toCatalystValue` to connect-common

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42870: Assignee: (was: Apache Spark) > Move `toCatalystValue` to connect-common > --

[jira] [Commented] (SPARK-42870) Move `toCatalystValue` to connect-common

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17702598#comment-17702598 ] Apache Spark commented on SPARK-42870: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-42870) Move `toCatalystValue` to connect-common

2023-03-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42870: Assignee: Apache Spark > Move `toCatalystValue` to connect-common > -

[jira] [Created] (SPARK-42870) Move `toCatalystValue` to connect-common

2023-03-20 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42870: - Summary: Move `toCatalystValue` to connect-common Key: SPARK-42870 URL: https://issues.apache.org/jira/browse/SPARK-42870 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query

2023-03-20 Thread GuangWeiHong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Description:   CREATE TABLE test_noindex_table(`name` STRING,`age` INT,`city` STRING) PARTITIO

[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query

2023-03-20 Thread GuangWeiHong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Description:   SELECT * FROM ( SELECT *, COUNT(1) OVER itr AS grp_size FROM test WINDOW itr AS

[jira] [Updated] (SPARK-42869) can not analyze window exp on sub query

2023-03-20 Thread GuangWeiHong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangWeiHong updated SPARK-42869: - Attachment: image-2023-03-20-18-00-40-578.png > can not analyze window exp on sub query > --

  1   2   >