[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493642#comment-17493642 ] melin commented on SPARK-38200: --- [~beliefer]  Upsert SQL is not ANSI standard, Mysql and PG are very

[jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-38200: -- Description: When writing data into a relational database, data duplication needs to be considered. Both

[jira] [Updated] (SPARK-38214) No need to filter windows when windowDuration is multiple of slideDuration

[ https://issues.apache.org/jira/browse/SPARK-38214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nyingping updated SPARK-38214: -- Summary: No need to filter windows when windowDuration is multiple of slideDuration (was: No need to

[jira] [Commented] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493620#comment-17493620 ] Dongjoon Hyun commented on SPARK-38223: --- That question is orthogonal from the underlying storage

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493607#comment-17493607 ] jiaan.geng commented on SPARK-38200: [~melin] Thank you for the ping. Does the syntax is an ANSI

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Description: In [SPARK-38234|https://issues.apache.org/jira/browse/SPARK-38234]

[jira] [Commented] (SPARK-38235) Add test util for testing grouped aggregate pandas UDF.

[ https://issues.apache.org/jira/browse/SPARK-38235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493595#comment-17493595 ] Haejoon Lee commented on SPARK-38235: - I'm working on this > Add test util for testing grouped

[jira] [Comment Edited] (SPARK-38107) Use error classes in the compilation errors of python/pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-38107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493594#comment-17493594 ] Haejoon Lee edited comment on SPARK-38107 at 2/17/22, 1:38 AM: --- While

[jira] [Comment Edited] (SPARK-38107) Use error classes in the compilation errors of python/pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-38107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493594#comment-17493594 ] Haejoon Lee edited comment on SPARK-38107 at 2/17/22, 1:37 AM: --- While

[jira] [Comment Edited] (SPARK-38107) Use error classes in the compilation errors of python/pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-38107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493594#comment-17493594 ] Haejoon Lee edited comment on SPARK-38107 at 2/17/22, 1:37 AM: --- Let me add

[jira] [Updated] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Coal Chan updated SPARK-38230: -- Description: In `org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand`,

[jira] [Commented] (SPARK-38107) Use error classes in the compilation errors of python/pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-38107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493594#comment-17493594 ] Haejoon Lee commented on SPARK-38107: - Let me add the test util for testing grouped aggregate pandas

[jira] [Updated] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Coal Chan updated SPARK-38230: -- Description: In `org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelationCommand`,

[jira] [Created] (SPARK-38235) Add test util for testing grouped aggregate pandas UDF.

Haejoon Lee created SPARK-38235: --- Summary: Add test util for testing grouped aggregate pandas UDF. Key: SPARK-38235 URL: https://issues.apache.org/jira/browse/SPARK-38235 Project: Spark Issue

[jira] [Resolved] (SPARK-38224) How do I get a lot of results in KDE

[ https://issues.apache.org/jira/browse/SPARK-38224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38224. -- Resolution: Invalid > How do I get a lot of results in KDE >

[jira] [Commented] (SPARK-38224) How do I get a lot of results in KDE

[ https://issues.apache.org/jira/browse/SPARK-38224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493586#comment-17493586 ] Hyukjin Kwon commented on SPARK-38224: -- For questions, let's ask it to Spark user mailing list

[jira] [Resolved] (SPARK-38233) java.io.InvalidClassException: org.apache.hadoop.hbase.spark.HBaseRelation

[ https://issues.apache.org/jira/browse/SPARK-38233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38233. -- Resolution: Invalid > java.io.InvalidClassException:

[jira] [Commented] (SPARK-38233) java.io.InvalidClassException: org.apache.hadoop.hbase.spark.HBaseRelation

[ https://issues.apache.org/jira/browse/SPARK-38233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493585#comment-17493585 ] Hyukjin Kwon commented on SPARK-38233: -- [~vnig@96] for questions, let's ask to the spark user

[jira] [Resolved] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37411. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37411: -- Assignee: Maciej Szymkiewicz > Inline type hints for

[jira] [Commented] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493557#comment-17493557 ] Apache Spark commented on SPARK-38234: -- User 'yeskarthik' has created a pull request for this

[jira] [Commented] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493542#comment-17493542 ] Apache Spark commented on SPARK-38234: -- User 'yeskarthik' has created a pull request for this

[jira] [Assigned] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38234: Assignee: (was: Apache Spark) > Provide monitoring REST API for Structured Streaming

[jira] [Assigned] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38234: Assignee: Apache Spark > Provide monitoring REST API for Structured Streaming >

[jira] [Commented] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493541#comment-17493541 ] Apache Spark commented on SPARK-38234: -- User 'yeskarthik' has created a pull request for this

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Description: In SPARK-31953 Structured Streaming is added to the history server

[jira] [Updated] (SPARK-38222) Expose Node Description attribute in SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-38222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-38222: --- Attachment: Spark_SQL_REST_Result_with-nodeDesc > Expose Node Description attribute

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Attachment: StreamingAPI-SS1.jpg StreamingAPI-SS2.jpg > Provide

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Attachment: StreamingAPIsSampleIO.txt > Provide monitoring REST API for

[jira] [Commented] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493512#comment-17493512 ] Zimo Li commented on SPARK-38223: - [~dongjoon] One thing that I am particularly confused about is when I

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Description: In [SPARK-31953|https://issues.apache.org/jira/browse/SPARK-31953]

[jira] [Commented] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493507#comment-17493507 ] Dongjoon Hyun commented on SPARK-38223: --- For a record, [~lizimo] is confusing about the limitation

[jira] [Comment Edited] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493506#comment-17493506 ] Karthik Subramanian edited comment on SPARK-38234 at 2/16/22, 9:04 PM:

[jira] [Commented] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493506#comment-17493506 ] Karthik Subramanian commented on SPARK-38234: - I will send the PR soon. > Provide

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Description: In [SPARK-31953 Add Spark Structured Streaming History Server

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38234: - Affects Version/s: 3.3.0 (was: 3.2.0)

[jira] [Commented] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493504#comment-17493504 ] Jungtaek Lim commented on SPARK-38234: -- (I just changed the fixed versions - it is reserved to

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38234: - Fix Version/s: (was: 3.3.0) (was: 3.1.4) (was:

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Description: In [SPARK-31953] Add Spark Structured Streaming History Server

[jira] [Updated] (SPARK-38234) Provide monitoring REST API for Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-38234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Subramanian updated SPARK-38234: Description: In SPARK-31953, Structured Streaming is added to the history server

[jira] [Created] (SPARK-38234) Provide monitoring REST API for Structured Streaming

Karthik Subramanian created SPARK-38234: --- Summary: Provide monitoring REST API for Structured Streaming Key: SPARK-38234 URL: https://issues.apache.org/jira/browse/SPARK-38234 Project: Spark

[jira] [Closed] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-38223. - > PersistentVolumeClaim does not work in clusters with multiple nodes >

[jira] [Resolved] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38228. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35539

[jira] [Resolved] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38223. --- Resolution: Invalid Hi, [~lizimo]. It seems that you misunderstand the feature. Please try

[jira] [Resolved] (SPARK-38231) Upgrade commons-text to 1.9

[ https://issues.apache.org/jira/browse/SPARK-38231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38231. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35542

[jira] [Assigned] (SPARK-38231) Upgrade commons-text to 1.9

[ https://issues.apache.org/jira/browse/SPARK-38231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38231: - Assignee: Yang Jie > Upgrade commons-text to 1.9 > --- > >

[jira] [Commented] (SPARK-27826) saveAsTable() function case table have "HiveFileFormat" "ParquetFileFormat" format issue

[ https://issues.apache.org/jira/browse/SPARK-27826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493316#comment-17493316 ] fengtlyer commented on SPARK-27826: --- Hi Bandhu, sorry for late reply. At the end, we decide re-create

[jira] [Assigned] (SPARK-37156) Inline type hints for python/pyspark/storagelevel.py

[ https://issues.apache.org/jira/browse/SPARK-37156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37156: -- Assignee: dch nguyen (was: Apache Spark) > Inline type hints for

[jira] [Assigned] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-37155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37155: -- Assignee: (was: Byron Hsu) > Inline type hints for

[jira] [Assigned] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-37155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37155: -- Assignee: dch nguyen > Inline type hints for python/pyspark/statcounter.py >

[jira] [Commented] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493293#comment-17493293 ] Itay Bittan commented on SPARK-23977: - Hi all,   I follow the

[jira] [Commented] (SPARK-38223) PersistentVolumeClaim does not work in clusters with multiple nodes

[ https://issues.apache.org/jira/browse/SPARK-38223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493259#comment-17493259 ] Zimo Li commented on SPARK-38223: - [~dongjoon] this may relate to your changes since you added

[jira] [Commented] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493227#comment-17493227 ] Apache Spark commented on SPARK-37422: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37422: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/feature.py >

[jira] [Commented] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493225#comment-17493225 ] Apache Spark commented on SPARK-37422: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37422: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Assigned] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37427: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/mllib/tree.py >

[jira] [Assigned] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37427: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/tree.py >

[jira] [Commented] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493224#comment-17493224 ] Apache Spark commented on SPARK-37427: -- User 'zero323' has created a pull request for this issue:

[jira] [Created] (SPARK-38233) java.io.InvalidClassException: org.apache.hadoop.hbase.spark.HBaseRelation

sonalibhatt created SPARK-38233: --- Summary: java.io.InvalidClassException: org.apache.hadoop.hbase.spark.HBaseRelation Key: SPARK-38233 URL: https://issues.apache.org/jira/browse/SPARK-38233 Project:

[jira] [Commented] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493201#comment-17493201 ] Apache Spark commented on SPARK-38232: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493200#comment-17493200 ] Apache Spark commented on SPARK-38232: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38232: Assignee: Apache Spark > Explain formatted does not collect subqueries under query stage

[jira] [Assigned] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38232: Assignee: (was: Apache Spark) > Explain formatted does not collect subqueries under

[jira] [Updated] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38232: -- Parent: SPARK-37063 Issue Type: Sub-task (was: Bug) > Explain formatted does not collect

[jira] [Updated] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

[ https://issues.apache.org/jira/browse/SPARK-38232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-38232: -- Description: ExplainUtils have not catched QueryStageExec during collecting subquries. So we can not

[jira] [Created] (SPARK-38232) Explain formatted does not collect subqueries under query stage in AQE

XiDuo You created SPARK-38232: - Summary: Explain formatted does not collect subqueries under query stage in AQE Key: SPARK-38232 URL: https://issues.apache.org/jira/browse/SPARK-38232 Project: Spark

[jira] [Assigned] (SPARK-38227) Apply strict nullability of nested column in time window / session window

[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38227: Assignee: Apache Spark > Apply strict nullability of nested column in time window /

[jira] [Assigned] (SPARK-38227) Apply strict nullability of nested column in time window / session window

[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38227: Assignee: (was: Apache Spark) > Apply strict nullability of nested column in time

[jira] [Commented] (SPARK-38227) Apply strict nullability of nested column in time window / session window

[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493192#comment-17493192 ] Apache Spark commented on SPARK-38227: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-38231) Upgrade commons-text to 1.9

[ https://issues.apache.org/jira/browse/SPARK-38231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38231: Assignee: Apache Spark > Upgrade commons-text to 1.9 > --- > >

[jira] [Commented] (SPARK-38231) Upgrade commons-text to 1.9

[ https://issues.apache.org/jira/browse/SPARK-38231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493189#comment-17493189 ] Apache Spark commented on SPARK-38231: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38231) Upgrade commons-text to 1.9

[ https://issues.apache.org/jira/browse/SPARK-38231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38231: Assignee: (was: Apache Spark) > Upgrade commons-text to 1.9 >

[jira] [Updated] (SPARK-38231) Upgrade commons-text to 1.9

[ https://issues.apache.org/jira/browse/SPARK-38231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38231: - Description: https://commons.apache.org/proper/commons-text/changes-report.html#a1.9 (was:

[jira] [Created] (SPARK-38231) Upgrade commons-text to 1.9

Yang Jie created SPARK-38231: Summary: Upgrade commons-text to 1.9 Key: SPARK-38231 URL: https://issues.apache.org/jira/browse/SPARK-38231 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38229) Should't check temp/external/ifNotExists with visitReplaceTable when parser

[ https://issues.apache.org/jira/browse/SPARK-38229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38229: Assignee: Apache Spark > Should't check temp/external/ifNotExists with visitReplaceTable

[jira] [Assigned] (SPARK-38229) Should't check temp/external/ifNotExists with visitReplaceTable when parser

[ https://issues.apache.org/jira/browse/SPARK-38229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38229: Assignee: (was: Apache Spark) > Should't check temp/external/ifNotExists with

[jira] [Commented] (SPARK-38229) Should't check temp/external/ifNotExists with visitReplaceTable when parser

[ https://issues.apache.org/jira/browse/SPARK-38229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493174#comment-17493174 ] Apache Spark commented on SPARK-38229: -- User 'Yikf' has created a pull request for this issue:

[jira] [Updated] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Coal Chan updated SPARK-38230: -- Description: In `org.apache.spark.sql.execution.datasources. InsertIntoHadoopFsRelationCommand`, `

[jira] [Updated] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Coal Chan updated SPARK-38230: -- Description: In `org.apache.spark.sql.execution.datasources. InsertIntoHadoopFsRelationCommand`, `

[jira] [Created] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

Coal Chan created SPARK-38230: - Summary: InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases Key: SPARK-38230 URL: https://issues.apache.org/jira/browse/SPARK-38230

[jira] [Commented] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493131#comment-17493131 ] Apache Spark commented on SPARK-37783: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38229) Should't check temp/external/ifNotExists with visitReplaceTable when parser

yikf created SPARK-38229: Summary: Should't check temp/external/ifNotExists with visitReplaceTable when parser Key: SPARK-38229 URL: https://issues.apache.org/jira/browse/SPARK-38229 Project: Spark

[jira] [Updated] (SPARK-38227) Apply strict nullability of nested column in time window / session window

[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38227: - Description: In TimeWindow and SessionWindow, we define dataType of these function expressions

[jira] [Updated] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-38228: --- Description: As the ANSI store assignment policy force using ANSI cast, the legacy store

[jira] [Commented] (SPARK-38227) Apply strict nullability of nested column in time window / session window

[ https://issues.apache.org/jira/browse/SPARK-38227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493104#comment-17493104 ] Jungtaek Lim commented on SPARK-38227: -- Will submit a PR sooner. > Apply strict nullability of

[jira] [Commented] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493102#comment-17493102 ] Apache Spark commented on SPARK-38228: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493101#comment-17493101 ] Apache Spark commented on SPARK-38228: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38228: Assignee: Apache Spark (was: Gengliang Wang) > Legacy store assignment should not fail

[jira] [Assigned] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38228: Assignee: Gengliang Wang (was: Apache Spark) > Legacy store assignment should not fail

[jira] [Created] (SPARK-38228) Legacy store assignment should not fail on error under ANSI mode

Gengliang Wang created SPARK-38228: -- Summary: Legacy store assignment should not fail on error under ANSI mode Key: SPARK-38228 URL: https://issues.apache.org/jira/browse/SPARK-38228 Project: Spark

[jira] [Assigned] (SPARK-36061) Add `volcano` module and feature step

[ https://issues.apache.org/jira/browse/SPARK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36061: - Assignee: Yikun Jiang > Add `volcano` module and feature step >

[jira] [Resolved] (SPARK-36061) Add `volcano` module and feature step

[ https://issues.apache.org/jira/browse/SPARK-36061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36061. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35422

[jira] [Assigned] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38226: - Assignee: Xinyi Yu > Fix HiveCompatibilitySuite under ANSI mode >

[jira] [Resolved] (SPARK-38226) Fix HiveCompatibilitySuite under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38226. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35538

[jira] [Updated] (SPARK-38225) Adjust input `format` of function `to_binary`

[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38225: - Description: Currently, function to_binary doesn't deal with the non-string `format` parameter

[jira] [Updated] (SPARK-38225) Adjust input `format` of function `to_binary`

[ https://issues.apache.org/jira/browse/SPARK-38225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38225: - Summary: Adjust input `format` of function `to_binary` (was: Complete input validation of