[jira] [Assigned] (SPARK-42049) Improve AliasAwareOutputExpression

[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42049: --- Assignee: Peter Toth > Improve AliasAwareOutputExpression > ---

[jira] [Resolved] (SPARK-42049) Improve AliasAwareOutputExpression

[ https://issues.apache.org/jira/browse/SPARK-42049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42049. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37525 [https://gith

[jira] [Assigned] (SPARK-40086) Improve AliasAwareOutputPartitioning to take all aliases into account

[ https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40086: --- Assignee: Peter Toth > Improve AliasAwareOutputPartitioning to take all aliases into accoun

[jira] [Resolved] (SPARK-40086) Improve AliasAwareOutputPartitioning to take all aliases into account

[ https://issues.apache.org/jira/browse/SPARK-40086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40086. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37525 [https://gith

[jira] [Created] (SPARK-42258) pyspark.sql.functions should not expose typing.cast

Furcy Pin created SPARK-42258: - Summary: pyspark.sql.functions should not expose typing.cast Key: SPARK-42258 URL: https://issues.apache.org/jira/browse/SPARK-42258 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-42257) Remove unused variable in ExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-42257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42257: Assignee: (was: Apache Spark) > Remove unused variable in ExternalSorter > -

[jira] [Assigned] (SPARK-42257) Remove unused variable in ExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-42257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42257: Assignee: Apache Spark > Remove unused variable in ExternalSorter >

[jira] [Commented] (SPARK-42257) Remove unused variable in ExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-42257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682549#comment-17682549 ] Apache Spark commented on SPARK-42257: -- User 'khalidmammadov' has created a pull re

[jira] [Created] (SPARK-42257) Remove unused variable in ExternalSorter

Khalid Mammadov created SPARK-42257: --- Summary: Remove unused variable in ExternalSorter Key: SPARK-42257 URL: https://issues.apache.org/jira/browse/SPARK-42257 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-42256) SPIP: Lazy Materialization for Parquet Read Performance Improvement

[ https://issues.apache.org/jira/browse/SPARK-42256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-42256: -- Description: Spark-SQL filter operation is a common workload in order to select sp

[jira] [Resolved] (SPARK-42250) predict_batch_udf with float fails when the batch size consists of single value

[ https://issues.apache.org/jira/browse/SPARK-42250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42250. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39817 [https://gi

[jira] [Assigned] (SPARK-42250) predict_batch_udf with float fails when the batch size consists of single value

[ https://issues.apache.org/jira/browse/SPARK-42250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42250: Assignee: Hyukjin Kwon > predict_batch_udf with float fails when the batch size consists

[jira] [Commented] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682475#comment-17682475 ] Penglei Shi commented on SPARK-35725: - [~ulysses] Thx! > Support repartition expand

[jira] [Comment Edited] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682473#comment-17682473 ] XiDuo You edited comment on SPARK-35725 at 1/31/23 10:08 AM: -

[jira] [Comment Edited] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682473#comment-17682473 ] XiDuo You edited comment on SPARK-35725 at 1/31/23 10:07 AM: -

[jira] [Commented] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682473#comment-17682473 ] XiDuo You commented on SPARK-35725: --- [~Penglei Shi] Kyuubi community has a Spark exten

[jira] [Comment Edited] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682469#comment-17682469 ] Penglei Shi edited comment on SPARK-35725 at 1/31/23 9:57 AM:

[jira] [Commented] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682469#comment-17682469 ] Penglei Shi commented on SPARK-35725: - [~ulysses] Yes,  the final shuffle coming wit

[jira] [Created] (SPARK-42256) SPIP: Lazy Materialization for Parquet Read Performance Improvement

Kazuyuki Tanimura created SPARK-42256: - Summary: SPIP: Lazy Materialization for Parquet Read Performance Improvement Key: SPARK-42256 URL: https://issues.apache.org/jira/browse/SPARK-42256 Project

[jira] [Commented] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682460#comment-17682460 ] XiDuo You commented on SPARK-35725: --- [~Penglei Shi] , It will cause inconsistent. The

[jira] [Assigned] (SPARK-42251) Forbid deicmal type if precision less than 1

[ https://issues.apache.org/jira/browse/SPARK-42251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42251: Assignee: Apache Spark > Forbid deicmal type if precision less than 1 > -

[jira] [Commented] (SPARK-42251) Forbid deicmal type if precision less than 1

[ https://issues.apache.org/jira/browse/SPARK-42251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682456#comment-17682456 ] Apache Spark commented on SPARK-42251: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-42251) Forbid deicmal type if precision less than 1

[ https://issues.apache.org/jira/browse/SPARK-42251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42251: Assignee: (was: Apache Spark) > Forbid deicmal type if precision less than 1 > --

[jira] [Commented] (SPARK-35725) Support repartition expand partitions in AQE

[ https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682455#comment-17682455 ] Penglei Shi commented on SPARK-35725: - Hi [~ulysses]  , advisory partition size for

[jira] [Updated] (SPARK-42251) Forbid deicmal type if precision less than 1

[ https://issues.apache.org/jira/browse/SPARK-42251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42251: -- Summary: Forbid deicmal type if precision less than 1 (was: Forbid deicmal type if precision is 0) >

[jira] [Resolved] (SPARK-42229) Migrate SparkCoreErrors into error class

[ https://issues.apache.org/jira/browse/SPARK-42229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42229. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39791 [https://github.com

[jira] [Assigned] (SPARK-42229) Migrate SparkCoreErrors into error class

[ https://issues.apache.org/jira/browse/SPARK-42229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42229: Assignee: Haejoon Lee > Migrate SparkCoreErrors into error class > --

[jira] [Updated] (SPARK-42251) Forbid deicmal type if precision is 0

[ https://issues.apache.org/jira/browse/SPARK-42251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42251: -- Description: Spark does not actually support decimal type with 0 precision. e.g.   {code:java} – work

[jira] [Updated] (SPARK-42251) Forbid deicmal type if precision is 0

[ https://issues.apache.org/jira/browse/SPARK-42251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42251: -- Summary: Forbid deicmal type if precision is 0 (was: Forbid deicmal(0, 0)) > Forbid deicmal type if p

<    1   2