[jira] [Commented] (SPARK-35733) Check all day-time interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367895#comment-17367895 ] Apache Spark commented on SPARK-35733: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35733) Check all day-time interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35733: Assignee: (was: Apache Spark) > Check all day-time interval types in HiveInspectors t

[jira] [Assigned] (SPARK-35733) Check all day-time interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35733: Assignee: Apache Spark > Check all day-time interval types in HiveInspectors tests >

[jira] [Resolved] (SPARK-35845) OuterReference resolution should reject ambiguous column names

[ https://issues.apache.org/jira/browse/SPARK-35845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35845. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33004 [https:

[jira] [Created] (SPARK-35861) Introduce "prefix match scan" feature on state store

Jungtaek Lim created SPARK-35861: Summary: Introduce "prefix match scan" feature on state store Key: SPARK-35861 URL: https://issues.apache.org/jira/browse/SPARK-35861 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-35772) Check all year-month interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35772: Assignee: angerszhu > Check all year-month interval types in HiveInspectors tests > -

[jira] [Resolved] (SPARK-35772) Check all year-month interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35772. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32970 [https://github.com

[jira] [Resolved] (SPARK-35856) Move new interval type test cases from CastSuite to CastBaseSuite

[ https://issues.apache.org/jira/browse/SPARK-35856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35856. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33022 [https:

[jira] [Commented] (SPARK-35860) Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType

[ https://issues.apache.org/jira/browse/SPARK-35860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367830#comment-17367830 ] Apache Spark commented on SPARK-35860: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35860) Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType

[ https://issues.apache.org/jira/browse/SPARK-35860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35860: Assignee: (was: Apache Spark) > Support upcast between different field of > YearMont

[jira] [Assigned] (SPARK-35860) Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType

[ https://issues.apache.org/jira/browse/SPARK-35860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35860: Assignee: Apache Spark > Support upcast between different field of > YearMonthIntervalTy

[jira] [Commented] (SPARK-35542) Bucketizer created for multiple columns with parameters splitsArray,  inputCols and outputCols can not be loaded after saving it.

[ https://issues.apache.org/jira/browse/SPARK-35542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367829#comment-17367829 ] L. C. Hsieh commented on SPARK-35542: - So this is PySpark only issue and Scala Bucke

[jira] [Assigned] (SPARK-32923) Add support to properly handle different type of stage retries

[ https://issues.apache.org/jira/browse/SPARK-32923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32923: Assignee: Apache Spark > Add support to properly handle different type of stage retries >

[jira] [Created] (SPARK-35860) Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType

angerszhu created SPARK-35860: - Summary: Support upcast between different field of YearMonthIntervalType/DayTimeIntervalType Key: SPARK-35860 URL: https://issues.apache.org/jira/browse/SPARK-35860 Project

[jira] [Assigned] (SPARK-32923) Add support to properly handle different type of stage retries

[ https://issues.apache.org/jira/browse/SPARK-32923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32923: Assignee: (was: Apache Spark) > Add support to properly handle different type of stag

[jira] [Commented] (SPARK-32923) Add support to properly handle different type of stage retries

[ https://issues.apache.org/jira/browse/SPARK-32923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367825#comment-17367825 ] Apache Spark commented on SPARK-32923: -- User 'venkata91' has created a pull request

[jira] [Resolved] (SPARK-27299) Design: Property graph construction, save/load, and query APIs

[ https://issues.apache.org/jira/browse/SPARK-27299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-27299. -- Resolution: Won't Fix > Design: Property graph construction, save/load, and query APIs > -

[jira] [Resolved] (SPARK-35027) Close the inputStream in FileAppender when writing the logs failure

[ https://issues.apache.org/jira/browse/SPARK-35027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35027. -- Resolution: Not A Problem > Close the inputStream in FileAppender when writing the logs failur

[jira] [Commented] (SPARK-35542) Bucketizer created for multiple columns with parameters splitsArray,  inputCols and outputCols can not be loaded after saving it.

[ https://issues.apache.org/jira/browse/SPARK-35542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367810#comment-17367810 ] Sean R. Owen commented on SPARK-35542: -- Huh, yeah I see that too. Weird, as I'd thi

[jira] [Resolved] (SPARK-35218) abandoned

[ https://issues.apache.org/jira/browse/SPARK-35218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35218. -- Fix Version/s: (was: 3.1.1) Target Version/s: (was: 3.1.1) Resolution: I

[jira] [Resolved] (SPARK-35550) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/SPARK-35550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35550. -- Fix Version/s: 3.2.0 Resolution: Fixed > Upgrade Jackson to 2.12.3 > --

[jira] [Updated] (SPARK-35851) Wrong docs in function GraphGenerators.sampleLogNormal

[ https://issues.apache.org/jira/browse/SPARK-35851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-35851: - Component/s: Documentation Description: In class GraphGenerators docs, function sampleLogNorm

[jira] [Commented] (SPARK-35852) Improve the implementation for DateType +/- DayTimeIntervalType(DAY)

[ https://issues.apache.org/jira/browse/SPARK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367801#comment-17367801 ] Apache Spark commented on SPARK-35852: -- User 'Peng-Lei' has created a pull request

[jira] [Commented] (SPARK-35852) Improve the implementation for DateType +/- DayTimeIntervalType(DAY)

[ https://issues.apache.org/jira/browse/SPARK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367800#comment-17367800 ] Apache Spark commented on SPARK-35852: -- User 'Peng-Lei' has created a pull request

[jira] [Commented] (SPARK-35762) Errors while using spark-sql read hive 3.1 orc table

[ https://issues.apache.org/jira/browse/SPARK-35762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367789#comment-17367789 ] laokong commented on SPARK-35762: - [~hyukjin.kwon] tks a lot > Errors while using spark

[jira] [Resolved] (SPARK-35473) Enable disallow_untyped_defs mypy check for pyspark.pandas.groupby.

[ https://issues.apache.org/jira/browse/SPARK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35473. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33032 [https://gi

[jira] [Assigned] (SPARK-35473) Enable disallow_untyped_defs mypy check for pyspark.pandas.groupby.

[ https://issues.apache.org/jira/browse/SPARK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35473: Assignee: Takuya Ueshin > Enable disallow_untyped_defs mypy check for pyspark.pandas.grou

[jira] [Resolved] (SPARK-35858) SparkPlan.makeCopy should not set the active session

[ https://issues.apache.org/jira/browse/SPARK-35858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35858. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33029 [https://gi

[jira] [Assigned] (SPARK-35473) Enable disallow_untyped_defs mypy check for pyspark.pandas.groupby.

[ https://issues.apache.org/jira/browse/SPARK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35473: Assignee: Apache Spark > Enable disallow_untyped_defs mypy check for pyspark.pandas.group

[jira] [Assigned] (SPARK-35473) Enable disallow_untyped_defs mypy check for pyspark.pandas.groupby.

[ https://issues.apache.org/jira/browse/SPARK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35473: Assignee: (was: Apache Spark) > Enable disallow_untyped_defs mypy check for pyspark.p

[jira] [Commented] (SPARK-35473) Enable disallow_untyped_defs mypy check for pyspark.pandas.groupby.

[ https://issues.apache.org/jira/browse/SPARK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367699#comment-17367699 ] Apache Spark commented on SPARK-35473: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-35473) Enable disallow_untyped_defs mypy check for pyspark.pandas.groupby.

[ https://issues.apache.org/jira/browse/SPARK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367700#comment-17367700 ] Apache Spark commented on SPARK-35473: -- User 'ueshin' has created a pull request fo

[jira] [Created] (SPARK-35859) Cleanup type hints.

Takuya Ueshin created SPARK-35859: - Summary: Cleanup type hints. Key: SPARK-35859 URL: https://issues.apache.org/jira/browse/SPARK-35859 Project: Spark Issue Type: Sub-task Componen

[jira] [Resolved] (SPARK-35847) Manage InternalField in DataTypeOps.isnull

[ https://issues.apache.org/jira/browse/SPARK-35847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35847. --- Fix Version/s: 3.2.0 Assignee: Takuya Ueshin Resolution: Fixed Issue resolve

[jira] [Commented] (SPARK-35734) Format day-time intervals using type fields

[ https://issues.apache.org/jira/browse/SPARK-35734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367605#comment-17367605 ] Apache Spark commented on SPARK-35734: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367580#comment-17367580 ] Apache Spark commented on SPARK-35700: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35695: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Bug) > QueryExecutionListener does not

[jira] [Commented] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367571#comment-17367571 ] Dongjoon Hyun commented on SPARK-35695: --- Thank you, [~tanelk]. This is important f

[jira] [Resolved] (SPARK-35849) Make astype data-type-based for DecimalOps

[ https://issues.apache.org/jira/browse/SPARK-35849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-35849. --- Fix Version/s: 3.2.0 Assignee: Yikun Jiang Resolution: Fixed Issue resolved

[jira] [Assigned] (SPARK-35858) SparkPlan.makeCopy should not set the active session

[ https://issues.apache.org/jira/browse/SPARK-35858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35858: Assignee: Apache Spark > SparkPlan.makeCopy should not set the active session > -

[jira] [Commented] (SPARK-35858) SparkPlan.makeCopy should not set the active session

[ https://issues.apache.org/jira/browse/SPARK-35858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367523#comment-17367523 ] Apache Spark commented on SPARK-35858: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-35858) SparkPlan.makeCopy should not set the active session

[ https://issues.apache.org/jira/browse/SPARK-35858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35858: Assignee: (was: Apache Spark) > SparkPlan.makeCopy should not set the active session

[jira] [Assigned] (SPARK-35858) SparkPlan.makeCopy should not set the active session

[ https://issues.apache.org/jira/browse/SPARK-35858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35858: Assignee: Apache Spark > SparkPlan.makeCopy should not set the active session > -

[jira] [Commented] (SPARK-35714) Bug fix for deadlock during the executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-35714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367521#comment-17367521 ] Apache Spark commented on SPARK-35714: -- User 'Ngone51' has created a pull request f

[jira] [Created] (SPARK-35858) SparkPlan.makeCopy should not set the active session

Wenchen Fan created SPARK-35858: --- Summary: SparkPlan.makeCopy should not set the active session Key: SPARK-35858 URL: https://issues.apache.org/jira/browse/SPARK-35858 Project: Spark Issue Type

[jira] [Assigned] (SPARK-35645) Merge contents and remove obsolete pages in Getting Started section

[ https://issues.apache.org/jira/browse/SPARK-35645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35645: - Assignee: Hyukjin Kwon > Merge contents and remove obsolete pages in Getting Started se

[jira] [Resolved] (SPARK-35645) Merge contents and remove obsolete pages in Getting Started section

[ https://issues.apache.org/jira/browse/SPARK-35645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35645. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33018 [https://

[jira] [Commented] (SPARK-35741) Variance of 1 record gives NULL in Spark 3.x and NaN in Spark 2.x

[ https://issues.apache.org/jira/browse/SPARK-35741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367504#comment-17367504 ] Apache Spark commented on SPARK-35741: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-35857) The ANSI flag of Cast should be kept after being copied

[ https://issues.apache.org/jira/browse/SPARK-35857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367489#comment-17367489 ] Apache Spark commented on SPARK-35857: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35857) The ANSI flag of Cast should be kept after being copied

[ https://issues.apache.org/jira/browse/SPARK-35857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367486#comment-17367486 ] Apache Spark commented on SPARK-35857: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35857) The ANSI flag of Cast should be kept after being copied

[ https://issues.apache.org/jira/browse/SPARK-35857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35857: Assignee: Apache Spark (was: Gengliang Wang) > The ANSI flag of Cast should be kept afte

[jira] [Assigned] (SPARK-35857) The ANSI flag of Cast should be kept after being copied

[ https://issues.apache.org/jira/browse/SPARK-35857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35857: Assignee: Gengliang Wang (was: Apache Spark) > The ANSI flag of Cast should be kept afte

[jira] [Resolved] (SPARK-35854) Improve the error message of to_timestamp_ntz with invalid format pattern

[ https://issues.apache.org/jira/browse/SPARK-35854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35854. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33019 [https:

[jira] [Commented] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367475#comment-17367475 ] Apache Spark commented on SPARK-35695: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-35857) The ANSI flag of Cast should be kept after being copied

Gengliang Wang created SPARK-35857: -- Summary: The ANSI flag of Cast should be kept after being copied Key: SPARK-35857 URL: https://issues.apache.org/jira/browse/SPARK-35857 Project: Spark I

[jira] [Commented] (SPARK-35563) [SQL] Window operations with over Int.MaxValue + 1 rows can silently drop rows

[ https://issues.apache.org/jira/browse/SPARK-35563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367437#comment-17367437 ] vinay commented on SPARK-35563: --- If we change the row_number from int to long is it not li

[jira] [Assigned] (SPARK-35727) Return INTERVAL DAY from dates subtraction

[ https://issues.apache.org/jira/browse/SPARK-35727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35727: --- Assignee: PengLei > Return INTERVAL DAY from dates subtraction > --

[jira] [Resolved] (SPARK-35727) Return INTERVAL DAY from dates subtraction

[ https://issues.apache.org/jira/browse/SPARK-35727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35727. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32999 [https://gith

[jira] [Updated] (SPARK-35838) Ensure all modules can be maven test independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-35838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35838: -- Summary: Ensure all modules can be maven test independently in Scala 2.13 (was: Ensure kafka-

[jira] [Assigned] (SPARK-35838) Ensure kafka-0-10-sql module can maven test independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-35838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35838: - Assignee: Yang Jie > Ensure kafka-0-10-sql module can maven test independently in Scala

[jira] [Resolved] (SPARK-35838) Ensure kafka-0-10-sql module can maven test independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-35838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35838. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32994 [https://

[jira] [Assigned] (SPARK-35852) Improve the implementation for DateType +/- DayTimeIntervalType(DAY)

[ https://issues.apache.org/jira/browse/SPARK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35852: Assignee: Apache Spark > Improve the implementation for DateType +/- DayTimeIntervalType(

[jira] [Commented] (SPARK-35852) Improve the implementation for DateType +/- DayTimeIntervalType(DAY)

[ https://issues.apache.org/jira/browse/SPARK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367332#comment-17367332 ] Apache Spark commented on SPARK-35852: -- User 'Peng-Lei' has created a pull request

[jira] [Assigned] (SPARK-35852) Improve the implementation for DateType +/- DayTimeIntervalType(DAY)

[ https://issues.apache.org/jira/browse/SPARK-35852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35852: Assignee: (was: Apache Spark) > Improve the implementation for DateType +/- DayTimeIn

[jira] [Commented] (SPARK-35812) Throw an error if `version` and `timestamp` are used together in DataFrame.to_delta.

[ https://issues.apache.org/jira/browse/SPARK-35812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367331#comment-17367331 ] Apache Spark commented on SPARK-35812: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-35812) Throw an error if `version` and `timestamp` are used together in DataFrame.to_delta.

[ https://issues.apache.org/jira/browse/SPARK-35812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367330#comment-17367330 ] Apache Spark commented on SPARK-35812: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-35812) Throw an error if `version` and `timestamp` are used together in DataFrame.to_delta.

[ https://issues.apache.org/jira/browse/SPARK-35812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35812: Assignee: (was: Apache Spark) > Throw an error if `version` and `timestamp` are used

[jira] [Assigned] (SPARK-35812) Throw an error if `version` and `timestamp` are used together in DataFrame.to_delta.

[ https://issues.apache.org/jira/browse/SPARK-35812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35812: Assignee: Apache Spark > Throw an error if `version` and `timestamp` are used together in

[jira] [Commented] (SPARK-35856) Move new interval type test cases from CastSuite to CastBaseSuite

[ https://issues.apache.org/jira/browse/SPARK-35856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367268#comment-17367268 ] Apache Spark commented on SPARK-35856: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35856) Move new interval type test cases from CastSuite to CastBaseSuite

[ https://issues.apache.org/jira/browse/SPARK-35856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35856: Assignee: Gengliang Wang (was: Apache Spark) > Move new interval type test cases from Ca

[jira] [Assigned] (SPARK-35856) Move new interval type test cases from CastSuite to CastBaseSuite

[ https://issues.apache.org/jira/browse/SPARK-35856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35856: Assignee: Apache Spark (was: Gengliang Wang) > Move new interval type test cases from Ca

[jira] [Created] (SPARK-35856) Move new interval type test cases from CastSuite to CastBaseSuite

Gengliang Wang created SPARK-35856: -- Summary: Move new interval type test cases from CastSuite to CastBaseSuite Key: SPARK-35856 URL: https://issues.apache.org/jira/browse/SPARK-35856 Project: Spark

[jira] [Commented] (SPARK-35855) Unify reuse map data structures in non-AQE and AQE rules

[ https://issues.apache.org/jira/browse/SPARK-35855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367232#comment-17367232 ] Apache Spark commented on SPARK-35855: -- User 'peter-toth' has created a pull reques

[jira] [Assigned] (SPARK-35855) Unify reuse map data structures in non-AQE and AQE rules

[ https://issues.apache.org/jira/browse/SPARK-35855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35855: Assignee: Apache Spark > Unify reuse map data structures in non-AQE and AQE rules > -

[jira] [Assigned] (SPARK-35855) Unify reuse map data structures in non-AQE and AQE rules

[ https://issues.apache.org/jira/browse/SPARK-35855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35855: Assignee: (was: Apache Spark) > Unify reuse map data structures in non-AQE and AQE ru

[jira] [Created] (SPARK-35855) Unify reuse map data structures in non-AQE and AQE rules

Peter Toth created SPARK-35855: -- Summary: Unify reuse map data structures in non-AQE and AQE rules Key: SPARK-35855 URL: https://issues.apache.org/jira/browse/SPARK-35855 Project: Spark Issue Ty

[jira] [Commented] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367181#comment-17367181 ] Apache Spark commented on SPARK-35543: -- User 'attilapiros' has created a pull reque

[jira] [Commented] (SPARK-35854) Improve the error message of to_timestamp_ntz with invalid format pattern

[ https://issues.apache.org/jira/browse/SPARK-35854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367180#comment-17367180 ] Apache Spark commented on SPARK-35854: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35854) Improve the error message of to_timestamp_ntz with invalid format pattern

[ https://issues.apache.org/jira/browse/SPARK-35854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35854: Assignee: Apache Spark (was: Gengliang Wang) > Improve the error message of to_timestamp

[jira] [Assigned] (SPARK-35854) Improve the error message of to_timestamp_ntz with invalid format pattern

[ https://issues.apache.org/jira/browse/SPARK-35854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35854: Assignee: Gengliang Wang (was: Apache Spark) > Improve the error message of to_timestamp

[jira] [Created] (SPARK-35854) Improve the error message of to_timestamp_ntz with invalid format pattern

Gengliang Wang created SPARK-35854: -- Summary: Improve the error message of to_timestamp_ntz with invalid format pattern Key: SPARK-35854 URL: https://issues.apache.org/jira/browse/SPARK-35854 Project

[jira] [Assigned] (SPARK-35645) Merge contents and remove obsolete pages in Getting Started section

[ https://issues.apache.org/jira/browse/SPARK-35645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35645: Assignee: Apache Spark > Merge contents and remove obsolete pages in Getting Started sect

[jira] [Assigned] (SPARK-35645) Merge contents and remove obsolete pages in Getting Started section

[ https://issues.apache.org/jira/browse/SPARK-35645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35645: Assignee: (was: Apache Spark) > Merge contents and remove obsolete pages in Getting S

[jira] [Commented] (SPARK-35645) Merge contents and remove obsolete pages in Getting Started section

[ https://issues.apache.org/jira/browse/SPARK-35645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367158#comment-17367158 ] Apache Spark commented on SPARK-35645: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-35799) Fix the allUpdatesTimeMs metric measuring in FlatMapGroupsWithStateExec

[ https://issues.apache.org/jira/browse/SPARK-35799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-35799: - Fix Version/s: 3.1.3 > Fix the allUpdatesTimeMs metric measuring in FlatMapGroupsWithStateExec >

[jira] [Commented] (SPARK-35696) Refine the code examples in the pandas API on Spark documentation.

[ https://issues.apache.org/jira/browse/SPARK-35696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367131#comment-17367131 ] Apache Spark commented on SPARK-35696: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-35696) Refine the code examples in the pandas API on Spark documentation.

[ https://issues.apache.org/jira/browse/SPARK-35696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35696: Assignee: (was: Apache Spark) > Refine the code examples in the pandas API on Spark d

[jira] [Assigned] (SPARK-35696) Refine the code examples in the pandas API on Spark documentation.

[ https://issues.apache.org/jira/browse/SPARK-35696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35696: Assignee: Apache Spark > Refine the code examples in the pandas API on Spark documentatio

[jira] [Commented] (SPARK-35696) Refine the code examples in the pandas API on Spark documentation.

[ https://issues.apache.org/jira/browse/SPARK-35696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367130#comment-17367130 ] Apache Spark commented on SPARK-35696: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-35318) View internal properties should be hidden for describe table command

[ https://issues.apache.org/jira/browse/SPARK-35318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367069#comment-17367069 ] Apache Spark commented on SPARK-35318: -- User 'jerqi' has created a pull request for

[jira] [Commented] (SPARK-35853) Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible

[ https://issues.apache.org/jira/browse/SPARK-35853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367068#comment-17367068 ] Apache Spark commented on SPARK-35853: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-35853) Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible

[ https://issues.apache.org/jira/browse/SPARK-35853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35853: Assignee: Apache Spark > Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possi

[jira] [Assigned] (SPARK-35853) Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible

[ https://issues.apache.org/jira/browse/SPARK-35853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35853: Assignee: (was: Apache Spark) > Remark the shuffle origin to ENSURE_REQUIREMENTS as f

[jira] [Commented] (SPARK-35853) Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible

[ https://issues.apache.org/jira/browse/SPARK-35853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367066#comment-17367066 ] Apache Spark commented on SPARK-35853: -- User 'ulysses-you' has created a pull reque

[jira] [Updated] (SPARK-35853) Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible

[ https://issues.apache.org/jira/browse/SPARK-35853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35853: -- Description: In some queries, we might repartition by some columns with a large partition number manu

[jira] [Created] (SPARK-35853) Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible

XiDuo You created SPARK-35853: - Summary: Remark the shuffle origin to ENSURE_REQUIREMENTS as far as possible Key: SPARK-35853 URL: https://issues.apache.org/jira/browse/SPARK-35853 Project: Spark