[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Resolved] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

2023-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42611. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40206

[jira] [Assigned] (SPARK-42611) Insert char/varchar length checks for inner fields during resolution

2023-02-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42611: --- Assignee: Anton Okolnychyi > Insert char/varchar length checks for inner fields during

[jira] [Commented] (SPARK-38334) Implement support for DEFAULT values for columns in tables

2023-02-28 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694868#comment-17694868 ] Gengliang Wang commented on SPARK-38334: [~dtenedor] Shall we write docs under

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-42627: -- Description:   {code:java} Exception in thread "main" org.apache.spark.SparkSQLException: Unrecognized SQL

[jira] [Created] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2023-02-28 Thread melin (Jira)
melin created SPARK-42627: - Summary: Spark: Getting SQLException: Unsupported type -102 reading from Oracle Key: SPARK-42627 URL: https://issues.apache.org/jira/browse/SPARK-42627 Project: Spark

[jira] [Resolved] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42491. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40214

[jira] [Updated] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42491: - Priority: Trivial (was: Minor) > Upgrade jetty to 9.4.51.v20230217 >

[jira] [Assigned] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42491: Assignee: Yang Jie > Upgrade jetty to 9.4.51.v20230217 >

[jira] [Assigned] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

2023-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42616: Assignee: Kent Yao > SparkSQLCLIDriver shall only close started hive sessionState >

[jira] [Resolved] (SPARK-42616) SparkSQLCLIDriver shall only close started hive sessionState

2023-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42616. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40211

[jira] [Assigned] (SPARK-41868) Support data type Duration(NANOSECOND)

2023-02-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41868: - Assignee: Takuya Ueshin > Support data type Duration(NANOSECOND) >

[jira] [Resolved] (SPARK-41868) Support data type Duration(NANOSECOND)

2023-02-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41868. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40226

[jira] [Commented] (SPARK-42521) Add NULL values for INSERT commands with user-specified lists of fewer columns than the target table

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694799#comment-17694799 ] Apache Spark commented on SPARK-42521: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42625) Upgrade zstd-jni to 1.5.4-2

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42625. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40225

[jira] [Assigned] (SPARK-42625) Upgrade zstd-jni to 1.5.4-2

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42625: - Assignee: Dongjoon Hyun > Upgrade zstd-jni to 1.5.4-2 > --- >

[jira] [Commented] (SPARK-41874) Implement DataFrame `sameSemantics`

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694796#comment-17694796 ] Apache Spark commented on SPARK-41874: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41874) Implement DataFrame `sameSemantics`

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694795#comment-17694795 ] Apache Spark commented on SPARK-41874: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42624. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40223

[jira] [Assigned] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42624: Assignee: Takuya Ueshin > Reorganize imports in test_functions >

[jira] [Commented] (SPARK-41870) Handle duplicate columns in `createDataFrame`

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694791#comment-17694791 ] Apache Spark commented on SPARK-41870: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41870) Handle duplicate columns in `createDataFrame`

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41870: Assignee: (was: Apache Spark) > Handle duplicate columns in `createDataFrame` >

[jira] [Assigned] (SPARK-41870) Handle duplicate columns in `createDataFrame`

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41870: Assignee: Apache Spark > Handle duplicate columns in `createDataFrame` >

[jira] [Resolved] (SPARK-42543) Specify protocol for UDF artifact transfer in JVM/Scala client

2023-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42543. --- Fix Version/s: 3.4.0 Assignee: Venkata Sai Akhil Gudesa Resolution:

[jira] [Created] (SPARK-42626) Add Destructive Iterator for SparkResult

2023-02-28 Thread Jira
Herman van Hövell created SPARK-42626: - Summary: Add Destructive Iterator for SparkResult Key: SPARK-42626 URL: https://issues.apache.org/jira/browse/SPARK-42626 Project: Spark Issue

[jira] [Commented] (SPARK-41868) Support data type Duration(NANOSECOND)

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694781#comment-17694781 ] Apache Spark commented on SPARK-41868: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41868) Support data type Duration(NANOSECOND)

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41868: Assignee: Apache Spark > Support data type Duration(NANOSECOND) >

[jira] [Assigned] (SPARK-41868) Support data type Duration(NANOSECOND)

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41868: Assignee: (was: Apache Spark) > Support data type Duration(NANOSECOND) >

[jira] [Commented] (SPARK-41868) Support data type Duration(NANOSECOND)

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694780#comment-17694780 ] Apache Spark commented on SPARK-41868: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-40679) add named_struct to spark scala api for parity to spark sql

2023-02-28 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694757#comment-17694757 ] Pablo Langa Blanco commented on SPARK-40679: I think the original development supports the

[jira] [Assigned] (SPARK-42625) Upgrade zstd-jni to 1.5.4-2

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42625: Assignee: (was: Apache Spark) > Upgrade zstd-jni to 1.5.4-2 >

[jira] [Assigned] (SPARK-42625) Upgrade zstd-jni to 1.5.4-2

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42625: Assignee: Apache Spark > Upgrade zstd-jni to 1.5.4-2 > --- > >

[jira] [Commented] (SPARK-42625) Upgrade zstd-jni to 1.5.4-2

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694755#comment-17694755 ] Apache Spark commented on SPARK-42625: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42625) Upgrade zstd-jni to 1.5.4-2

2023-02-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42625: - Summary: Upgrade zstd-jni to 1.5.4-2 Key: SPARK-42625 URL: https://issues.apache.org/jira/browse/SPARK-42625 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694753#comment-17694753 ] Apache Spark commented on SPARK-42539: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Commented] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin"

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694752#comment-17694752 ] Apache Spark commented on SPARK-42539: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42624: Assignee: (was: Apache Spark) > Reorganize imports in test_functions >

[jira] [Assigned] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42624: Assignee: Apache Spark > Reorganize imports in test_functions >

[jira] [Commented] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694729#comment-17694729 ] Apache Spark commented on SPARK-42624: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-42624: -- Component/s: PySpark (was: SQL) > Reorganize imports in test_functions >

[jira] [Created] (SPARK-42624) Reorganize imports in test_functions

2023-02-28 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42624: - Summary: Reorganize imports in test_functions Key: SPARK-42624 URL: https://issues.apache.org/jira/browse/SPARK-42624 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-42614) Make all constructors private[sql]

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42614. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40207

[jira] [Commented] (SPARK-40034) PathOutputCommitters to work with dynamic partition overwrite

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694668#comment-17694668 ] Dongjoon Hyun commented on SPARK-40034: --- For the record, Apache Spark 3.4.0 RC2 is planned on

[jira] [Commented] (SPARK-40034) PathOutputCommitters to work with dynamic partition overwrite

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694664#comment-17694664 ] Dongjoon Hyun commented on SPARK-40034: --- This is reverted from `branch-3.4` via

[jira] [Updated] (SPARK-40034) PathOutputCommitters to work with dynamic partition overwrite

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40034: -- Affects Version/s: 3.5.0 (was: 3.4.0) > PathOutputCommitters to

[jira] [Updated] (SPARK-40034) PathOutputCommitters to work with dynamic partition overwrite

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40034: -- Fix Version/s: 3.5.0 (was: 3.4.0) > PathOutputCommitters to work with

[jira] [Created] (SPARK-42623) parameter markers not blocked in DDL

2023-02-28 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-42623: Summary: parameter markers not blocked in DDL Key: SPARK-42623 URL: https://issues.apache.org/jira/browse/SPARK-42623 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694661#comment-17694661 ] Apache Spark commented on SPARK-42615: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

2023-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42615. --- Fix Version/s: 3.4.1 Resolution: Fixed > Refactor the AnalyzePlan RPC and

[jira] [Assigned] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

2023-02-28 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42615: - Assignee: Ruifeng Zheng > Refactor the AnalyzePlan RPC and add

[jira] [Commented] (SPARK-41551) Improve/complete PathOutputCommitProtocol support for dynamic partitioning

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694632#comment-17694632 ] Apache Spark commented on SPARK-41551: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-41551) Improve/complete PathOutputCommitProtocol support for dynamic partitioning

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694629#comment-17694629 ] Apache Spark commented on SPARK-41551: -- User 'steveloughran' has created a pull request for this

[jira] [Commented] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694622#comment-17694622 ] Apache Spark commented on SPARK-42622: -- User 'jelmerk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42622: Assignee: (was: Apache Spark) > StackOverflowError reading json that does not

[jira] [Commented] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694621#comment-17694621 ] Apache Spark commented on SPARK-42622: -- User 'jelmerk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42622: Assignee: Apache Spark > StackOverflowError reading json that does not conform to schema

[jira] [Updated] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Jelmer Kuperus (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jelmer Kuperus updated SPARK-42622: --- Description: Databricks runtime 12.1 uses a pre-release version of spark 3.4.x we

[jira] [Updated] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Jelmer Kuperus (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jelmer Kuperus updated SPARK-42622: --- Flags: Patch,Important Patch available here https://github.com/apache/spark/pull/40219 >

[jira] [Created] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-02-28 Thread Jelmer Kuperus (Jira)
Jelmer Kuperus created SPARK-42622: -- Summary: StackOverflowError reading json that does not conform to schema Key: SPARK-42622 URL: https://issues.apache.org/jira/browse/SPARK-42622 Project: Spark

[jira] [Commented] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694533#comment-17694533 ] Apache Spark commented on SPARK-42579: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694532#comment-17694532 ] Apache Spark commented on SPARK-42579: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42579: Assignee: (was: Apache Spark) > Extend function.lit() to match Literal.apply() >

[jira] [Assigned] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42579: Assignee: Apache Spark > Extend function.lit() to match Literal.apply() >

[jira] [Commented] (SPARK-42559) Implement DataFrameNaFunctions

2023-02-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694508#comment-17694508 ] BingKun Pan commented on SPARK-42559: - On the way, I will add more UT to cover it. > Implement

[jira] [Commented] (SPARK-42558) Implement DataFrameStatFunctions

2023-02-28 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694507#comment-17694507 ] BingKun Pan commented on SPARK-42558: - I work on it. > Implement DataFrameStatFunctions >

[jira] [Assigned] (SPARK-42559) Implement DataFrameNaFunctions

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42559: Assignee: Apache Spark (was: BingKun Pan) > Implement DataFrameNaFunctions >

[jira] [Assigned] (SPARK-42559) Implement DataFrameNaFunctions

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42559: Assignee: BingKun Pan (was: Apache Spark) > Implement DataFrameNaFunctions >

[jira] [Commented] (SPARK-42559) Implement DataFrameNaFunctions

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694502#comment-17694502 ] Apache Spark commented on SPARK-42559: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42593: Assignee: (was: Apache Spark) > Deprecate & remove the APIs that will be removed in

[jira] [Assigned] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42593: Assignee: Apache Spark > Deprecate & remove the APIs that will be removed in pandas 2.0.

[jira] [Commented] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694464#comment-17694464 ] Apache Spark commented on SPARK-42593: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694463#comment-17694463 ] Apache Spark commented on SPARK-42593: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-42593) Deprecate & remove the APIs that will be removed in pandas 2.0.

2023-02-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42593: Summary: Deprecate & remove the APIs that will be removed in pandas 2.0. (was: Deprecate the

[jira] [Created] (SPARK-42621) Add `inclusive` parameter for date_range

2023-02-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42621: --- Summary: Add `inclusive` parameter for date_range Key: SPARK-42621 URL: https://issues.apache.org/jira/browse/SPARK-42621 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

2023-02-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42620: --- Summary: Add `inclusive` parameter for (DataFrame|Series).between_time Key: SPARK-42620 URL: https://issues.apache.org/jira/browse/SPARK-42620 Project: Spark

[jira] [Assigned] (SPARK-42608) Use full column names for inner fields in resolution errors

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42608: - Assignee: Anton Okolnychyi > Use full column names for inner fields in resolution

[jira] [Resolved] (SPARK-42608) Use full column names for inner fields in resolution errors

2023-02-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42608. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40202

[jira] [Updated] (SPARK-42593) Deprecate the APIs that will be removed in pandas 2.0.

2023-02-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42593: Parent: SPARK-42618 Issue Type: Sub-task (was: New Feature) > Deprecate the APIs that

[jira] [Created] (SPARK-42619) Add `show_counts` parameter for DataFrame.info

2023-02-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42619: --- Summary: Add `show_counts` parameter for DataFrame.info Key: SPARK-42619 URL: https://issues.apache.org/jira/browse/SPARK-42619 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42617) Support `isocalendar`

2023-02-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42617: Parent: SPARK-42618 Issue Type: Sub-task (was: New Feature) > Support `isocalendar` >

[jira] [Created] (SPARK-42618) Support pandas 2.0.0

2023-02-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42618: --- Summary: Support pandas 2.0.0 Key: SPARK-42618 URL: https://issues.apache.org/jira/browse/SPARK-42618 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-42376) Introduce watermark propagation among operators

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694401#comment-17694401 ] Apache Spark commented on SPARK-42376: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-42591) Document SS guide doc for introducing watermark propagation among operators

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42591: Assignee: (was: Apache Spark) > Document SS guide doc for introducing watermark

[jira] [Commented] (SPARK-42591) Document SS guide doc for introducing watermark propagation among operators

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17694400#comment-17694400 ] Apache Spark commented on SPARK-42591: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-42591) Document SS guide doc for introducing watermark propagation among operators

2023-02-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42591: Assignee: Apache Spark > Document SS guide doc for introducing watermark propagation