[jira] [Commented] (SPARK-40732) Double type precision problem

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17734010#comment-17734010 ] Dongjoon Hyun commented on SPARK-40732: --- I found the original Java change. - https

[jira] [Resolved] (SPARK-43929) Add date time functions to Scala and Python - part 1

2023-06-18 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43929. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41636 [https://

[jira] [Assigned] (SPARK-43929) Add date time functions to Scala and Python - part 1

2023-06-18 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43929: - Assignee: jiaan.geng > Add date time functions to Scala and Python - part 1 > -

[jira] [Commented] (SPARK-44083) Spark streaming: Add max pending microbatches conf to skip scheduling new mircobatch

2023-06-18 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17734000#comment-17734000 ] Jungtaek Lim commented on SPARK-44083: -- I'm sorry to say, but we decided DStream to

[jira] [Updated] (SPARK-44083) Spark streaming: Add max pending microbatches conf to skip scheduling new mircobatch

2023-06-18 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-44083: - Component/s: DStreams (was: Structured Streaming) > Spark streaming: Add ma

[jira] [Assigned] (SPARK-44092) Add `Utils.isJavaVersionAtLeast21` and make `core` module tests pass with Java 21

2023-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44092: Assignee: Dongjoon Hyun > Add `Utils.isJavaVersionAtLeast21` and make `core` module tests

[jira] [Resolved] (SPARK-44092) Add `Utils.isJavaVersionAtLeast21` and make `core` module tests pass with Java 21

2023-06-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44092. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41648 [https://gi

[jira] [Resolved] (SPARK-44095) Make HiveExternalCatalogVersionsSuite skip old Spark versions on Java 21

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44095. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41652 [https://

[jira] [Assigned] (SPARK-44095) Make HiveExternalCatalogVersionsSuite skip old Spark versions on Java 21

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44095: - Assignee: Dongjoon Hyun > Make HiveExternalCatalogVersionsSuite skip old Spark versions

[jira] [Created] (SPARK-44095) Make HiveExternalCatalogVersionsSuite skip old Spark versions on Java 21

2023-06-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44095: - Summary: Make HiveExternalCatalogVersionsSuite skip old Spark versions on Java 21 Key: SPARK-44095 URL: https://issues.apache.org/jira/browse/SPARK-44095 Project: S

[jira] [Assigned] (SPARK-44034) Add a new test group for sql module

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44034: - Assignee: Yang Jie > Add a new test group for sql module >

[jira] [Resolved] (SPARK-44034) Add a new test group for sql module

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44034. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41638 [https://

[jira] [Resolved] (SPARK-44094) Upgrade Apache Arrow to 12.0.1

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44094. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41650 [https://

[jira] [Assigned] (SPARK-44094) Upgrade Apache Arrow to 12.0.1

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44094: - Assignee: Dongjoon Hyun > Upgrade Apache Arrow to 12.0.1 >

[jira] [Commented] (SPARK-44087) pyspark sql

2023-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733947#comment-17733947 ] Bjørn Jørgensen commented on SPARK-44087: - Hi, we do have a mailing list for [Q

[jira] [Comment Edited] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

2023-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733945#comment-17733945 ] Bjørn Jørgensen edited comment on SPARK-44050 at 6/18/23 7:50 PM:

[jira] [Comment Edited] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

2023-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733945#comment-17733945 ] Bjørn Jørgensen edited comment on SPARK-44050 at 6/18/23 7:49 PM:

[jira] [Commented] (SPARK-44050) Unable to Mount ConfigMap in Driver Pod - ConfigMap Creation Issue

2023-06-18 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733945#comment-17733945 ] Bjørn Jørgensen commented on SPARK-44050: - https://issues.apache.org/jira/browse

[jira] [Resolved] (SPARK-44093) Make `catalyst` module passes in Java 21

2023-06-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44093. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41649 [https://github.com

[jira] [Assigned] (SPARK-44093) Make `catalyst` module passes in Java 21

2023-06-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44093: Assignee: Dongjoon Hyun > Make `catalyst` module passes in Java 21 >

[jira] [Assigned] (SPARK-44089) Remove the ignore Annotation from `AlterTableRenamePartitionSuite`

2023-06-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44089: Assignee: Yang Jie > Remove the ignore Annotation from `AlterTableRenamePartitionSuite` > ---

[jira] [Resolved] (SPARK-44089) Remove the ignore Annotation from `AlterTableRenamePartitionSuite`

2023-06-18 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44089. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41647 [https://github.com

[jira] [Assigned] (SPARK-44024) Change to use `map` where `unzip` used to extract a single element

2023-06-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44024: Assignee: Yang Jie > Change to use `map` where `unzip` used to extract a single element

[jira] [Resolved] (SPARK-44024) Change to use `map` where `unzip` used to extract a single element

2023-06-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44024. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41548 [https://gi

[jira] [Created] (SPARK-44094) Upgrade Apache Arrow to 12.0.1

2023-06-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44094: - Summary: Upgrade Apache Arrow to 12.0.1 Key: SPARK-44094 URL: https://issues.apache.org/jira/browse/SPARK-44094 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-40791) The semantics of `F` in `DateTimeFormatter` have changed

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733880#comment-17733880 ] Dongjoon Hyun commented on SPARK-40791: --- Here are some updates for this JIRA, [~Lu

[jira] [Comment Edited] (SPARK-40732) Double type precision problem

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733879#comment-17733879 ] Dongjoon Hyun edited comment on SPARK-40732 at 6/18/23 8:30 AM: --

[jira] [Commented] (SPARK-40732) Double type precision problem

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733879#comment-17733879 ] Dongjoon Hyun commented on SPARK-40732: --- I confirmed that Java 21-ea also has the

[jira] [Updated] (SPARK-44093) Make `catalyst` module passes in Java 21

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44093: -- Summary: Make `catalyst` module passes in Java 21 (was: Fix `catalyst` module passes in Java

[jira] [Created] (SPARK-44093) Fix `catalyst` module passes in Java 21

2023-06-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44093: - Summary: Fix `catalyst` module passes in Java 21 Key: SPARK-44093 URL: https://issues.apache.org/jira/browse/SPARK-44093 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-44092) Add `Utils.isJavaVersionAtLeast21` and make `core` module tests pass with Java 21

2023-06-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44092: -- Summary: Add `Utils.isJavaVersionAtLeast21` and make `core` module tests pass with Java 21 (w