[jira] [Resolved] (SPARK-38537) Unify Statefulset* to StatefulSet*

[ https://issues.apache.org/jira/browse/SPARK-38537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38537. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35827 [https://

[jira] [Assigned] (SPARK-38537) Unify Statefulset* to StatefulSet*

[ https://issues.apache.org/jira/browse/SPARK-38537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38537: - Assignee: Dongjoon Hyun > Unify Statefulset* to StatefulSet* >

[jira] [Resolved] (SPARK-38320) (flat)MapGroupsWithState can timeout groups which just received inputs in the same microbatch

[ https://issues.apache.org/jira/browse/SPARK-38320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38320. -- Fix Version/s: 3.3.0 3.2.2 Assignee: Alex Balikov Resolution

[jira] [Assigned] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38538: --- Assignee: Dongjoon Hyun > Fix driver environment verification in BasicDriverFeatureStepSuit

[jira] [Resolved] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38538. - Fix Version/s: 3.3.0 3.0.4 3.2.2 3.1.3

[jira] [Commented] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

[ https://issues.apache.org/jira/browse/SPARK-38539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505384#comment-17505384 ] Apache Spark commented on SPARK-38539: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

[ https://issues.apache.org/jira/browse/SPARK-38539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38539: Assignee: (was: Apache Spark) > Add document for ToNumber for DecimalFormat's compati

[jira] [Commented] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

[ https://issues.apache.org/jira/browse/SPARK-38539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505383#comment-17505383 ] Apache Spark commented on SPARK-38539: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

[ https://issues.apache.org/jira/browse/SPARK-38539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38539: Assignee: Apache Spark > Add document for ToNumber for DecimalFormat's compatibility > --

[jira] [Created] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

jiaan.geng created SPARK-38539: -- Summary: Add document for ToNumber for DecimalFormat's compatibility Key: SPARK-38539 URL: https://issues.apache.org/jira/browse/SPARK-38539 Project: Spark Issu

[jira] [Commented] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505380#comment-17505380 ] Apache Spark commented on SPARK-36058: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505379#comment-17505379 ] Apache Spark commented on SPARK-38538: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38538: Assignee: (was: Apache Spark) > Fix driver environment verification in BasicDriverFea

[jira] [Assigned] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38538: Assignee: Apache Spark > Fix driver environment verification in BasicDriverFeatureStepSui

[jira] [Updated] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38538: -- Issue Type: Bug (was: Test) > Fix driver environment verification in BasicDriverFeatureStepSu

[jira] [Created] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

Dongjoon Hyun created SPARK-38538: - Summary: Fix driver environment verification in BasicDriverFeatureStepSuite Key: SPARK-38538 URL: https://issues.apache.org/jira/browse/SPARK-38538 Project: Spark

[jira] [Assigned] (SPARK-38537) Unify Statefulset* to StatefulSet*

[ https://issues.apache.org/jira/browse/SPARK-38537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38537: Assignee: (was: Apache Spark) > Unify Statefulset* to StatefulSet* >

[jira] [Commented] (SPARK-38537) Unify Statefulset* to StatefulSet*

[ https://issues.apache.org/jira/browse/SPARK-38537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505378#comment-17505378 ] Apache Spark commented on SPARK-38537: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-38537) Unify Statefulset* to StatefulSet*

[ https://issues.apache.org/jira/browse/SPARK-38537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38537: Assignee: Apache Spark > Unify Statefulset* to StatefulSet* > ---

[jira] [Created] (SPARK-38537) Unify Statefulset* to StatefulSet*

Dongjoon Hyun created SPARK-38537: - Summary: Unify Statefulset* to StatefulSet* Key: SPARK-38537 URL: https://issues.apache.org/jira/browse/SPARK-38537 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36371) Support raw string literal

[ https://issues.apache.org/jira/browse/SPARK-36371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36371: Labels: release-notes (was: ) > Support raw string literal > -- > >

[jira] [Updated] (SPARK-34806) Helper class for batch Dataset.observe()

[ https://issues.apache.org/jira/browse/SPARK-34806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-34806: Labels: release-notes (was: ) > Helper class for batch Dataset.observe() > --

[jira] [Resolved] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37430. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35739

[jira] [Assigned] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37430: -- Assignee: alper tankut turker > Inline type hints for python/pyspark/mllib/li

[jira] [Created] (SPARK-38536) Spark 3 can not read mixed format partitions

Huicheng Song created SPARK-38536: - Summary: Spark 3 can not read mixed format partitions Key: SPARK-38536 URL: https://issues.apache.org/jira/browse/SPARK-38536 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Xu updated SPARK-38388: - Labels: correctness data-loss (was: ) > Repartition + Stage retries could lead to incorrect data > ---

[jira] [Assigned] (SPARK-38535) Add the datetimeUnit enum to the grammar and use it in TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38535: Assignee: Apache Spark (was: Max Gekk) > Add the datetimeUnit enum to the grammar and us

[jira] [Commented] (SPARK-38535) Add the datetimeUnit enum to the grammar and use it in TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505260#comment-17505260 ] Apache Spark commented on SPARK-38535: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-38535) Add the datetimeUnit enum to the grammar and use it in TIMESTAMPADD/DIFF

[ https://issues.apache.org/jira/browse/SPARK-38535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38535: Assignee: Max Gekk (was: Apache Spark) > Add the datetimeUnit enum to the grammar and us

[jira] [Created] (SPARK-38535) Add the datetimeUnit enum to the grammar and use it in TIMESTAMPADD/DIFF

Max Gekk created SPARK-38535: Summary: Add the datetimeUnit enum to the grammar and use it in TIMESTAMPADD/DIFF Key: SPARK-38535 URL: https://issues.apache.org/jira/browse/SPARK-38535 Project: Spark

[jira] [Resolved] (SPARK-38534) Disable to_timestamp('366', 'DD') test case

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38534. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35825 [https://

[jira] [Assigned] (SPARK-38534) Disable to_timestamp('366', 'DD') test case

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38534: - Assignee: Dongjoon Hyun > Disable to_timestamp('366', 'DD') test case > ---

[jira] [Updated] (SPARK-38534) Disable to_timestamp('366', 'DD') test case

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38534: -- Summary: Disable to_timestamp('366', 'DD') test case (was: Flaky Test: ansi/datetime-parsing-

[jira] [Updated] (SPARK-38534) Disable to_timestamp('366', 'DD') test case

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38534: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Bug) > Disable to_timestamp('366', 'DD

[jira] [Updated] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38534: -- Description: Currently, Daily Java 11 and 17 build are broken. - https://github.com/apache/spa

[jira] [Updated] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38534: -- Description: Currently, Java 17 build is broken. - https://github.com/apache/spark/actions/run

[jira] [Assigned] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38534: Assignee: Apache Spark > Flaky Test: ansi/datetime-parsing-invalid.sql >

[jira] [Commented] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505220#comment-17505220 ] Apache Spark commented on SPARK-38534: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38534: Assignee: (was: Apache Spark) > Flaky Test: ansi/datetime-parsing-invalid.sql > -

[jira] [Commented] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505219#comment-17505219 ] Apache Spark commented on SPARK-38534: -- User 'dongjoon-hyun' has created a pull req

[jira] [Updated] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38534: -- Description: **Java 8** {code} $ bin/spark-shell --conf spark.sql.ansi.enabled=true Setting de

[jira] [Comment Edited] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505216#comment-17505216 ] Dongjoon Hyun edited comment on SPARK-38534 at 3/12/22, 8:35 AM: -

[jira] [Commented] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

[ https://issues.apache.org/jira/browse/SPARK-38534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505216#comment-17505216 ] Dongjoon Hyun commented on SPARK-38534: --- cc [~gengliang] > Flaky Test: ansi/datet

[jira] [Created] (SPARK-38534) Flaky Test: ansi/datetime-parsing-invalid.sql

Dongjoon Hyun created SPARK-38534: - Summary: Flaky Test: ansi/datetime-parsing-invalid.sql Key: SPARK-38534 URL: https://issues.apache.org/jira/browse/SPARK-38534 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-38532) Add test case for invalid gapDuration of sessionwindow

[ https://issues.apache.org/jira/browse/SPARK-38532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505215#comment-17505215 ] Apache Spark commented on SPARK-38532: -- User 'nyingping' has created a pull request

[jira] [Assigned] (SPARK-38532) Add test case for invalid gapDuration of sessionwindow

[ https://issues.apache.org/jira/browse/SPARK-38532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38532: Assignee: (was: Apache Spark) > Add test case for invalid gapDuration of sessionwindo

[jira] [Commented] (SPARK-38532) Add test case for invalid gapDuration of sessionwindow

[ https://issues.apache.org/jira/browse/SPARK-38532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505214#comment-17505214 ] Apache Spark commented on SPARK-38532: -- User 'nyingping' has created a pull request

[jira] [Assigned] (SPARK-38532) Add test case for invalid gapDuration of sessionwindow

[ https://issues.apache.org/jira/browse/SPARK-38532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38532: Assignee: Apache Spark > Add test case for invalid gapDuration of sessionwindow > ---