[jira] [Commented] (SPARK-44697) Clean up the usage of org.apache.commons.lang3.RandomUtils

[ https://issues.apache.org/jira/browse/SPARK-44697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751446#comment-17751446 ] Snoot.io commented on SPARK-44697: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751447#comment-17751447 ] Yang Jie commented on SPARK-44580: -- A new crash case  

[jira] [Created] (SPARK-44697) Clean up the usage of org.apache.commons.lang3.RandomUtils

Yang Jie created SPARK-44697: Summary: Clean up the usage of org.apache.commons.lang3.RandomUtils Key: SPARK-44697 URL: https://issues.apache.org/jira/browse/SPARK-44697 Project: Spark Issue

[jira] [Commented] (SPARK-42621) Add `inclusive` parameter for date_range

[ https://issues.apache.org/jira/browse/SPARK-42621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751445#comment-17751445 ] Snoot.io commented on SPARK-42621: -- User 'dzhigimont' has created a pull request for this issue:

[jira] [Created] (SPARK-44696) Support deal with microsecond for `from_json` function

lvyanquan created SPARK-44696: - Summary: Support deal with microsecond for `from_json` function Key: SPARK-44696 URL: https://issues.apache.org/jira/browse/SPARK-44696 Project: Spark Issue Type:

[jira] [Commented] (SPARK-44091) Yarn module test failed on MacOs/Apple Slicon

[ https://issues.apache.org/jira/browse/SPARK-44091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751443#comment-17751443 ] Snoot.io commented on SPARK-44091: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-44695) Improve error message for `DataFrame.toDF`.

[ https://issues.apache.org/jira/browse/SPARK-44695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751441#comment-17751441 ] Snoot.io commented on SPARK-44695: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-44695) Improve error message for `DataFrame.toDF`.

[ https://issues.apache.org/jira/browse/SPARK-44695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751439#comment-17751439 ] Snoot.io commented on SPARK-44695: -- User 'itholic' has created a pull request for this issue:

[jira] [Created] (SPARK-44695) Improve error message for `DataFrame.toDF`.

Haejoon Lee created SPARK-44695: --- Summary: Improve error message for `DataFrame.toDF`. Key: SPARK-44695 URL: https://issues.apache.org/jira/browse/SPARK-44695 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-44682) Make pandas error class message_parameters strings

[ https://issues.apache.org/jira/browse/SPARK-44682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44682. -- Fix Version/s: 3.5.0 4.0.0 Assignee: Amanda Liu Resolution:

[jira] [Updated] (SPARK-44694) Add Default & Active SparkSession for Python Client

[ https://issues.apache.org/jira/browse/SPARK-44694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44694: - Epic Link: SPARK-39375 > Add Default & Active SparkSession for Python Client >

[jira] [Created] (SPARK-44694) Add Default & Active SparkSession for Python Client

Hyukjin Kwon created SPARK-44694: Summary: Add Default & Active SparkSession for Python Client Key: SPARK-44694 URL: https://issues.apache.org/jira/browse/SPARK-44694 Project: Spark Issue

[jira] [Resolved] (SPARK-44693) The `SqlApi` module should use a more appropriate Setting object name.

[ https://issues.apache.org/jira/browse/SPARK-44693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44693. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-44693) The `SqlApi` module should use a more appropriate Setting object name.

[ https://issues.apache.org/jira/browse/SPARK-44693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44693: Assignee: Yang Jie > The `SqlApi` module should use a more appropriate Setting object name. >

[jira] [Created] (SPARK-44693) The `SqlApi` module should use a more appropriate Setting object name.

Yang Jie created SPARK-44693: Summary: The `SqlApi` module should use a more appropriate Setting object name. Key: SPARK-44693 URL: https://issues.apache.org/jira/browse/SPARK-44693 Project: Spark

[jira] [Resolved] (SPARK-44376) Build using maven is broken using 2.13 and Java 11 and Java 17

[ https://issues.apache.org/jira/browse/SPARK-44376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44376. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-44690) Downgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-44690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44690: Assignee: Yang Jie > Downgrade Scala to 2.13.8 > - > >

[jira] [Resolved] (SPARK-44690) Downgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-44690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44690. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Created] (SPARK-44692) Move Trigger.scala to sql/api

Herman van Hövell created SPARK-44692: - Summary: Move Trigger.scala to sql/api Key: SPARK-44692 URL: https://issues.apache.org/jira/browse/SPARK-44692 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-41636) DataSourceStrategy#selectFilters returns predicates in non-deterministic order

[ https://issues.apache.org/jira/browse/SPARK-41636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41636: Assignee: Jia Fan > DataSourceStrategy#selectFilters returns predicates in

[jira] [Resolved] (SPARK-41636) DataSourceStrategy#selectFilters returns predicates in non-deterministic order

[ https://issues.apache.org/jira/browse/SPARK-41636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41636. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-44629) Publish PySpark Test Guidelines webpage

[ https://issues.apache.org/jira/browse/SPARK-44629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44629. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44629) Publish PySpark Test Guidelines webpage

[ https://issues.apache.org/jira/browse/SPARK-44629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44629: Assignee: Amanda Liu > Publish PySpark Test Guidelines webpage >

[jira] [Updated] (SPARK-44622) Add GetErrorInfo RPC

[ https://issues.apache.org/jira/browse/SPARK-44622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yihong He updated SPARK-44622: -- Summary: Add GetErrorInfo RPC (was: Add GetDebugInfo RPC) > Add GetErrorInfo RPC >

[jira] [Resolved] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42500. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42038

[jira] [Assigned] (SPARK-42500) ConstantPropagation support more cases

[ https://issues.apache.org/jira/browse/SPARK-42500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42500: --- Assignee: Tongwei > ConstantPropagation support more cases >

[jira] [Updated] (SPARK-44690) Downgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-44690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44690: - Affects Version/s: 4.0.0 > Downgrade Scala to 2.13.8 > - > >

[jira] [Created] (SPARK-44691) Move Subclasses of Analysis to sql/api

Yihong He created SPARK-44691: - Summary: Move Subclasses of Analysis to sql/api Key: SPARK-44691 URL: https://issues.apache.org/jira/browse/SPARK-44691 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-44650) `spark.executor.defaultJavaOptions` Check illegal java options

[ https://issues.apache.org/jira/browse/SPARK-44650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-44650: - Issue Type: Improvement (was: Bug) > `spark.executor.defaultJavaOptions` Check illegal java

[jira] [Resolved] (SPARK-44650) `spark.executor.defaultJavaOptions` Check illegal java options

[ https://issues.apache.org/jira/browse/SPARK-44650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-44650. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42313

[jira] [Assigned] (SPARK-44650) `spark.executor.defaultJavaOptions` Check illegal java options

[ https://issues.apache.org/jira/browse/SPARK-44650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-44650: Assignee: dzcxzl > `spark.executor.defaultJavaOptions` Check illegal java options >

[jira] [Assigned] (SPARK-44688) Should check if `free_disk_space` exists first, then proceed to execution.

[ https://issues.apache.org/jira/browse/SPARK-44688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44688: Assignee: Yang Jie > Should check if `free_disk_space` exists first, then proceed to execution.

[jira] [Resolved] (SPARK-44688) Should check if `free_disk_space` exists first, then proceed to execution.

[ https://issues.apache.org/jira/browse/SPARK-44688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44688. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42359

[jira] [Commented] (SPARK-38475) Use error classes in org.apache.spark.serializer

[ https://issues.apache.org/jira/browse/SPARK-38475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751373#comment-17751373 ] ASF GitHub Bot commented on SPARK-38475: User 'bozhang2820' has created a pull request for this