[jira] [Created] (SPARK-39603) Dataset planning in a unit test takes a very long time to finish (e.g. >8mins for complex job)

Tanin Na Nakorn created SPARK-39603: --- Summary: Dataset planning in a unit test takes a very long time to finish (e.g. >8mins for complex job) Key: SPARK-39603 URL:

[jira] [Created] (SPARK-39602) Invoking .repartition(100000) in a unit test causes the unit test to take >20 minutes.

Tanin Na Nakorn created SPARK-39602: --- Summary: Invoking .repartition(10) in a unit test causes the unit test to take >20 minutes. Key: SPARK-39602 URL: https://issues.apache.org/jira/browse/SPARK-39602

[jira] [Assigned] (SPARK-39396) Spark Thriftserver enabled LDAP，Error using beeline connection: error code 49 - invalid credentials

[ https://issues.apache.org/jira/browse/SPARK-39396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39396: Assignee: weiliang hao > Spark Thriftserver enabled LDAP，Error using beeline connection:

[jira] [Resolved] (SPARK-39396) Spark Thriftserver enabled LDAP，Error using beeline connection: error code 49 - invalid credentials

[ https://issues.apache.org/jira/browse/SPARK-39396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39396. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36784

[jira] [Commented] (SPARK-34026) DataSource V2: Inject repartition and sort nodes to satisfy required distribution and ordering

[ https://issues.apache.org/jira/browse/SPARK-34026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558815#comment-17558815 ] Apache Spark commented on SPARK-34026: -- User 'pan3793' has created a pull request for this issue:

[jira] [Commented] (SPARK-34026) DataSource V2: Inject repartition and sort nodes to satisfy required distribution and ordering

[ https://issues.apache.org/jira/browse/SPARK-34026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558814#comment-17558814 ] Apache Spark commented on SPARK-34026: -- User 'pan3793' has created a pull request for this issue:

[jira] [Commented] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down

[ https://issues.apache.org/jira/browse/SPARK-39601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558788#comment-17558788 ] Apache Spark commented on SPARK-39601: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down

[ https://issues.apache.org/jira/browse/SPARK-39601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39601: Assignee: Apache Spark > AllocationFailure should not be treated as exitCausedByApp when

[jira] [Commented] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down

[ https://issues.apache.org/jira/browse/SPARK-39601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558787#comment-17558787 ] Apache Spark commented on SPARK-39601: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down

[ https://issues.apache.org/jira/browse/SPARK-39601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39601: Assignee: (was: Apache Spark) > AllocationFailure should not be treated as

[jira] [Assigned] (SPARK-39600) Enhance pushdown limit through window

[ https://issues.apache.org/jira/browse/SPARK-39600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39600: Assignee: (was: Apache Spark) > Enhance pushdown limit through window >

[jira] [Commented] (SPARK-39600) Enhance pushdown limit through window

[ https://issues.apache.org/jira/browse/SPARK-39600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558786#comment-17558786 ] Apache Spark commented on SPARK-39600: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39600) Enhance pushdown limit through window

[ https://issues.apache.org/jira/browse/SPARK-39600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39600: Assignee: Apache Spark > Enhance pushdown limit through window >

[jira] [Created] (SPARK-39601) AllocationFailure should not be treated as exitCausedByApp when driver is shutting down

Cheng Pan created SPARK-39601: - Summary: AllocationFailure should not be treated as exitCausedByApp when driver is shutting down Key: SPARK-39601 URL: https://issues.apache.org/jira/browse/SPARK-39601

[jira] [Created] (SPARK-39600) Enhance pushdown limit through window

Yuming Wang created SPARK-39600: --- Summary: Enhance pushdown limit through window Key: SPARK-39600 URL: https://issues.apache.org/jira/browse/SPARK-39600 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558769#comment-17558769 ] Apache Spark commented on SPARK-39596: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39582) "Since " docs on array_agg are incorrect

[ https://issues.apache.org/jira/browse/SPARK-39582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39582: Assignee: Nicholas Chammas > "Since " docs on array_agg are incorrect >

[jira] [Resolved] (SPARK-39582) "Since " docs on array_agg are incorrect

[ https://issues.apache.org/jira/browse/SPARK-39582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39582. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36982

[jira] [Assigned] (SPARK-39595) Upgrade rocksdbjni to 7.3.1

[ https://issues.apache.org/jira/browse/SPARK-39595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39595: Assignee: Yang Jie > Upgrade rocksdbjni to 7.3.1 > --- > >

[jira] [Resolved] (SPARK-39595) Upgrade rocksdbjni to 7.3.1

[ https://issues.apache.org/jira/browse/SPARK-39595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39595. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36979

[jira] [Updated] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39596: - Fix Version/s: 3.3.1 > Run `Linters, licenses, dependencies and documentation generation `

[jira] [Assigned] (SPARK-39599) Upgrade maven to 3.8.6

[ https://issues.apache.org/jira/browse/SPARK-39599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39599: Assignee: Apache Spark > Upgrade maven to 3.8.6 > -- > >

[jira] [Assigned] (SPARK-39599) Upgrade maven to 3.8.6

[ https://issues.apache.org/jira/browse/SPARK-39599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39599: Assignee: (was: Apache Spark) > Upgrade maven to 3.8.6 > -- > >

[jira] [Resolved] (SPARK-39483) Construct the schema from `np.dtype` when `createDataFrame` from a NumPy array

[ https://issues.apache.org/jira/browse/SPARK-39483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39483. --- Resolution: Resolved resolved by https://github.com/apache/spark/pull/36870 > Construct

[jira] [Created] (SPARK-39599) Upgrade maven to 3.8.6

Yang Jie created SPARK-39599: Summary: Upgrade maven to 3.8.6 Key: SPARK-39599 URL: https://issues.apache.org/jira/browse/SPARK-39599 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558740#comment-17558740 ] Apache Spark commented on SPARK-39596: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39596. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36987

[jira] [Assigned] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39596: - Assignee: Dongjoon Hyun > Run `Linters, licenses, dependencies and documentation

[jira] [Assigned] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39596: Assignee: Apache Spark > Run `Linters, licenses, dependencies and documentation

[jira] [Commented] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558738#comment-17558738 ] Apache Spark commented on SPARK-39596: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39596: Assignee: (was: Apache Spark) > Run `Linters, licenses, dependencies and

[jira] [Commented] (SPARK-39596) Run `Linters, licenses, dependencies and documentation generation ` GitHub Actions failed

[ https://issues.apache.org/jira/browse/SPARK-39596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558734#comment-17558734 ] Dongjoon Hyun commented on SPARK-39596: --- Thank you for pinging me, [~LuciferYang]. > Run