[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501675#comment-17501675 ] Ismael Juma commented on SPARK-25075: - Yeah, I was asking since Kafka plans to drop support for

[jira] [Assigned] (SPARK-38419) Remove tab character and trailing space in script

[ https://issues.apache.org/jira/browse/SPARK-38419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38419: Assignee: Apache Spark > Remove tab character and trailing space in script >

[jira] [Commented] (SPARK-38419) Remove tab character and trailing space in script

[ https://issues.apache.org/jira/browse/SPARK-38419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501662#comment-17501662 ] Apache Spark commented on SPARK-38419: -- User 'stczwd' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38419) Remove tab character and trailing space in script

[ https://issues.apache.org/jira/browse/SPARK-38419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38419: Assignee: (was: Apache Spark) > Remove tab character and trailing space in script >

[jira] [Commented] (SPARK-38189) Add priority scheduling doc for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501643#comment-17501643 ] Dongjoon Hyun commented on SPARK-38189: --- I moved out this from SPARK-36057 because this is a

[jira] [Resolved] (SPARK-38189) Add priority scheduling doc for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38189. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-38189) Add priority scheduling doc for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38189: -- Issue Type: Task (was: Improvement) > Add priority scheduling doc for Spark on K8S >

[jira] [Updated] (SPARK-38189) Add priority scheduling doc for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38189: -- Parent: (was: SPARK-36057) Issue Type: Improvement (was: Sub-task) > Add

[jira] [Assigned] (SPARK-38189) Add priority scheduling doc for Spark on K8S

[ https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38189: - Assignee: Yikun Jiang > Add priority scheduling doc for Spark on K8S >

[jira] [Assigned] (SPARK-38418) Add PySpark cleanShuffleDependencies API

[ https://issues.apache.org/jira/browse/SPARK-38418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38418: - Assignee: Dongjoon Hyun > Add PySpark cleanShuffleDependencies API >

[jira] [Resolved] (SPARK-38418) Add PySpark cleanShuffleDependencies API

[ https://issues.apache.org/jira/browse/SPARK-38418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38418. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35737

[jira] [Created] (SPARK-38419) Remove tab character and trailing space in script

Jackey Lee created SPARK-38419: -- Summary: Remove tab character and trailing space in script Key: SPARK-38419 URL: https://issues.apache.org/jira/browse/SPARK-38419 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-38418) Add PySpark cleanShuffleDependencies API

[ https://issues.apache.org/jira/browse/SPARK-38418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38418: Assignee: Apache Spark > Add PySpark cleanShuffleDependencies API >

[jira] [Assigned] (SPARK-38418) Add PySpark cleanShuffleDependencies API

[ https://issues.apache.org/jira/browse/SPARK-38418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38418: Assignee: (was: Apache Spark) > Add PySpark cleanShuffleDependencies API >

[jira] [Commented] (SPARK-38418) Add PySpark cleanShuffleDependencies API

[ https://issues.apache.org/jira/browse/SPARK-38418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501622#comment-17501622 ] Apache Spark commented on SPARK-38418: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-38418) Add PySpark cleanShuffleDependencies API

Dongjoon Hyun created SPARK-38418: - Summary: Add PySpark cleanShuffleDependencies API Key: SPARK-38418 URL: https://issues.apache.org/jira/browse/SPARK-38418 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API

[ https://issues.apache.org/jira/browse/SPARK-38417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38417. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35736

[jira] [Assigned] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API

[ https://issues.apache.org/jira/browse/SPARK-38417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38417: - Assignee: Dongjoon Hyun > Remove `Experimental` from `RDD.cleanShuffleDependencies`

[jira] [Assigned] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API

[ https://issues.apache.org/jira/browse/SPARK-38417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38417: Assignee: (was: Apache Spark) > Remove `Experimental` from

[jira] [Commented] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API

[ https://issues.apache.org/jira/browse/SPARK-38417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501577#comment-17501577 ] Apache Spark commented on SPARK-38417: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API

[ https://issues.apache.org/jira/browse/SPARK-38417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38417: Assignee: Apache Spark > Remove `Experimental` from `RDD.cleanShuffleDependencies` API >

[jira] [Created] (SPARK-38417) Remove `Experimental` from `RDD.cleanShuffleDependencies` API

Dongjoon Hyun created SPARK-38417: - Summary: Remove `Experimental` from `RDD.cleanShuffleDependencies` API Key: SPARK-38417 URL: https://issues.apache.org/jira/browse/SPARK-38417 Project: Spark

[jira] [Created] (SPARK-38416) Duplicate functions

Bjørn Jørgensen created SPARK-38416: --- Summary: Duplicate functions Key: SPARK-38416 URL: https://issues.apache.org/jira/browse/SPARK-38416 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33206) Spark Shuffle Index Cache calculates memory usage wrong

[ https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33206: -- Fix Version/s: 3.0.4 > Spark Shuffle Index Cache calculates memory usage wrong >

[jira] [Commented] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501474#comment-17501474 ] Daniel commented on SPARK-38415: PR to update this behavior is out for review in:

[jira] [Commented] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501475#comment-17501475 ] Apache Spark commented on SPARK-38415: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501473#comment-17501473 ] Apache Spark commented on SPARK-38415: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38415: Assignee: (was: Apache Spark) > Update histogram_numeric (x, y) result type to make

[jira] [Assigned] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

[ https://issues.apache.org/jira/browse/SPARK-38415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38415: Assignee: Apache Spark > Update histogram_numeric (x, y) result type to make x == input

[jira] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

[ https://issues.apache.org/jira/browse/SPARK-38415 ] Daniel deleted comment on SPARK-38415: was (Author: JIRAUSER285772): PR to update this behavior is out for review in: https://github.com/apache/spark/pull/35735 > Update histogram_numeric (x,

[jira] [Created] (SPARK-38415) Update histogram_numeric (x, y) result type to make x == input type

Daniel created SPARK-38415: -- Summary: Update histogram_numeric (x, y) result type to make x == input type Key: SPARK-38415 URL: https://issues.apache.org/jira/browse/SPARK-38415 Project: Spark

[jira] [Commented] (SPARK-38188) Support queue scheduling (Introduce queue) with volcano implementations

[ https://issues.apache.org/jira/browse/SPARK-38188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501429#comment-17501429 ] Apache Spark commented on SPARK-38188: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-32432) Add support for reading ORC/Parquet files with SymlinkTextInputFormat

[ https://issues.apache.org/jira/browse/SPARK-32432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501430#comment-17501430 ] Apache Spark commented on SPARK-32432: -- User 'CHENXCHEN' has created a pull request for this issue:

[jira] [Commented] (SPARK-32432) Add support for reading ORC/Parquet files with SymlinkTextInputFormat

[ https://issues.apache.org/jira/browse/SPARK-32432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501427#comment-17501427 ] CHC commented on SPARK-32432: - As follows example, analyze the table size will be 100 instead of 1,

[jira] [Commented] (SPARK-38285) ClassCastException: GenericArrayData cannot be cast to InternalRow

[ https://issues.apache.org/jira/browse/SPARK-38285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501363#comment-17501363 ] Alessandro Bacchini commented on SPARK-38285: - Any news on this issue? The code freeze for

[jira] [Assigned] (SPARK-38196) Reactor framework so as JDBC dialect could compile expression by self way

[ https://issues.apache.org/jira/browse/SPARK-38196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38196: --- Assignee: jiaan.geng > Reactor framework so as JDBC dialect could compile expression by

[jira] [Resolved] (SPARK-38196) Reactor framework so as JDBC dialect could compile expression by self way

[ https://issues.apache.org/jira/browse/SPARK-38196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38196. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35494

[jira] [Resolved] (SPARK-38345) Introduce SQL function ARRAY_SIZE

[ https://issues.apache.org/jira/browse/SPARK-38345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38345. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35671

[jira] [Assigned] (SPARK-38345) Introduce SQL function ARRAY_SIZE

[ https://issues.apache.org/jira/browse/SPARK-38345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38345: --- Assignee: Xinrong Meng > Introduce SQL function ARRAY_SIZE >

[jira] [Resolved] (SPARK-38312) Use error classes in spark-core

[ https://issues.apache.org/jira/browse/SPARK-38312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38312. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35643

[jira] [Assigned] (SPARK-38312) Use error classes in spark-core

[ https://issues.apache.org/jira/browse/SPARK-38312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38312: --- Assignee: Bo Zhang > Use error classes in spark-core > --- > >

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Description: As we all know, table & column statistics are very important to spark SQL optimizer,

[jira] [Updated] (SPARK-38258) [proposal] collect & update statistics automatically when spark SQL is running

[ https://issues.apache.org/jira/browse/SPARK-38258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gabrywu updated SPARK-38258: Description: As we all know, table & column statistics are very important to spark SQL optimizer,

[jira] [Assigned] (SPARK-38414) Remove redundant SuppressWarnings

[ https://issues.apache.org/jira/browse/SPARK-38414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38414: Assignee: Apache Spark > Remove redundant SuppressWarnings >

[jira] [Assigned] (SPARK-38414) Remove redundant SuppressWarnings

[ https://issues.apache.org/jira/browse/SPARK-38414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38414: Assignee: (was: Apache Spark) > Remove redundant SuppressWarnings >

[jira] [Commented] (SPARK-38414) Remove redundant SuppressWarnings

[ https://issues.apache.org/jira/browse/SPARK-38414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501216#comment-17501216 ] Apache Spark commented on SPARK-38414: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38414) Remove redundant SuppressWarnings

Yang Jie created SPARK-38414: Summary: Remove redundant SuppressWarnings Key: SPARK-38414 URL: https://issues.apache.org/jira/browse/SPARK-38414 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-38413) Invalid call to exprId

liujintao created SPARK-38413: - Summary: Invalid call to exprId Key: SPARK-38413 URL: https://issues.apache.org/jira/browse/SPARK-38413 Project: Spark Issue Type: Bug Components: SQL