[jira] [Assigned] (SPARK-38999) Refactor DataSourceScanExec code to

[ https://issues.apache.org/jira/browse/SPARK-38999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38999: Assignee: (was: Apache Spark) > Refactor DataSourceScanExec code to >

[jira] [Commented] (SPARK-38999) Refactor DataSourceScanExec code to

[ https://issues.apache.org/jira/browse/SPARK-38999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526697#comment-17526697 ] Apache Spark commented on SPARK-38999: -- User 'utkarsh39' has created a pull request for this issue:

[jira] [Commented] (SPARK-38999) Refactor DataSourceScanExec code to

[ https://issues.apache.org/jira/browse/SPARK-38999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526696#comment-17526696 ] Apache Spark commented on SPARK-38999: -- User 'utkarsh39' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38999) Refactor DataSourceScanExec code to

[ https://issues.apache.org/jira/browse/SPARK-38999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38999: Assignee: Apache Spark > Refactor DataSourceScanExec code to >

[jira] [Assigned] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39000: Assignee: (was: Apache Spark) > Convert bools to ints in basic statistical functions

[jira] [Assigned] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39000: Assignee: Apache Spark > Convert bools to ints in basic statistical functions of GroupBy

[jira] [Commented] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

[ https://issues.apache.org/jira/browse/SPARK-39000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526690#comment-17526690 ] Apache Spark commented on SPARK-39000: -- User 'xinrong-databricks' has created a pull request for

[jira] [Created] (SPARK-39000) Convert bools to ints in basic statistical functions of GroupBy objects

Xinrong Meng created SPARK-39000: Summary: Convert bools to ints in basic statistical functions of GroupBy objects Key: SPARK-39000 URL: https://issues.apache.org/jira/browse/SPARK-39000 Project:

[jira] [Created] (SPARK-38999) Refactor DataSourceScanExec code to

Utkarsh Agarwal created SPARK-38999: --- Summary: Refactor DataSourceScanExec code to Key: SPARK-38999 URL: https://issues.apache.org/jira/browse/SPARK-38999 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-38977) Fix schema pruning with correlated subqueries

[ https://issues.apache.org/jira/browse/SPARK-38977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-38977. - Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-38977) Fix schema pruning with correlated subqueries

[ https://issues.apache.org/jira/browse/SPARK-38977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-38977: --- Assignee: Anton Okolnychyi > Fix schema pruning with correlated subqueries >

[jira] [Resolved] (SPARK-38732) Test the error class: INCOMPARABLE_PIVOT_COLUMN

[ https://issues.apache.org/jira/browse/SPARK-38732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38732. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36323

[jira] [Assigned] (SPARK-38732) Test the error class: INCOMPARABLE_PIVOT_COLUMN

[ https://issues.apache.org/jira/browse/SPARK-38732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38732: Assignee: lvshaokang > Test the error class: INCOMPARABLE_PIVOT_COLUMN >

[jira] [Resolved] (SPARK-38996) Use double quotes for types in error massages

[ https://issues.apache.org/jira/browse/SPARK-38996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38996. -- Fix Version/s: 3.4.0 (was: 3.3.0) Resolution: Fixed Issue resolved by

[jira] [Assigned] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-38973: --- Assignee: Chandni Singh > When push-based shuffle is enabled, a stage may

[jira] [Resolved] (SPARK-38973) When push-based shuffle is enabled, a stage may not complete when retried

[ https://issues.apache.org/jira/browse/SPARK-38973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-38973. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-38989) Implement `ignore_index` of `DataFrame/Series.sample`

[ https://issues.apache.org/jira/browse/SPARK-38989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38989: Assignee: (was: Apache Spark) > Implement `ignore_index` of

[jira] [Commented] (SPARK-38989) Implement `ignore_index` of `DataFrame/Series.sample`

[ https://issues.apache.org/jira/browse/SPARK-38989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526560#comment-17526560 ] Apache Spark commented on SPARK-38989: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38989) Implement `ignore_index` of `DataFrame/Series.sample`

[ https://issues.apache.org/jira/browse/SPARK-38989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38989: Assignee: Apache Spark > Implement `ignore_index` of `DataFrame/Series.sample` >

[jira] [Updated] (SPARK-38998) Call to MetricsSystem#getServletHandlers() may take place before MetricsSystem becomes running

[ https://issues.apache.org/jira/browse/SPARK-38998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-38998: --- Description: Sometimes the following exception is observed: {code} java.lang.IllegalArgumentException:

[jira] [Updated] (SPARK-38998) Call to MetricsSystem#getServletHandlers() may take place before MetricsSystem becomes running

[ https://issues.apache.org/jira/browse/SPARK-38998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-38998: --- Description: Sometimes the following exception is observed: {code} java.lang.IllegalArgumentException:

[jira] [Created] (SPARK-38998) Call to MetricsSystem#getServletHandlers() may take place before MetricsSystem becomes running

Ted Yu created SPARK-38998: -- Summary: Call to MetricsSystem#getServletHandlers() may take place before MetricsSystem becomes running Key: SPARK-38998 URL: https://issues.apache.org/jira/browse/SPARK-38998

[jira] [Commented] (SPARK-38897) DS V2 supports push down string functions

[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526432#comment-17526432 ] Apache Spark commented on SPARK-38897: -- User 'chenzhx' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38897) DS V2 supports push down string functions

[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38897: Assignee: Apache Spark > DS V2 supports push down string functions >

[jira] [Assigned] (SPARK-38897) DS V2 supports push down string functions

[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38897: Assignee: (was: Apache Spark) > DS V2 supports push down string functions >

[jira] [Assigned] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38968: Assignee: qian > remove hadoopConf from KerberosConfDriverFeatureStep >

[jira] [Updated] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38968: - Priority: Trivial (was: Minor) > remove hadoopConf from KerberosConfDriverFeatureStep >

[jira] [Resolved] (SPARK-38968) remove hadoopConf from KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38968. -- Resolution: Fixed Issue resolved by pull request 36283

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Commented] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526358#comment-17526358 ] Jack commented on SPARK-38862: -- Further to investigating an implementation for this, I found in the master

[jira] [Commented] (SPARK-38997) DS V2 aggregate push-down supports group by expressions

[ https://issues.apache.org/jira/browse/SPARK-38997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526359#comment-17526359 ] Apache Spark commented on SPARK-38997: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38997) DS V2 aggregate push-down supports group by expressions

[ https://issues.apache.org/jira/browse/SPARK-38997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38997: Assignee: Apache Spark > DS V2 aggregate push-down supports group by expressions >

[jira] [Assigned] (SPARK-38997) DS V2 aggregate push-down supports group by expressions

[ https://issues.apache.org/jira/browse/SPARK-38997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38997: Assignee: (was: Apache Spark) > DS V2 aggregate push-down supports group by

[jira] [Commented] (SPARK-38997) DS V2 aggregate push-down supports group by expressions

[ https://issues.apache.org/jira/browse/SPARK-38997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526357#comment-17526357 ] Apache Spark commented on SPARK-38997: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-38997) DS V2 aggregate push-down supports group by expressions

jiaan.geng created SPARK-38997: -- Summary: DS V2 aggregate push-down supports group by expressions Key: SPARK-38997 URL: https://issues.apache.org/jira/browse/SPARK-38997 Project: Spark Issue

[jira] [Assigned] (SPARK-38832) Remove unnecessary distinct in aggregate expression by distinctKeys

[ https://issues.apache.org/jira/browse/SPARK-38832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38832: --- Assignee: XiDuo You > Remove unnecessary distinct in aggregate expression by distinctKeys

[jira] [Resolved] (SPARK-38992) Avoid using bash -c in ShellBasedGroupsMappingProvider

[ https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38992. -- Fix Version/s: 3.3.0 3.0.4 3.2.2

[jira] [Assigned] (SPARK-38992) Avoid using bash -c in ShellBasedGroupsMappingProvider

[ https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38992: Assignee: Hyukjin Kwon > Avoid using bash -c in ShellBasedGroupsMappingProvider >

[jira] [Resolved] (SPARK-38994) Add an Python example of StreamingQueryListener

[ https://issues.apache.org/jira/browse/SPARK-38994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38994. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36318

[jira] [Resolved] (SPARK-38736) Test the error classes: INVALID_ARRAY_INDEX*

[ https://issues.apache.org/jira/browse/SPARK-38736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38736. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36314

[jira] [Assigned] (SPARK-38736) Test the error classes: INVALID_ARRAY_INDEX*

[ https://issues.apache.org/jira/browse/SPARK-38736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38736: Assignee: panbingkun > Test the error classes: INVALID_ARRAY_INDEX* >

[jira] [Commented] (SPARK-38996) Use double quotes for types in error massages

[ https://issues.apache.org/jira/browse/SPARK-38996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526299#comment-17526299 ] Apache Spark commented on SPARK-38996: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38996) Use double quotes for types in error massages

[ https://issues.apache.org/jira/browse/SPARK-38996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38996: Assignee: Max Gekk (was: Apache Spark) > Use double quotes for types in error massages

[jira] [Assigned] (SPARK-38996) Use double quotes for types in error massages

[ https://issues.apache.org/jira/browse/SPARK-38996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38996: Assignee: Apache Spark (was: Max Gekk) > Use double quotes for types in error massages

[jira] [Updated] (SPARK-38970) Skip build-and-test workflow on forks when scheduled

[ https://issues.apache.org/jira/browse/SPARK-38970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-38970: -- Summary: Skip build-and-test workflow on forks when scheduled (was: Check for changes only

[jira] [Updated] (SPARK-38996) Use double quotes for types in error massages

[ https://issues.apache.org/jira/browse/SPARK-38996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38996: - Description: All types should be printed in SQL style in error messages, and wrapped by double quotes.

[jira] [Created] (SPARK-38996) Use double quotes for types in error massages

Max Gekk created SPARK-38996: Summary: Use double quotes for types in error massages Key: SPARK-38996 URL: https://issues.apache.org/jira/browse/SPARK-38996 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-38732) Test the error class: INCOMPARABLE_PIVOT_COLUMN

[ https://issues.apache.org/jira/browse/SPARK-38732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526289#comment-17526289 ] Apache Spark commented on SPARK-38732: -- User 'lvshaokang' has created a pull request for this

[jira] [Commented] (SPARK-38732) Test the error class: INCOMPARABLE_PIVOT_COLUMN

[ https://issues.apache.org/jira/browse/SPARK-38732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526287#comment-17526287 ] Apache Spark commented on SPARK-38732: -- User 'lvshaokang' has created a pull request for this

[jira] [Assigned] (SPARK-38995) Format Config in Kubernetes Module

[ https://issues.apache.org/jira/browse/SPARK-38995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38995: Assignee: (was: Apache Spark) > Format Config in Kubernetes Module >

[jira] [Assigned] (SPARK-38995) Format Config in Kubernetes Module

[ https://issues.apache.org/jira/browse/SPARK-38995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38995: Assignee: Apache Spark > Format Config in Kubernetes Module >

[jira] [Commented] (SPARK-38995) Format Config in Kubernetes Module

[ https://issues.apache.org/jira/browse/SPARK-38995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526249#comment-17526249 ] Apache Spark commented on SPARK-38995: -- User 'zwangsheng' has created a pull request for this

[jira] [Created] (SPARK-38995) Format Config in Kubernetes Module

binjie yang created SPARK-38995: --- Summary: Format Config in Kubernetes Module Key: SPARK-38995 URL: https://issues.apache.org/jira/browse/SPARK-38995 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-38885) Upgrade netty to 4.1.76

[ https://issues.apache.org/jira/browse/SPARK-38885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526246#comment-17526246 ] Apache Spark commented on SPARK-38885: -- User 'LuciferYang' has created a pull request for this