[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Description: In this example, reading unnecessary nested fields still happens. Data

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Description: In this example, reading unnecessary nested fields still happens. Data

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Description: In this example, reading unnecessary nested fields still happens. Data

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Summary: Spark SQL reads unnecessary nested fields (filter after explode) (was: Spark SQL

[jira] [Updated] (SPARK-37201) Spark SQL reads unnecсessary nested fields (filter after explode)

[ https://issues.apache.org/jira/browse/SPARK-37201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Kotlov updated SPARK-37201: -- Summary: Spark SQL reads unnecсessary nested fields (filter after explode) (was: Spark SQL

[jira] [Created] (SPARK-37201) Spark SQL reads unnecessary nested fields (filter after explode)

Sergey Kotlov created SPARK-37201: - Summary: Spark SQL reads unnecessary nested fields (filter after explode) Key: SPARK-37201 URL: https://issues.apache.org/jira/browse/SPARK-37201 Project: Spark

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316697#comment-17316697 ] Sergey Kotlov commented on SPARK-34674: --- The fix that I currently use: 

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310235#comment-17310235 ] Sergey Kotlov commented on SPARK-34674: --- Thanks for looking into this problem, [~dongjoon]. As a

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307398#comment-17307398 ] Sergey Kotlov commented on SPARK-34674: --- I saw it in the sources. But you are right, generally I

[jira] [Commented] (SPARK-34674) Spark app on k8s doesn't terminate without call to sparkContext.stop() method

[ https://issues.apache.org/jira/browse/SPARK-34674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305419#comment-17305419 ] Sergey Kotlov commented on SPARK-34674: --- Thanks for response, [~dongjoon] I haven't tried to use