[jira] [Updated] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-46383: Description: `AccumulableInfo` is one of the top heap consumers in driver's heap dumps

[jira] [Updated] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-46383: Description: `AccumulableInfo` is one of the top heap consumers in driver's heap dumps

[jira] [Updated] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-46383: Attachment: screenshot-1.png > Reduce Driver Heap Usage by Reducing the Lifespan of

[jira] [Created] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

Utkarsh Agarwal created SPARK-46383: --- Summary: Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()` Key: SPARK-46383 URL: https://issues.apache.org/jira/browse/SPARK-46383

[jira] [Updated] (SPARK-46383) Reduce Driver Heap Usage by Reducing the Lifespan of `TaskInfo.accumulables()`

[ https://issues.apache.org/jira/browse/SPARK-46383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-46383: Attachment: Screenshot 2023-11-06 at 3.56.26 PM.png > Reduce Driver Heap Usage by

[jira] [Updated] (SPARK-45772) Add additional test coverage for input_file_name() expr + Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-45772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-45772: Summary: Add additional test coverage for input_file_name() expr + Python UDFs (was: Add

[jira] [Created] (SPARK-45772) Add additional test coverage for input_file_name_expr

Utkarsh Agarwal created SPARK-45772: --- Summary: Add additional test coverage for input_file_name_expr Key: SPARK-45772 URL: https://issues.apache.org/jira/browse/SPARK-45772 Project: Spark

[jira] [Commented] (SPARK-44705) Make PythonRunner single-threaded

[ https://issues.apache.org/jira/browse/SPARK-44705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751843#comment-17751843 ] Utkarsh Agarwal commented on SPARK-44705: - https://github.com/apache/spark/pull/42385 for this

[jira] [Created] (SPARK-44705) Make PythonRunner single-threaded

Utkarsh Agarwal created SPARK-44705: --- Summary: Make PythonRunner single-threaded Key: SPARK-44705 URL: https://issues.apache.org/jira/browse/SPARK-44705 Project: Spark Issue Type:

[jira] [Created] (SPARK-38999) Refactor DataSourceScanExec code to

Utkarsh Agarwal created SPARK-38999: --- Summary: Refactor DataSourceScanExec code to Key: SPARK-38999 URL: https://issues.apache.org/jira/browse/SPARK-38999 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36978) InferConstraints rule should create IsNotNull constraints on the nested field instead of the root nested type

[ https://issues.apache.org/jira/browse/SPARK-36978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Utkarsh Agarwal updated SPARK-36978: Description:

[jira] [Created] (SPARK-36978) InferConstraints rule should create IsNotNull constraints on the nested field instead of the root nested type

Utkarsh Agarwal created SPARK-36978: --- Summary: InferConstraints rule should create IsNotNull constraints on the nested field instead of the root nested type Key: SPARK-36978 URL:

[jira] [Created] (SPARK-33404) "date_trunc" expression returns incorrect results

Utkarsh Agarwal created SPARK-33404: --- Summary: "date_trunc" expression returns incorrect results Key: SPARK-33404 URL: https://issues.apache.org/jira/browse/SPARK-33404 Project: Spark