[jira] [Commented] (SPARK-10388) Public dataset loader interface

2021-10-01 Thread Munish Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-10388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423450#comment-17423450 ] Munish Sharma commented on SPARK-10388: --- [~mengxr] I would like to work on it, please assign it to

[jira] [Created] (SPARK-36911) Add AQE Planning Times to SQL Metrics

2021-10-01 Thread Michael Chen (Jira)
Michael Chen created SPARK-36911: Summary: Add AQE Planning Times to SQL Metrics Key: SPARK-36911 URL: https://issues.apache.org/jira/browse/SPARK-36911 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36910) Inline type hints for python/pyspark/sql/types.py

2021-10-01 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423426#comment-17423426 ] Xinrong Meng commented on SPARK-36910: -- I am working on this. > Inline type hints for

[jira] [Created] (SPARK-36910) Inline type hints for python/pyspark/sql/types.py

2021-10-01 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36910: Summary: Inline type hints for python/pyspark/sql/types.py Key: SPARK-36910 URL: https://issues.apache.org/jira/browse/SPARK-36910 Project: Spark Issue

[jira] [Commented] (SPARK-36238) Spark UI load event timeline too slow for huge stage

2021-10-01 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423419#comment-17423419 ] Senthil Kumar commented on SPARK-36238: --- [~angerszhuuu] Did you try increasing heap memory for

[jira] [Commented] (SPARK-36901) ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs

2021-10-01 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423409#comment-17423409 ] Senthil Kumar commented on SPARK-36901: --- [~rangareddy.av...@gmail.com] It looks like normal

[jira] [Comment Edited] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-10-01 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423402#comment-17423402 ] Senthil Kumar edited comment on SPARK-36861 at 10/1/21, 7:24 PM: - Yes in

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

2021-10-01 Thread Senthil Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423402#comment-17423402 ] Senthil Kumar commented on SPARK-36861: --- Yes in Spark 3.3 hour column is created as "DateType" but

[jira] [Created] (SPARK-36909) pyspark.sql.catalog stubs are missing annotation for createExternalTable

2021-10-01 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-36909: -- Summary: pyspark.sql.catalog stubs are missing annotation for createExternalTable Key: SPARK-36909 URL: https://issues.apache.org/jira/browse/SPARK-36909

[jira] [Created] (SPARK-36908) Document speculation metrics added as part of SPARK-36038

2021-10-01 Thread Venkata krishnan Sowrirajan (Jira)
Venkata krishnan Sowrirajan created SPARK-36908: --- Summary: Document speculation metrics added as part of SPARK-36038 Key: SPARK-36908 URL: https://issues.apache.org/jira/browse/SPARK-36908

[jira] [Resolved] (SPARK-36038) Basic speculation metrics at stage level

2021-10-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36038. Fix Version/s: 3.3.0 Assignee: Venkata krishnan Sowrirajan Resolution:

[jira] [Commented] (SPARK-36903) oom exception occurred during code generation due to a large number of case when branches

2021-10-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423124#comment-17423124 ] Hyukjin Kwon commented on SPARK-36903: -- oh wait that configuration is removed by optimization later

[jira] [Commented] (SPARK-36903) oom exception occurred during code generation due to a large number of case when branches

2021-10-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423118#comment-17423118 ] Hyukjin Kwon commented on SPARK-36903: -- Yes, can you try and see if it works? > oom exception