[jira] [Commented] (SPARK-35678) add a common softmax function

[ https://issues.apache.org/jira/browse/SPARK-35678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366390#comment-17366390 ] Apache Spark commented on SPARK-35678: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-35835) Select filter query on table with struct complex type fails

[ https://issues.apache.org/jira/browse/SPARK-35835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366386#comment-17366386 ] pavithra ramachandran commented on SPARK-35835: --- i shall raise a PR soon > Select filter

[jira] [Created] (SPARK-35835) Select filter query on table with struct complex type fails

Chetan Bhat created SPARK-35835: --- Summary: Select filter query on table with struct complex type fails Key: SPARK-35835 URL: https://issues.apache.org/jira/browse/SPARK-35835 Project: Spark

[jira] [Assigned] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32041: --- Assignee: Peter Toth > Exchange reuse won't work in cases when DPP, subqueries are

[jira] [Resolved] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32041. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28885

[jira] [Resolved] (SPARK-28940) Subquery reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28940. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28885

[jira] [Assigned] (SPARK-28940) Subquery reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28940: --- Assignee: Peter Toth > Subquery reuse across all subquery levels >

[jira] [Resolved] (SPARK-29375) Exchange reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29375. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28885

[jira] [Assigned] (SPARK-29375) Exchange reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29375: --- Assignee: Peter Toth > Exchange reuse across all subquery levels >

[jira] [Commented] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366373#comment-17366373 ] Apache Spark commented on SPARK-35545: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366372#comment-17366372 ] Apache Spark commented on SPARK-35545: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35811) Deprecate DataFrame.to_spark_io

[ https://issues.apache.org/jira/browse/SPARK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35811. -- Assignee: Kevin Su Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-35811) Deprecate DataFrame.to_spark_io

[ https://issues.apache.org/jira/browse/SPARK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35811: - Fix Version/s: 3.2.0 > Deprecate DataFrame.to_spark_io > --- > >

[jira] [Assigned] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35834: Assignee: Apache Spark > Use the same cleanup logic as Py4J in inheritable thread API >

[jira] [Assigned] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35834: Assignee: (was: Apache Spark) > Use the same cleanup logic as Py4J in inheritable

[jira] [Commented] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366324#comment-17366324 ] Apache Spark commented on SPARK-35834: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35834: - Issue Type: Bug (was: Improvement) > Use the same cleanup logic as Py4J in inheritable thread

[jira] [Created] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

Hyukjin Kwon created SPARK-35834: Summary: Use the same cleanup logic as Py4J in inheritable thread API Key: SPARK-35834 URL: https://issues.apache.org/jira/browse/SPARK-35834 Project: Spark

[jira] [Assigned] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35671: --- Assignee: Chandni Singh > Add Support in the ESS to serve merged shuffle

[jira] [Resolved] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-35671. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-35827) Show proper error message when update column types to year-month/day-time interval

[ https://issues.apache.org/jira/browse/SPARK-35827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35827. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32978

[jira] [Assigned] (SPARK-35775) Check all year-month interval types in aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35775: Assignee: Apache Spark > Check all year-month interval types in aggregate expressions >

[jira] [Commented] (SPARK-35775) Check all year-month interval types in aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366235#comment-17366235 ] Apache Spark commented on SPARK-35775: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35775) Check all year-month interval types in aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35775: Assignee: (was: Apache Spark) > Check all year-month interval types in aggregate

[jira] [Assigned] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35832: - Assignee: Dongjoon Hyun > Add LocalRootDirsTest trait > --- >

[jira] [Resolved] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35832. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32986

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366181#comment-17366181 ] Apache Spark commented on SPARK-35564: -- User 'Kimahriman' has created a pull request for this

[jira] [Assigned] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35564: Assignee: (was: Apache Spark) > Support subexpression elimination for non-common

[jira] [Assigned] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35564: Assignee: Apache Spark > Support subexpression elimination for non-common branches of

[jira] [Created] (SPARK-35833) The Statistics size of PARQUET table is not estimated correctly

HonglunChen created SPARK-35833: --- Summary: The Statistics size of PARQUET table is not estimated correctly Key: SPARK-35833 URL: https://issues.apache.org/jira/browse/SPARK-35833 Project: Spark

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366173#comment-17366173 ] Gejun Shen edited comment on SPARK-20427 at 6/20/21, 12:16 PM: --- When you

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366173#comment-17366173 ] Gejun Shen edited comment on SPARK-20427 at 6/20/21, 12:16 PM: --- When you

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366173#comment-17366173 ] Gejun Shen edited comment on SPARK-20427 at 6/20/21, 12:09 PM: --- When you

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366173#comment-17366173 ] Gejun Shen commented on SPARK-20427: When you use custom scheme, I believe precision would also

[jira] [Assigned] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35832: Assignee: (was: Apache Spark) > Add LocalRootDirsTest trait >

[jira] [Commented] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366135#comment-17366135 ] Apache Spark commented on SPARK-35832: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35832: Assignee: Apache Spark > Add LocalRootDirsTest trait > --- > >

[jira] [Updated] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35832: -- Issue Type: Bug (was: Improvement) > Add LocalRootDirsTest trait >

[jira] [Assigned] (SPARK-35777) Check all year-month interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35777: Assignee: (was: Apache Spark) > Check all year-month interval types in UDF >

[jira] [Assigned] (SPARK-35777) Check all year-month interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35777: Assignee: Apache Spark > Check all year-month interval types in UDF >

[jira] [Commented] (SPARK-35777) Check all year-month interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366134#comment-17366134 ] Apache Spark commented on SPARK-35777: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-35832) Add LocalRootDirsTest trait

Dongjoon Hyun created SPARK-35832: - Summary: Add LocalRootDirsTest trait Key: SPARK-35832 URL: https://issues.apache.org/jira/browse/SPARK-35832 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35726) Truncate java.time.Duration by fields of day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-35726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366130#comment-17366130 ] Apache Spark commented on SPARK-35726: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-35769) Truncate java.time.Period by fields of year-month interval type

[ https://issues.apache.org/jira/browse/SPARK-35769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366128#comment-17366128 ] Apache Spark commented on SPARK-35769: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-35726) Truncate java.time.Duration by fields of day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-35726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366126#comment-17366126 ] Apache Spark commented on SPARK-35726: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366123#comment-17366123 ] Saurabh Chawla commented on SPARK-35700: [~hyukjin.kwon]/ [~Qin Yao] / [~cloud_fan] - I was able

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366122#comment-17366122 ] Gengliang Wang commented on SPARK-35802: +1 with [~sarutak]. It's an API for rendering UI and