[jira] [Assigned] (SPARK-35838) Ensure kafka-0-10-sql module can maven test independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-35838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35838: Assignee: Apache Spark > Ensure kafka-0-10-sql module can maven test independently in Sca

[jira] [Assigned] (SPARK-35838) Ensure kafka-0-10-sql module can maven test independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-35838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35838: Assignee: (was: Apache Spark) > Ensure kafka-0-10-sql module can maven test independe

[jira] [Commented] (SPARK-35838) Ensure kafka-0-10-sql module can maven test independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-35838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366418#comment-17366418 ] Apache Spark commented on SPARK-35838: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-35838) Ensure kafka-0-10-sql module can maven test independently in Scala 2.13

Yang Jie created SPARK-35838: Summary: Ensure kafka-0-10-sql module can maven test independently in Scala 2.13 Key: SPARK-35838 URL: https://issues.apache.org/jira/browse/SPARK-35838 Project: Spark

[jira] [Commented] (SPARK-35776) Check all year-month interval types in arrow

[ https://issues.apache.org/jira/browse/SPARK-35776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366409#comment-17366409 ] Apache Spark commented on SPARK-35776: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35776) Check all year-month interval types in arrow

[ https://issues.apache.org/jira/browse/SPARK-35776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35776: Assignee: Apache Spark > Check all year-month interval types in arrow > -

[jira] [Assigned] (SPARK-35776) Check all year-month interval types in arrow

[jira] [Assigned] (SPARK-35776) Check all year-month interval types in arrow

[ https://issues.apache.org/jira/browse/SPARK-35776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35776: Assignee: Apache Spark > Check all year-month interval types in arrow > -

[jira] [Assigned] (SPARK-35836) Remove reference to spark.shuffle.push.based.enabled in ShuffleBlockPusherSuite

[ https://issues.apache.org/jira/browse/SPARK-35836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35836: Assignee: (was: Apache Spark) > Remove reference to spark.shuffle.push.based.enabled

[jira] [Commented] (SPARK-35836) Remove reference to spark.shuffle.push.based.enabled in ShuffleBlockPusherSuite

[ https://issues.apache.org/jira/browse/SPARK-35836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366406#comment-17366406 ] Apache Spark commented on SPARK-35836: -- User 'otterc' has created a pull request fo

[jira] [Assigned] (SPARK-35836) Remove reference to spark.shuffle.push.based.enabled in ShuffleBlockPusherSuite

[ https://issues.apache.org/jira/browse/SPARK-35836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35836: Assignee: Apache Spark > Remove reference to spark.shuffle.push.based.enabled in > Shuff

[jira] [Commented] (SPARK-35776) Check all year-month interval types in arrow

[ https://issues.apache.org/jira/browse/SPARK-35776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366401#comment-17366401 ] angerszhu commented on SPARK-35776: --- Working on this > Check all year-month interval

[jira] [Updated] (SPARK-35837) Recommendations for Common Query Problems

[ https://issues.apache.org/jira/browse/SPARK-35837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35837: Description: Teradata supports [Recommendations for Common Query Problems|https://docs.teradata.c

[jira] [Updated] (SPARK-35837) Recommendations for Common Query Problems

[ https://issues.apache.org/jira/browse/SPARK-35837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35837: Description: Teradata supports [Recommendations for Common Query Problems|https://docs.teradata.c

[jira] [Updated] (SPARK-35837) Recommendations for Common Query Problems

[ https://issues.apache.org/jira/browse/SPARK-35837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35837: Description: Teradata supports [Recommendations for Common Query Problems|https://docs.teradata.c

[jira] [Created] (SPARK-35837) Recommendations for Common Query Problems

Yuming Wang created SPARK-35837: --- Summary: Recommendations for Common Query Problems Key: SPARK-35837 URL: https://issues.apache.org/jira/browse/SPARK-35837 Project: Spark Issue Type: New Featu

[jira] [Created] (SPARK-35836) Remove reference to spark.shuffle.push.based.enabled in ShuffleBlockPusherSuite

Chandni Singh created SPARK-35836: - Summary: Remove reference to spark.shuffle.push.based.enabled in ShuffleBlockPusherSuite Key: SPARK-35836 URL: https://issues.apache.org/jira/browse/SPARK-35836 Pro

[jira] [Commented] (SPARK-35678) add a common softmax function

[ https://issues.apache.org/jira/browse/SPARK-35678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366390#comment-17366390 ] Apache Spark commented on SPARK-35678: -- User 'zhengruifeng' has created a pull requ

[jira] [Commented] (SPARK-35835) Select filter query on table with struct complex type fails

[ https://issues.apache.org/jira/browse/SPARK-35835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366386#comment-17366386 ] pavithra ramachandran commented on SPARK-35835: --- i shall raise a PR soon

[jira] [Created] (SPARK-35835) Select filter query on table with struct complex type fails

Chetan Bhat created SPARK-35835: --- Summary: Select filter query on table with struct complex type fails Key: SPARK-35835 URL: https://issues.apache.org/jira/browse/SPARK-35835 Project: Spark Is

[jira] [Assigned] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32041: --- Assignee: Peter Toth > Exchange reuse won't work in cases when DPP, subqueries are involved

[jira] [Resolved] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32041. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28885 [https://gith

[jira] [Resolved] (SPARK-28940) Subquery reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28940. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28885 [https://gith

[jira] [Assigned] (SPARK-28940) Subquery reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-28940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28940: --- Assignee: Peter Toth > Subquery reuse across all subquery levels >

[jira] [Resolved] (SPARK-29375) Exchange reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-29375. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 28885 [https://gith

[jira] [Assigned] (SPARK-29375) Exchange reuse across all subquery levels

[ https://issues.apache.org/jira/browse/SPARK-29375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-29375: --- Assignee: Peter Toth > Exchange reuse across all subquery levels >

[jira] [Commented] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366373#comment-17366373 ] Apache Spark commented on SPARK-35545: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366372#comment-17366372 ] Apache Spark commented on SPARK-35545: -- User 'Ngone51' has created a pull request f

[jira] [Resolved] (SPARK-35811) Deprecate DataFrame.to_spark_io

[ https://issues.apache.org/jira/browse/SPARK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35811. -- Assignee: Kevin Su Resolution: Fixed Fixed in https://github.com/apache/spark/pull/32964

[jira] [Updated] (SPARK-35811) Deprecate DataFrame.to_spark_io

[ https://issues.apache.org/jira/browse/SPARK-35811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35811: - Fix Version/s: 3.2.0 > Deprecate DataFrame.to_spark_io > --- > >

[jira] [Assigned] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35834: Assignee: Apache Spark > Use the same cleanup logic as Py4J in inheritable thread API > -

[jira] [Assigned] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35834: Assignee: (was: Apache Spark) > Use the same cleanup logic as Py4J in inheritable thr

[jira] [Commented] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366324#comment-17366324 ] Apache Spark commented on SPARK-35834: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

[ https://issues.apache.org/jira/browse/SPARK-35834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35834: - Issue Type: Bug (was: Improvement) > Use the same cleanup logic as Py4J in inheritable thread A

[jira] [Created] (SPARK-35834) Use the same cleanup logic as Py4J in inheritable thread API

Hyukjin Kwon created SPARK-35834: Summary: Use the same cleanup logic as Py4J in inheritable thread API Key: SPARK-35834 URL: https://issues.apache.org/jira/browse/SPARK-35834 Project: Spark

[jira] [Assigned] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-35671: --- Assignee: Chandni Singh > Add Support in the ESS to serve merged shuffle bl

[jira] [Resolved] (SPARK-35671) Add Support in the ESS to serve merged shuffle block meta and data to executors

[ https://issues.apache.org/jira/browse/SPARK-35671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-35671. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 328

[jira] [Resolved] (SPARK-35827) Show proper error message when update column types to year-month/day-time interval

[ https://issues.apache.org/jira/browse/SPARK-35827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35827. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32978 [https://github.com

[jira] [Assigned] (SPARK-35775) Check all year-month interval types in aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35775: Assignee: Apache Spark > Check all year-month interval types in aggregate expressions > -

[jira] [Commented] (SPARK-35775) Check all year-month interval types in aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366235#comment-17366235 ] Apache Spark commented on SPARK-35775: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35775) Check all year-month interval types in aggregate expressions

[ https://issues.apache.org/jira/browse/SPARK-35775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35775: Assignee: (was: Apache Spark) > Check all year-month interval types in aggregate expr

[jira] [Assigned] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35832: - Assignee: Dongjoon Hyun > Add LocalRootDirsTest trait > --- > >

[jira] [Resolved] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35832. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32986 [https://

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366181#comment-17366181 ] Apache Spark commented on SPARK-35564: -- User 'Kimahriman' has created a pull reques

[jira] [Assigned] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35564: Assignee: (was: Apache Spark) > Support subexpression elimination for non-common bran

[jira] [Assigned] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35564: Assignee: Apache Spark > Support subexpression elimination for non-common branches of con

[jira] [Created] (SPARK-35833) The Statistics size of PARQUET table is not estimated correctly

HonglunChen created SPARK-35833: --- Summary: The Statistics size of PARQUET table is not estimated correctly Key: SPARK-35833 URL: https://issues.apache.org/jira/browse/SPARK-35833 Project: Spark

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366173#comment-17366173 ] Gejun Shen edited comment on SPARK-20427 at 6/20/21, 12:16 PM: ---

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366173#comment-17366173 ] Gejun Shen edited comment on SPARK-20427 at 6/20/21, 12:16 PM: ---

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366173#comment-17366173 ] Gejun Shen edited comment on SPARK-20427 at 6/20/21, 12:09 PM: ---

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366173#comment-17366173 ] Gejun Shen commented on SPARK-20427: When you use custom scheme, I believe precision

[jira] [Assigned] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35832: Assignee: (was: Apache Spark) > Add LocalRootDirsTest trait > ---

[jira] [Commented] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366135#comment-17366135 ] Apache Spark commented on SPARK-35832: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35832: Assignee: Apache Spark > Add LocalRootDirsTest trait > --- > >

[jira] [Updated] (SPARK-35832) Add LocalRootDirsTest trait

[ https://issues.apache.org/jira/browse/SPARK-35832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35832: -- Issue Type: Bug (was: Improvement) > Add LocalRootDirsTest trait > --

[jira] [Assigned] (SPARK-35777) Check all year-month interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35777: Assignee: (was: Apache Spark) > Check all year-month interval types in UDF >

[jira] [Assigned] (SPARK-35777) Check all year-month interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35777: Assignee: Apache Spark > Check all year-month interval types in UDF > ---

[jira] [Commented] (SPARK-35777) Check all year-month interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366134#comment-17366134 ] Apache Spark commented on SPARK-35777: -- User 'AngersZh' has created a pull requ

[jira] [Created] (SPARK-35832) Add LocalRootDirsTest trait

Dongjoon Hyun created SPARK-35832: - Summary: Add LocalRootDirsTest trait Key: SPARK-35832 URL: https://issues.apache.org/jira/browse/SPARK-35832 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-35726) Truncate java.time.Duration by fields of day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-35726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366130#comment-17366130 ] Apache Spark commented on SPARK-35726: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-35769) Truncate java.time.Period by fields of year-month interval type

[ https://issues.apache.org/jira/browse/SPARK-35769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366128#comment-17366128 ] Apache Spark commented on SPARK-35769: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-35726) Truncate java.time.Duration by fields of day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-35726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366126#comment-17366126 ] Apache Spark commented on SPARK-35726: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366123#comment-17366123 ] Saurabh Chawla commented on SPARK-35700: [~hyukjin.kwon]/ [~Qin Yao] / [~cloud_f

[jira] [Commented] (SPARK-35802) Error loading the stages/stage/ page in spark UI

[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366122#comment-17366122 ] Gengliang Wang commented on SPARK-35802: +1 with [~sarutak]. It's an API for ren