[jira] [Assigned] (SPARK-38574) Enrich Avro data source documentation

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-38574: -- Assignee: Tianhan Hu > Enrich Avro data source documentation >

[jira] [Resolved] (SPARK-38574) Enrich Avro data source documentation

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38574. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35880

[jira] [Commented] (SPARK-38194) Make memory overhead factor configurable

2022-03-21 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510197#comment-17510197 ] Yikun Jiang commented on SPARK-38194: - 3.4: [https://github.com/apache/spark/pull/35504]

[jira] [Assigned] (SPARK-38621) Add volcano module to release-build.sh

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38621: Assignee: Apache Spark > Add volcano module to release-build.sh >

[jira] [Assigned] (SPARK-38621) Add volcano module to release-build.sh

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38621: Assignee: (was: Apache Spark) > Add volcano module to release-build.sh >

[jira] [Commented] (SPARK-38621) Add volcano module to release-build.sh

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510195#comment-17510195 ] Apache Spark commented on SPARK-38621: -- User 'Yikun' has created a pull request for this issue:

[jira] [Created] (SPARK-38621) Add volcano module to release-build.sh

2022-03-21 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-38621: --- Summary: Add volcano module to release-build.sh Key: SPARK-38621 URL: https://issues.apache.org/jira/browse/SPARK-38621 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-38620) Replace `value.formatted(formatString)` with `formatString.format(value)` to clean up compilation warning

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510193#comment-17510193 ] Apache Spark commented on SPARK-38620: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38620) Replace `value.formatted(formatString)` with `formatString.format(value)` to clean up compilation warning

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38620: Assignee: Apache Spark > Replace `value.formatted(formatString)` with

[jira] [Commented] (SPARK-38620) Replace `value.formatted(formatString)` with `formatString.format(value)` to clean up compilation warning

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510192#comment-17510192 ] Apache Spark commented on SPARK-38620: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38620) Replace `value.formatted(formatString)` with `formatString.format(value)` to clean up compilation warning

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38620: Assignee: (was: Apache Spark) > Replace `value.formatted(formatString)` with

[jira] [Updated] (SPARK-38620) Replace `value.formatted(formatString)` with `formatString.format(value)` to clean up compilation warning

2022-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38620: - Summary: Replace `value.formatted(formatString)` with `formatString.format(value)` to clean up

[jira] [Created] (SPARK-38620) Replace `value.formatted(formatString)` with `formatString.format(value)`

2022-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-38620: Summary: Replace `value.formatted(formatString)` with `formatString.format(value)` Key: SPARK-38620 URL: https://issues.apache.org/jira/browse/SPARK-38620 Project: Spark

[jira] [Assigned] (SPARK-38619) Clean up Junit api usage in scalatest

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38619: Assignee: Apache Spark > Clean up Junit api usage in scalatest >

[jira] [Assigned] (SPARK-38619) Clean up Junit api usage in scalatest

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38619: Assignee: (was: Apache Spark) > Clean up Junit api usage in scalatest >

[jira] [Commented] (SPARK-38619) Clean up Junit api usage in scalatest

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510190#comment-17510190 ] Apache Spark commented on SPARK-38619: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-38619) Clean up Junit api usage in scalatest

2022-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38619: - Description: There are some Junit api usage in scalatest, for example   {code:java}  

[jira] [Created] (SPARK-38619) Clean up Junit api usage in scalatest

2022-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-38619: Summary: Clean up Junit api usage in scalatest Key: SPARK-38619 URL: https://issues.apache.org/jira/browse/SPARK-38619 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-38604) ceil and floor return different types when called from scala than sql

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38604. -- Fix Version/s: 3.3.0 Assignee: Robert Joseph Evans Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-38488) Spark doc build not work on Mac OS M1

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38488: Assignee: Yikun Jiang > Spark doc build not work on Mac OS M1 >

[jira] [Resolved] (SPARK-38488) Spark doc build not work on Mac OS M1

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38488. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35918

[jira] [Created] (SPARK-38618) Implement JDBCDataSourceV2

2022-03-21 Thread Andrew Murphy (Jira)
Andrew Murphy created SPARK-38618: - Summary: Implement JDBCDataSourceV2 Key: SPARK-38618 URL: https://issues.apache.org/jira/browse/SPARK-38618 Project: Spark Issue Type: Sub-task

[jira] (SPARK-33236) Enable Push-based shuffle service to store state in NM level DB for work preserving restart

2022-03-21 Thread Ye Zhou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33236 ] Ye Zhou deleted comment on SPARK-33236: - was (Author: zhouyejoe): WIP PR posted [https://github.com/apache/spark/pull/35906.]  > Enable Push-based shuffle service to store state in NM level DB

[jira] [Commented] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-21 Thread Jason Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510162#comment-17510162 ] Jason Xu commented on SPARK-38388: -- Thank you [~mridulm80] ! Wenchen also suggested to propagate the

[jira] [Commented] (SPARK-38336) Catalyst changes for DEFAULT column support

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17510155#comment-17510155 ] Apache Spark commented on SPARK-38336: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Created] (SPARK-38617) Show timing for Spark rules and phases in SQL UI and Rest API

2022-03-21 Thread Yian Liou (Jira)
Yian Liou created SPARK-38617: - Summary: Show timing for Spark rules and phases in SQL UI and Rest API Key: SPARK-38617 URL: https://issues.apache.org/jira/browse/SPARK-38617 Project: Spark

[jira] [Assigned] (SPARK-38606) Update document to make a good guide of multiple versions of the Spark Shuffle Service

2022-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38606: Assignee: tonydoen > Update document to make a good guide of multiple versions of the

[jira] [Resolved] (SPARK-38606) Update document to make a good guide of multiple versions of the Spark Shuffle Service

2022-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38606. -- Fix Version/s: 3.2.2 Resolution: Fixed Issue resolved by pull request 35914

[jira] [Commented] (SPARK-38615) Provide error context for runtime ANSI failures

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1751#comment-1751 ] Gengliang Wang commented on SPARK-38615: [~maxgekk] I am targeting this one in 3.3 as well.

[jira] [Resolved] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

2022-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34805. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35270

[jira] [Updated] (SPARK-38615) Provide error context for runtime ANSI failures

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-38615: --- Issue Type: Improvement (was: Bug) > Provide error context for runtime ANSI failures >

[jira] [Assigned] (SPARK-38616) Keep track of SQL query text in Catalyst TreeNode

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38616: Assignee: Gengliang Wang (was: Apache Spark) > Keep track of SQL query text in Catalyst

[jira] [Assigned] (SPARK-38616) Keep track of SQL query text in Catalyst TreeNode

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38616: Assignee: Apache Spark (was: Gengliang Wang) > Keep track of SQL query text in Catalyst

[jira] [Commented] (SPARK-38616) Keep track of SQL query text in Catalyst TreeNode

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509982#comment-17509982 ] Apache Spark commented on SPARK-38616: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-38616) Keep track of SQL query text in Catalyst TreeNode

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-38616: --- Summary: Keep track of SQL query text in Catalyst TreeNode (was: Include SQL query text in

[jira] [Created] (SPARK-38616) Include SQL query text in the Origin of TreeNode

2022-03-21 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38616: -- Summary: Include SQL query text in the Origin of TreeNode Key: SPARK-38616 URL: https://issues.apache.org/jira/browse/SPARK-38616 Project: Spark Issue

[jira] [Updated] (SPARK-38615) Provide error context for runtime ANSI failures

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-38615: --- Epic Link: SPARK-35030 > Provide error context for runtime ANSI failures >

[jira] [Created] (SPARK-38615) Provide error context for runtime ANSI failures

2022-03-21 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38615: -- Summary: Provide error context for runtime ANSI failures Key: SPARK-38615 URL: https://issues.apache.org/jira/browse/SPARK-38615 Project: Spark Issue

[jira] [Resolved] (SPARK-38154) Set up a new GA job to run tests with ANSI mode

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38154. Fix Version/s: 3.3.0 Assignee: Apache Spark Resolution: Fixed > Set up a

[jira] [Commented] (SPARK-38604) ceil and floor return different types when called from scala than sql

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509915#comment-17509915 ] Apache Spark commented on SPARK-38604: -- User 'revans2' has created a pull request for this issue:

[jira] [Commented] (SPARK-38604) ceil and floor return different types when called from scala than sql

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509916#comment-17509916 ] Apache Spark commented on SPARK-38604: -- User 'revans2' has created a pull request for this issue:

[jira] [Updated] (SPARK-38614) df.show() shows incorrect F.percent_rank results

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Description: Expected result is obtained using Spark 3.1.1, but not 3.2.1 *Minimal reproducible example*

[jira] [Updated] (SPARK-38614) df.show() shows incorrect F.percent_rank results

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Description: Expected result is obtained using Spark 3.1.2, but not 3.2.0 or 3.2.1 *Minimal reproducible

[jira] [Updated] (SPARK-38614) df.show() shows incorrect F.percent_rank results

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Affects Version/s: 3.2.0 > df.show() shows incorrect F.percent_rank results >

[jira] [Updated] (SPARK-38194) Make memory overhead factor configurable

2022-03-21 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38194: -- Fix Version/s: 3.3.0 > Make memory overhead factor configurable >

[jira] [Updated] (SPARK-38614) df.show() shows incorrect F.percent_rank results

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Labels: correctness (was: ) > df.show() shows incorrect F.percent_rank results >

[jira] [Updated] (SPARK-38614) df.show() shows incorrect F.percent_rank results

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Summary: df.show() shows incorrect F.percent_rank results (was: df.show(3) does not equal df.show() first

[jira] [Assigned] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38578: Assignee: Apache Spark > Avoid unnecessary sort in FileFormatWriter if user has

[jira] [Commented] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509848#comment-17509848 ] Apache Spark commented on SPARK-38578: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-38578) Avoid unnecessary sort in FileFormatWriter if user has specified sort in AQE

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38578: Assignee: (was: Apache Spark) > Avoid unnecessary sort in FileFormatWriter if user

[jira] [Updated] (SPARK-38614) df.show(3) does not equal df.show() first rows

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Description: Expected result is obtained using Spark 3.0.2, but not 3.2.1 *Minimal reproducible example*

[jira] [Updated] (SPARK-38614) df.show(3) does not equal df.show() first rows

2022-03-21 Thread ZygD (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZygD updated SPARK-38614: - Description: *Minimal reproducible example* {code:java} from pyspark.sql import SparkSession, functions as F, 

[jira] [Commented] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509820#comment-17509820 ] Apache Spark commented on SPARK-38613: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38613: Assignee: (was: Apache Spark) > Fix >

[jira] [Assigned] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38613: Assignee: Apache Spark > Fix >

[jira] [Commented] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509819#comment-17509819 ] Apache Spark commented on SPARK-38613: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38614) df.show(3) does not equal df.show() first rows

2022-03-21 Thread ZygD (Jira)
ZygD created SPARK-38614: Summary: df.show(3) does not equal df.show() first rows Key: SPARK-38614 URL: https://issues.apache.org/jira/browse/SPARK-38614 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-38613) Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete

2022-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-38613: Summary: Fix RemoteBlockPushResolverSuite#testWritingPendingBufsIsAbortedImmediatelyDuringComplete Key: SPARK-38613 URL: https://issues.apache.org/jira/browse/SPARK-38613

[jira] [Assigned] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38612: Assignee: Yikun Jiang > Fix Inline type hint for duplicated.keep >

[jira] [Resolved] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38612. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35920

[jira] [Assigned] (SPARK-30220) Support Filter expression uses IN/EXISTS predicate sub-queries

2022-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30220: --- Assignee: Tanel Kiis > Support Filter expression uses IN/EXISTS predicate sub-queries >

[jira] [Resolved] (SPARK-30220) Support Filter expression uses IN/EXISTS predicate sub-queries

2022-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30220. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 34402

[jira] [Assigned] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

2022-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37995: --- Assignee: XiDuo You > TPCDS 1TB q72 fails when >

[jira] [Resolved] (SPARK-37995) TPCDS 1TB q72 fails when spark.sql.optimizer.dynamicPartitionPruning.reuseBroadcastOnly is false

2022-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37995. - Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-38601) AttributeError: module 'databricks.koalas' has no attribute 'DateOffset'

2022-03-21 Thread Prakhar Sandhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509742#comment-17509742 ] Prakhar Sandhu commented on SPARK-38601: Hi [~hyukjin.kwon] , # Any other alternative that

[jira] [Commented] (SPARK-37483) Support push down top N to JDBC data source V2

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509728#comment-17509728 ] Apache Spark commented on SPARK-37483: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37483) Support push down top N to JDBC data source V2

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509727#comment-17509727 ] Apache Spark commented on SPARK-37483: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509726#comment-17509726 ] Apache Spark commented on SPARK-38612: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38612: Assignee: (was: Apache Spark) > Fix Inline type hint for duplicated.keep >

[jira] [Assigned] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38612: Assignee: Apache Spark > Fix Inline type hint for duplicated.keep >

[jira] [Commented] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509725#comment-17509725 ] Apache Spark commented on SPARK-38612: -- User 'Yikun' has created a pull request for this issue:

[jira] [Created] (SPARK-38612) Fix Inline type hint for duplicated.keep

2022-03-21 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-38612: --- Summary: Fix Inline type hint for duplicated.keep Key: SPARK-38612 URL: https://issues.apache.org/jira/browse/SPARK-38612 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-38609) Add PYSPARK_PANDAS_USAGE_LOGGER environment variable as an alias of KOALAS_USAGE_LOGGER

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38609: Assignee: Hyukjin Kwon > Add PYSPARK_PANDAS_USAGE_LOGGER environment variable as an

[jira] [Resolved] (SPARK-38609) Add PYSPARK_PANDAS_USAGE_LOGGER environment variable as an alias of KOALAS_USAGE_LOGGER

2022-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38609. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35917

[jira] [Commented] (SPARK-38611) Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite`

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17509664#comment-17509664 ] Apache Spark commented on SPARK-38611: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38611) Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite`

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38611: Assignee: Apache Spark > Use `assertThrows` instead of handwriting `intercept` method in

[jira] [Assigned] (SPARK-38611) Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite`

2022-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38611: Assignee: (was: Apache Spark) > Use `assertThrows` instead of handwriting

[jira] [Created] (SPARK-38611) Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite`

2022-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-38611: Summary: Use `assertThrows` instead of handwriting `intercept` method in `CatalogLoadingSuite` Key: SPARK-38611 URL: https://issues.apache.org/jira/browse/SPARK-38611

[jira] [Resolved] (SPARK-38548) New SQL function: try_sum

2022-03-21 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38548. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35848