[jira] [Assigned] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39904: Assignee: Apache Spark > Rename inferDate to preferDate and fix an issue when inferring

[jira] [Assigned] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39904: Assignee: (was: Apache Spark) > Rename inferDate to preferDate and fix an issue when

[jira] [Commented] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572240#comment-17572240 ] Apache Spark commented on SPARK-39904: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39844) Restrict adding DEFAULT columns for existing tables to allowlist of supported data source types

[ https://issues.apache.org/jira/browse/SPARK-39844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-39844: -- Assignee: Daniel > Restrict adding DEFAULT columns for existing tables to allowlist

[jira] [Resolved] (SPARK-39844) Restrict adding DEFAULT columns for existing tables to allowlist of supported data source types

[ https://issues.apache.org/jira/browse/SPARK-39844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39844. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37256

[jira] [Assigned] (SPARK-39905) Remove checkErrorClass()

[ https://issues.apache.org/jira/browse/SPARK-39905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39905: Assignee: Apache Spark (was: Max Gekk) > Remove checkErrorClass() >

[jira] [Assigned] (SPARK-39905) Remove checkErrorClass()

[ https://issues.apache.org/jira/browse/SPARK-39905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39905: Assignee: Max Gekk (was: Apache Spark) > Remove checkErrorClass() >

[jira] [Commented] (SPARK-39905) Remove checkErrorClass()

[ https://issues.apache.org/jira/browse/SPARK-39905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572238#comment-17572238 ] Apache Spark commented on SPARK-39905: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-39905) Remove checkErrorClass()

Max Gekk created SPARK-39905: Summary: Remove checkErrorClass() Key: SPARK-39905 URL: https://issues.apache.org/jira/browse/SPARK-39905 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Sadikov updated SPARK-39904: - Description: Follow-up for https://issues.apache.org/jira/browse/SPARK-39469. > Rename

[jira] [Created] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

Ivan Sadikov created SPARK-39904: Summary: Rename inferDate to preferDate and fix an issue when inferring schema Key: SPARK-39904 URL: https://issues.apache.org/jira/browse/SPARK-39904 Project: Spark

[jira] [Resolved] (SPARK-39899) Incorrect passing of message parameters in InvalidUDFClassException

[ https://issues.apache.org/jira/browse/SPARK-39899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39899. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37323

[jira] [Resolved] (SPARK-39889) Use different error classes for numeric/interval divided by 0

[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39889. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37313

[jira] [Commented] (SPARK-34788) Spark throws FileNotFoundException instead of IOException when disk is full

[ https://issues.apache.org/jira/browse/SPARK-34788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572212#comment-17572212 ] wenweijian commented on SPARK-34788: I got this FileNotFoundException when the

[jira] [Resolved] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39890. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37318

[jira] [Assigned] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39890: --- Assignee: XiDuo You > Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering >

[jira] [Created] (SPARK-39903) Reenable TPC-DS q72 in GitHub Actions

Hyukjin Kwon created SPARK-39903: Summary: Reenable TPC-DS q72 in GitHub Actions Key: SPARK-39903 URL: https://issues.apache.org/jira/browse/SPARK-39903 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-39900) Issue with querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572201#comment-17572201 ] Hyukjin Kwon commented on SPARK-39900: -- Please go ahead for a PR [~Zing] > Issue with querying

[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572193#comment-17572193 ] Sumeet commented on SPARK-39902: An example of this change can be seen while viewing the Iceberg scans

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Attachment: Screen Shot 2022-07-27 at 6.39.48 PM.png > Add Scan details to spark plan scan node in SparkUI

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Attachment: Screen Shot 2022-07-27 at 6.38.56 PM.png > Add Scan details to spark plan scan node in SparkUI

[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572192#comment-17572192 ] Apache Spark commented on SPARK-39902: -- User 'sumeetgajjar' has created a pull request for this

[jira] [Assigned] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39902: Assignee: Apache Spark > Add Scan details to spark plan scan node in SparkUI >

[jira] [Assigned] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39902: Assignee: (was: Apache Spark) > Add Scan details to spark plan scan node in SparkUI

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Description: Hi, For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" as opposed

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Attachment: Screen Shot 2022-07-27 at 6.00.50 PM.png > Add Scan details to spark plan scan node in SparkUI

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Attachment: Screen Shot 2022-07-27 at 6.00.27 PM.png > Add Scan details to spark plan scan node in SparkUI

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Attachment: (was: Screen Shot 2022-07-27 at 6.00.27 PM.png) > Add Scan details to spark plan scan node

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Attachment: Screen Shot 2022-07-27 at 6.00.27 PM.png > Add Scan details to spark plan scan node in SparkUI

[jira] [Updated] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumeet updated SPARK-39902: --- Description: Hi, For DSv2, the scan node in the spark plan on SparkUI simply shows "BatchScan" as opposed

[jira] [Commented] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-39902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572186#comment-17572186 ] Sumeet commented on SPARK-39902: I'm working on it and will publish a patch soon. > Add Scan details to

[jira] [Created] (SPARK-39902) Add Scan details to spark plan scan node in SparkUI

Sumeet created SPARK-39902: -- Summary: Add Scan details to spark plan scan node in SparkUI Key: SPARK-39902 URL: https://issues.apache.org/jira/browse/SPARK-39902 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38496) Improve the test coverage for pyspark/sql module

[ https://issues.apache.org/jira/browse/SPARK-38496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572180#comment-17572180 ] Haejoon Lee commented on SPARK-38496: - I'm working on this > Improve the test coverage for

[jira] [Resolved] (SPARK-38493) Improve the test coverage for pyspark/pandas module

[ https://issues.apache.org/jira/browse/SPARK-38493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38493. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37294

[jira] [Resolved] (SPARK-39839) Handle special case of null variable-length Decimal with non-zero offsetAndSize in UnsafeRow structural integrity check

[ https://issues.apache.org/jira/browse/SPARK-39839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39839. -- Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution:

[jira] [Assigned] (SPARK-38493) Improve the test coverage for pyspark/pandas module

[ https://issues.apache.org/jira/browse/SPARK-38493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38493: Assignee: Haejoon Lee > Improve the test coverage for pyspark/pandas module >

[jira] [Assigned] (SPARK-39839) Handle special case of null variable-length Decimal with non-zero offsetAndSize in UnsafeRow structural integrity check

[ https://issues.apache.org/jira/browse/SPARK-39839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39839: Assignee: Kris Mok > Handle special case of null variable-length Decimal with non-zero

[jira] [Commented] (SPARK-39743) Unable to set zstd compression level while writing parquet files

[ https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572169#comment-17572169 ] zhiming she commented on SPARK-39743: - [~hyukjin.kwon]   can you mark this issue as `Resolved`. >

[jira] [Commented] (SPARK-39900) Issue with querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572166#comment-17572166 ] shezm commented on SPARK-39900: --- I can try to fix this issue. > Issue with querying dataframe produced by

[jira] [Commented] (SPARK-39722) Make Dataset.showString() public

[ https://issues.apache.org/jira/browse/SPARK-39722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572165#comment-17572165 ] Erik Krogen commented on SPARK-39722: - General +1 from me. We have some internal code that does

[jira] [Created] (SPARK-39901) Reconsider design of ignoreCorruptFiles feature

Josh Rosen created SPARK-39901: -- Summary: Reconsider design of ignoreCorruptFiles feature Key: SPARK-39901 URL: https://issues.apache.org/jira/browse/SPARK-39901 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39898. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37321

[jira] [Assigned] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39898: - Assignee: Dongjoon Hyun > Upgrade kubernetes-client to 5.12.3 >

[jira] [Commented] (SPARK-39857) V2ExpressionBuilder uses the wrong LiteralValue data type for In predicate

[ https://issues.apache.org/jira/browse/SPARK-39857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572125#comment-17572125 ] Apache Spark commented on SPARK-39857: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-39857) V2ExpressionBuilder uses the wrong LiteralValue data type for In predicate

[ https://issues.apache.org/jira/browse/SPARK-39857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572124#comment-17572124 ] Apache Spark commented on SPARK-39857: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Updated] (SPARK-39900) Issue with querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-39900: --- Summary: Issue with querying dataframe produced by 'binaryFile' format using 'not' operator (was:

[jira] [Updated] (SPARK-39900) Querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-39900: --- Description: When creating a dataframe using the binaryFile format I am encountering weird result

[jira] [Updated] (SPARK-39900) Querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-39900: --- Description: When creating a dataframe using the binaryFile format I am encountering weird result

[jira] [Updated] (SPARK-39900) Querying dataframe produced by 'binaryFile' format using 'not' operator

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-39900: --- Summary: Querying dataframe produced by 'binaryFile' format using 'not' operator (was: Incorrect

[jira] [Updated] (SPARK-39900) Incorrect result when query dataframe produced by 'binaryFile' format

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-39900: --- Description: When creating a dataframe using the binaryFile format I am encountering weird result

[jira] [Updated] (SPARK-39900) Incorrect result when query dataframe produced by 'binaryFile' format

[ https://issues.apache.org/jira/browse/SPARK-39900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoit Roy updated SPARK-39900: --- Description: When creating a dataframe using the binaryFile format I am encountering weird result

[jira] [Created] (SPARK-39900) Incorrect result when query dataframe produced by 'binaryFile' format

Benoit Roy created SPARK-39900: -- Summary: Incorrect result when query dataframe produced by 'binaryFile' format Key: SPARK-39900 URL: https://issues.apache.org/jira/browse/SPARK-39900 Project: Spark

[jira] [Commented] (SPARK-39899) Incorrect passing of message parameters in InvalidUDFClassException

[ https://issues.apache.org/jira/browse/SPARK-39899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572096#comment-17572096 ] Apache Spark commented on SPARK-39899: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39899) Incorrect passing of message parameters in InvalidUDFClassException

[ https://issues.apache.org/jira/browse/SPARK-39899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39899: Assignee: Apache Spark (was: Max Gekk) > Incorrect passing of message parameters in

[jira] [Assigned] (SPARK-39899) Incorrect passing of message parameters in InvalidUDFClassException

[ https://issues.apache.org/jira/browse/SPARK-39899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39899: Assignee: Max Gekk (was: Apache Spark) > Incorrect passing of message parameters in

[jira] [Commented] (SPARK-39899) Incorrect passing of message parameters in InvalidUDFClassException

[ https://issues.apache.org/jira/browse/SPARK-39899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572095#comment-17572095 ] Apache Spark commented on SPARK-39899: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-39899) Incorrect passing of message parameters in InvalidUDFClassException

Max Gekk created SPARK-39899: Summary: Incorrect passing of message parameters in InvalidUDFClassException Key: SPARK-39899 URL: https://issues.apache.org/jira/browse/SPARK-39899 Project: Spark

[jira] [Updated] (SPARK-39864) ExecutionListenerManager's registration of the ExecutionListenerBus should be lazy

[ https://issues.apache.org/jira/browse/SPARK-39864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39864: -- Affects Version/s: 3.4.0 (was: 2.0.0) > ExecutionListenerManager's

[jira] [Commented] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572016#comment-17572016 ] Apache Spark commented on SPARK-39898: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17572015#comment-17572015 ] Apache Spark commented on SPARK-39898: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-39845) 0.0 and -0.0 are not consistent in set operations

[ https://issues.apache.org/jira/browse/SPARK-39845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navin Kumar updated SPARK-39845: Description: This is a continuation of the issue described in SPARK-32110. When using Array

[jira] [Assigned] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39898: Assignee: Apache Spark > Upgrade kubernetes-client to 5.12.3 >

[jira] [Assigned] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39898: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 5.12.3 >

[jira] [Updated] (SPARK-39845) 0.0 and -0.0 are not consistent in set operations

[ https://issues.apache.org/jira/browse/SPARK-39845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navin Kumar updated SPARK-39845: Description: This is a continuation of the issue described in SPARK-32110. When using Array

[jira] [Updated] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

[ https://issues.apache.org/jira/browse/SPARK-39898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39898: -- Component/s: Build > Upgrade kubernetes-client to 5.12.3 >

[jira] [Created] (SPARK-39898) Upgrade kubernetes-client to 5.12.3

Dongjoon Hyun created SPARK-39898: - Summary: Upgrade kubernetes-client to 5.12.3 Key: SPARK-39898 URL: https://issues.apache.org/jira/browse/SPARK-39898 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39885) Behavior differs between arrays_overlap and array_contains for negative 0.0

[ https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-39885: -- Summary: Behavior differs between arrays_overlap and array_contains for negative 0.0

[jira] [Updated] (SPARK-39885) Behavior differs between array_overlap and array_contains for negative 0.0

[ https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-39885: -- Description: {{array_contains([0.0], -0.0)}} will return true.

[jira] [Created] (SPARK-39897) StackOverflowError in TaskMemoryManager

Andrew Ray created SPARK-39897: -- Summary: StackOverflowError in TaskMemoryManager Key: SPARK-39897 URL: https://issues.apache.org/jira/browse/SPARK-39897 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-39743) Unable to set zstd compression level while writing parquet files

[ https://issues.apache.org/jira/browse/SPARK-39743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571995#comment-17571995 ] shezm commented on SPARK-39743: --- [~yeachan153]  spark.io.compression.zstd.level is adapted to 

[jira] [Comment Edited] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark.

[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571978#comment-17571978 ] pralabhkumar edited comment on SPARK-39375 at 7/27/22 2:51 PM: --- This is

[jira] [Commented] (SPARK-39375) SPIP: Spark Connect - A client and server interface for Apache Spark.

[ https://issues.apache.org/jira/browse/SPARK-39375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571978#comment-17571978 ] pralabhkumar commented on SPARK-39375: -- This is really good proposal and need of an hour

[jira] [Commented] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-39896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571950#comment-17571950 ] Yuming Wang commented on SPARK-39896: - cc [~fchen] > The structural integrity of the plan is broken

[jira] [Created] (SPARK-39896) The structural integrity of the plan is broken after UnwrapCastInBinaryComparison

Yuming Wang created SPARK-39896: --- Summary: The structural integrity of the plan is broken after UnwrapCastInBinaryComparison Key: SPARK-39896 URL: https://issues.apache.org/jira/browse/SPARK-39896

[jira] [Assigned] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

[ https://issues.apache.org/jira/browse/SPARK-39880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39880: Assignee: Wenchen Fan > V2 SHOW FUNCTIONS command should print qualified function name like v1 >

[jira] [Resolved] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

[ https://issues.apache.org/jira/browse/SPARK-39880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39880. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37301

[jira] [Commented] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571871#comment-17571871 ] Apache Spark commented on SPARK-39819: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-39887) Expression transform error

[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571865#comment-17571865 ] Apache Spark commented on SPARK-39887: -- User 'cfmcgrady' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39887) Expression transform error

[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39887: Assignee: Apache Spark > Expression transform error > -- > >

[jira] [Assigned] (SPARK-39887) Expression transform error

[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39887: Assignee: (was: Apache Spark) > Expression transform error >

[jira] [Commented] (SPARK-39887) Expression transform error

[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571864#comment-17571864 ] Apache Spark commented on SPARK-39887: -- User 'cfmcgrady' has created a pull request for this issue:

[jira] [Updated] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39819: --- Summary: DS V2 aggregate push down can work with Top N or Paging (Sort with group expressions)

[jira] [Assigned] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39890: Assignee: (was: Apache Spark) > Make TakeOrderedAndProjectExec inherit

[jira] [Commented] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571831#comment-17571831 ] Apache Spark commented on SPARK-39890: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

[ https://issues.apache.org/jira/browse/SPARK-39890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39890: Assignee: Apache Spark > Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

[jira] [Created] (SPARK-39895) pyspark drop doesn't accept *cols

Santosh Pingale created SPARK-39895: --- Summary: pyspark drop doesn't accept *cols Key: SPARK-39895 URL: https://issues.apache.org/jira/browse/SPARK-39895 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-39894) Combine the similar binary comparison in boolean expression.

[ https://issues.apache.org/jira/browse/SPARK-39894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571817#comment-17571817 ] Apache Spark commented on SPARK-39894: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39894) Combine the similar binary comparison in boolean expression.

[ https://issues.apache.org/jira/browse/SPARK-39894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39894: Assignee: Apache Spark > Combine the similar binary comparison in boolean expression. >

[jira] [Commented] (SPARK-39894) Combine the similar binary comparison in boolean expression.

[ https://issues.apache.org/jira/browse/SPARK-39894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571816#comment-17571816 ] Apache Spark commented on SPARK-39894: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39894) Combine the similar binary comparison in boolean expression.

[ https://issues.apache.org/jira/browse/SPARK-39894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39894: Assignee: (was: Apache Spark) > Combine the similar binary comparison in boolean

[jira] [Assigned] (SPARK-39731) Correctness issue when parsing dates with yyyyMMdd format in CSV and JSON

[ https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39731: --- Assignee: Ivan Sadikov > Correctness issue when parsing dates with MMdd format in CSV

[jira] [Resolved] (SPARK-39731) Correctness issue when parsing dates with yyyyMMdd format in CSV and JSON

[ https://issues.apache.org/jira/browse/SPARK-39731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39731. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37147

[jira] [Assigned] (SPARK-39893) Remove redundant aggregate if it is group only and all grouping and aggregate expressions are foldable

[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39893: Assignee: Apache Spark > Remove redundant aggregate if it is group only and all grouping

[jira] [Commented] (SPARK-39893) Remove redundant aggregate if it is group only and all grouping and aggregate expressions are foldable

[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571804#comment-17571804 ] Apache Spark commented on SPARK-39893: -- User 'wankunde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39893) Remove redundant aggregate if it is group only and all grouping and aggregate expressions are foldable

[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39893: Assignee: (was: Apache Spark) > Remove redundant aggregate if it is group only and

[jira] [Commented] (SPARK-39893) Remove redundant aggregate if it is group only and all grouping and aggregate expressions are foldable

[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571803#comment-17571803 ] Apache Spark commented on SPARK-39893: -- User 'wankunde' has created a pull request for this issue:

[jira] [Updated] (SPARK-39873) Remove OptimizeLimitZero and merge it into EliminateLimits

[ https://issues.apache.org/jira/browse/SPARK-39873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39873: --- Affects Version/s: 3.4.0 (was: 2.4.0) > Remove OptimizeLimitZero and

[jira] [Created] (SPARK-39894) Combine the similar binary comparison in boolean expression.

jiaan.geng created SPARK-39894: -- Summary: Combine the similar binary comparison in boolean expression. Key: SPARK-39894 URL: https://issues.apache.org/jira/browse/SPARK-39894 Project: Spark

[jira] [Updated] (SPARK-39893) Remove redundant aggregate if it is group only and all grouping and aggregate expressions are foldable

[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-39893: Summary: Remove redundant aggregate if it is group only and all grouping and aggregate expressions are

[jira] [Updated] (SPARK-39893) Remove Aggregate if it is group only and all grouping and aggregate expressions are foldable

[ https://issues.apache.org/jira/browse/SPARK-39893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-39893: Summary: Remove Aggregate if it is group only and all grouping and aggregate expressions are foldable

  1   2   >