[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520910#comment-17520910 ] Apache Spark commented on SPARK-38829: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520909#comment-17520909 ] Apache Spark commented on SPARK-38829: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Resolved] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

[ https://issues.apache.org/jira/browse/SPARK-38859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38859. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36142

[jira] [Assigned] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

[ https://issues.apache.org/jira/browse/SPARK-38859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38859: Assignee: Yikun Jiang > iloc setitem failed due to "Cannot convert * into bool" >

[jira] [Assigned] (SPARK-38731) Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38731: Assignee: Max Gekk > Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to

[jira] [Resolved] (SPARK-38731) Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38731. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36147

[jira] [Resolved] (SPARK-38730) Move tests for the grouping error classes to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38730. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36147

[jira] [Assigned] (SPARK-38730) Move tests for the grouping error classes to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38730: Assignee: Max Gekk > Move tests for the grouping error classes to

[jira] [Created] (SPARK-38867) Avoid OOM when bufferedPlan has a lot of duplicate keys in SortMergeJoin codegen

mcdull_zhang created SPARK-38867: Summary: Avoid OOM when bufferedPlan has a lot of duplicate keys in SortMergeJoin codegen Key: SPARK-38867 URL: https://issues.apache.org/jira/browse/SPARK-38867

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520900#comment-17520900 ] Gengliang Wang commented on SPARK-38829: [~ivan.sadikov] +1, disabling it in 3.3 is simpler >

[jira] [Commented] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520897#comment-17520897 ] Apache Spark commented on SPARK-38678: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520896#comment-17520896 ] Apache Spark commented on SPARK-38678: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-38835) Refactor FsHistoryProviderSuite to test rocks db

[ https://issues.apache.org/jira/browse/SPARK-38835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520895#comment-17520895 ] Apache Spark commented on SPARK-38835: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-38835) Refactor FsHistoryProviderSuite to test rocks db

[ https://issues.apache.org/jira/browse/SPARK-38835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520894#comment-17520894 ] Apache Spark commented on SPARK-38835: -- User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-38677) pyspark hangs in local mode running rdd map operation

[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38677. -- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-38796) Implement the to_number and try_to_number SQL functions according to a new specification

[ https://issues.apache.org/jira/browse/SPARK-38796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520881#comment-17520881 ] Apache Spark commented on SPARK-38796: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Commented] (SPARK-38866) Update ORC to 1.7.4

[ https://issues.apache.org/jira/browse/SPARK-38866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520880#comment-17520880 ] Apache Spark commented on SPARK-38866: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-38866) Update ORC to 1.7.4

[ https://issues.apache.org/jira/browse/SPARK-38866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38866: Assignee: (was: Apache Spark) > Update ORC to 1.7.4 > --- > >

[jira] [Assigned] (SPARK-38866) Update ORC to 1.7.4

[ https://issues.apache.org/jira/browse/SPARK-38866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38866: Assignee: Apache Spark > Update ORC to 1.7.4 > --- > >

[jira] [Created] (SPARK-38866) Update ORC to 1.7.4

William Hyun created SPARK-38866: Summary: Update ORC to 1.7.4 Key: SPARK-38866 URL: https://issues.apache.org/jira/browse/SPARK-38866 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

[ https://issues.apache.org/jira/browse/SPARK-38865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520878#comment-17520878 ] Apache Spark commented on SPARK-38865: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

[ https://issues.apache.org/jira/browse/SPARK-38865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38865: Assignee: Apache Spark > Update document of JDBC options for pushDownAggregate and

[jira] [Commented] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

[ https://issues.apache.org/jira/browse/SPARK-38865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520877#comment-17520877 ] Apache Spark commented on SPARK-38865: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

[ https://issues.apache.org/jira/browse/SPARK-38865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38865: Assignee: (was: Apache Spark) > Update document of JDBC options for

[jira] [Created] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

jiaan.geng created SPARK-38865: -- Summary: Update document of JDBC options for pushDownAggregate and pushDownLimit Key: SPARK-38865 URL: https://issues.apache.org/jira/browse/SPARK-38865 Project: Spark

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520870#comment-17520870 ] Ivan Sadikov commented on SPARK-38829: -- [~Gengliang.Wang] Do you still want to merge the PR for 3.3

[jira] [Commented] (SPARK-27998) Column alias should support double quote string

[ https://issues.apache.org/jira/browse/SPARK-27998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520841#comment-17520841 ] Apache Spark commented on SPARK-27998: -- User 'andygrove' has created a pull request for this issue:

[jira] [Commented] (SPARK-27998) Column alias should support double quote string

[ https://issues.apache.org/jira/browse/SPARK-27998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520840#comment-17520840 ] Apache Spark commented on SPARK-27998: -- User 'andygrove' has created a pull request for this issue:

[jira] [Updated] (SPARK-38864) Melt function for Dataset API

[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-38864: -- Description: As pointed out in SPARK-30273 and SPARK-37799, the Dataset API provides the

[jira] [Commented] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520801#comment-17520801 ] Jack commented on SPARK-38862: -- **Edit** - Having reviewed the current status of implementation, could we

[jira] [Commented] (SPARK-38864) Melt function for Dataset API

[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520796#comment-17520796 ] Apache Spark commented on SPARK-38864: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38864) Melt function for Dataset API

[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38864: Assignee: Apache Spark > Melt function for Dataset API > - >

[jira] [Assigned] (SPARK-38864) Melt function for Dataset API

[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38864: Assignee: (was: Apache Spark) > Melt function for Dataset API >

[jira] [Commented] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520794#comment-17520794 ] Apache Spark commented on SPARK-38085: -- User 'aokolnychyi' has created a pull request for this

[jira] [Commented] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520793#comment-17520793 ] Apache Spark commented on SPARK-38085: -- User 'aokolnychyi' has created a pull request for this

[jira] [Created] (SPARK-38864) Melt function for Dataset API

Enrico Minack created SPARK-38864: - Summary: Melt function for Dataset API Key: SPARK-38864 URL: https://issues.apache.org/jira/browse/SPARK-38864 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-38863) Implement `skipna` parameter of `DataFrame.all`

[ https://issues.apache.org/jira/browse/SPARK-38863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520790#comment-17520790 ] Apache Spark commented on SPARK-38863: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-38863) Implement `skipna` parameter of `DataFrame.all`

[ https://issues.apache.org/jira/browse/SPARK-38863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38863: Assignee: (was: Apache Spark) > Implement `skipna` parameter of `DataFrame.all` >

[jira] [Assigned] (SPARK-38863) Implement `skipna` parameter of `DataFrame.all`

[ https://issues.apache.org/jira/browse/SPARK-38863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38863: Assignee: Apache Spark > Implement `skipna` parameter of `DataFrame.all` >

[jira] [Commented] (SPARK-38863) Implement `skipna` parameter of `DataFrame.all`

[ https://issues.apache.org/jira/browse/SPARK-38863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520791#comment-17520791 ] Apache Spark commented on SPARK-38863: -- User 'xinrong-databricks' has created a pull request for

[jira] [Created] (SPARK-38863) Implement `skipna` parameter of `DataFrame.all`

Xinrong Meng created SPARK-38863: Summary: Implement `skipna` parameter of `DataFrame.all` Key: SPARK-38863 URL: https://issues.apache.org/jira/browse/SPARK-38863 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-38731) Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38731: Assignee: Apache Spark > Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to

[jira] [Assigned] (SPARK-38731) Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38731: Assignee: (was: Apache Spark) > Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to

[jira] [Commented] (SPARK-38731) Move the tests `GROUPING_SIZE_LIMIT_EXCEEDED` to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520778#comment-17520778 ] Apache Spark commented on SPARK-38731: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-38730) Move tests for the grouping error classes to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520777#comment-17520777 ] Apache Spark commented on SPARK-38730: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38730) Move tests for the grouping error classes to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38730: Assignee: (was: Apache Spark) > Move tests for the grouping error classes to

[jira] [Assigned] (SPARK-38730) Move tests for the grouping error classes to QueryCompilationErrorsSuite

[ https://issues.apache.org/jira/browse/SPARK-38730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38730: Assignee: Apache Spark > Move tests for the grouping error classes to

[jira] [Updated] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack updated SPARK-38862: - Priority: Trivial (was: Major) > Basic Authentication or Token Based Authentication for The REST Submission >

[jira] [Updated] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack updated SPARK-38862: - Priority: Major (was: Trivial) > Basic Authentication or Token Based Authentication for The REST Submission >

[jira] [Commented] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520739#comment-17520739 ] Apache Spark commented on SPARK-38404: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38404: Assignee: Apache Spark > Spark does not find CTE inside nested CTE >

[jira] [Commented] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520737#comment-17520737 ] Apache Spark commented on SPARK-38404: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-38404) Spark does not find CTE inside nested CTE

[ https://issues.apache.org/jira/browse/SPARK-38404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38404: Assignee: (was: Apache Spark) > Spark does not find CTE inside nested CTE >

[jira] [Updated] (SPARK-38791) Output parameter values of error classes in SQL style

[ https://issues.apache.org/jira/browse/SPARK-38791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38791: - Fix Version/s: 3.3.0 > Output parameter values of error classes in SQL style >

[jira] [Updated] (SPARK-38791) Output parameter values of error classes in SQL style

[ https://issues.apache.org/jira/browse/SPARK-38791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38791: - Affects Version/s: 3.3.0 > Output parameter values of error classes in SQL style >

[jira] [Updated] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack updated SPARK-38862: - Target Version/s: 3.3.0, 3.2.2 (was: 3.2.1, 3.3.0, 3.2.2) > Basic Authentication or Token Based Authentication

[jira] [Updated] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

[ https://issues.apache.org/jira/browse/SPARK-38862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack updated SPARK-38862: - Description: [Spark documentation|https://spark.apache.org/docs/latest/security.html] states that ??The REST

[jira] [Created] (SPARK-38862) Basic Authentication or Token Based Authentication for The REST Submission Server

Jack created SPARK-38862: Summary: Basic Authentication or Token Based Authentication for The REST Submission Server Key: SPARK-38862 URL: https://issues.apache.org/jira/browse/SPARK-38862 Project: Spark

[jira] [Assigned] (SPARK-38854) Improve the test coverage for pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-38854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38854: Assignee: Apache Spark (was: Hyukjin Kwon) > Improve the test coverage for

[jira] [Assigned] (SPARK-38854) Improve the test coverage for pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-38854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38854: Assignee: Hyukjin Kwon (was: Apache Spark) > Improve the test coverage for

[jira] [Commented] (SPARK-38854) Improve the test coverage for pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-38854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520610#comment-17520610 ] Apache Spark commented on SPARK-38854: -- User 'pralabhkumar' has created a pull request for this

[jira] [Created] (SPARK-38861) GroupState.getCurrentWatermarkMs() on static Dataframe throws exception but should return -1

Trevor Christman created SPARK-38861: Summary: GroupState.getCurrentWatermarkMs() on static Dataframe throws exception but should return -1 Key: SPARK-38861 URL:

[jira] [Updated] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eugene updated SPARK-38846: --- Environment: Spark2.3.0/Spark3.2.1 on Yarn Teradata 16.20.32.59 was: Spark2.3.0 on Yarn Teradata

[jira] [Updated] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eugene updated SPARK-38846: --- Description: I'm trying to load data from Teradata, the code using is:          sparkSession.read          

[jira] [Updated] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eugene updated SPARK-38846: --- Affects Version/s: 3.2.1 > Teradata's Number is either converted to its floor value or ceiling value >

[jira] [Commented] (SPARK-38791) Output parameter values of error classes in SQL style

[ https://issues.apache.org/jira/browse/SPARK-38791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520562#comment-17520562 ] Apache Spark commented on SPARK-38791: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-37133) Add a config to optionally enforce ANSI reserved keywords

[ https://issues.apache.org/jira/browse/SPARK-37133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37133: - Epic Link: SPARK-38860 > Add a config to optionally enforce ANSI reserved keywords >

[jira] [Updated] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default

[ https://issues.apache.org/jira/browse/SPARK-37724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37724: - Epic Link: SPARK-38860 > ANSI mode: disable ANSI reserved keywords by default >

[jira] [Updated] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map

[ https://issues.apache.org/jira/browse/SPARK-37750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37750: - Epic Link: SPARK-38860 > ANSI mode: optionally return null result if element not exists in array/map >

[jira] [Updated] (SPARK-38304) Elt() should return null if index is null under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-38304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38304: - Epic Link: SPARK-38860 > Elt() should return null if index is null under ANSI mode >

[jira] [Created] (SPARK-38860) ANSI enhancements in Spark 3.3

Max Gekk created SPARK-38860: Summary: ANSI enhancements in Spark 3.3 Key: SPARK-38860 URL: https://issues.apache.org/jira/browse/SPARK-38860 Project: Spark Issue Type: Epic

[jira] [Commented] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

[ https://issues.apache.org/jira/browse/SPARK-38859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520543#comment-17520543 ] Apache Spark commented on SPARK-38859: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

[ https://issues.apache.org/jira/browse/SPARK-38859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520542#comment-17520542 ] Apache Spark commented on SPARK-38859: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

[ https://issues.apache.org/jira/browse/SPARK-38859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38859: Assignee: (was: Apache Spark) > iloc setitem failed due to "Cannot convert * into

[jira] [Assigned] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

[ https://issues.apache.org/jira/browse/SPARK-38859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38859: Assignee: Apache Spark > iloc setitem failed due to "Cannot convert * into bool" >

[jira] [Commented] (SPARK-38689) Use error classes in the compilation errors of not allowed DESC PARTITION

[ https://issues.apache.org/jira/browse/SPARK-38689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520541#comment-17520541 ] huangtengfei commented on SPARK-38689: -- I am working on this. Thanks [~maxgekk] > Use error

[jira] [Created] (SPARK-38859) iloc setitem failed due to "Cannot convert * into bool"

Yikun Jiang created SPARK-38859: --- Summary: iloc setitem failed due to "Cannot convert * into bool" Key: SPARK-38859 URL: https://issues.apache.org/jira/browse/SPARK-38859 Project: Spark Issue

[jira] [Updated] (SPARK-38858) PythonException - socke.timeout: timed out - socket.py line 707

[ https://issues.apache.org/jira/browse/SPARK-38858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Veale updated SPARK-38858: --- Environment: Intel i7 core 64Gb ram ( 30Gb assigned to spark executor memory) 4 cores Windows 11

[jira] [Updated] (SPARK-38858) PythonException - socke.timeout: timed out - socket.py line 707

[ https://issues.apache.org/jira/browse/SPARK-38858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Veale updated SPARK-38858: --- Attachment: socketpy.png socketError - timed out.png > PythonException -

[jira] [Created] (SPARK-38858) PythonException - socke.timeout: timed out - socket.py line 707

Alex Veale created SPARK-38858: -- Summary: PythonException - socke.timeout: timed out - socket.py line 707 Key: SPARK-38858 URL: https://issues.apache.org/jira/browse/SPARK-38858 Project: Spark

[jira] [Resolved] (SPARK-38796) Implement the to_number and try_to_number SQL functions according to a new specification

[ https://issues.apache.org/jira/browse/SPARK-38796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38796. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36066

[jira] [Assigned] (SPARK-38796) Implement the to_number and try_to_number SQL functions according to a new specification

[ https://issues.apache.org/jira/browse/SPARK-38796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38796: --- Assignee: Daniel > Implement the to_number and try_to_number SQL functions according to a

[jira] [Resolved] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.py

[ https://issues.apache.org/jira/browse/SPARK-37424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37424. Fix Version/s: 3.3.0 Assignee: Maciej Szymkiewicz Resolution:

[jira] [Assigned] (SPARK-37396) Inline type hint files for files in python/pyspark/mllib

[ https://issues.apache.org/jira/browse/SPARK-37396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37396: -- Assignee: Maciej Szymkiewicz > Inline type hint files for files in

[jira] [Resolved] (SPARK-37396) Inline type hint files for files in python/pyspark/mllib

[ https://issues.apache.org/jira/browse/SPARK-37396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37396. Fix Version/s: 3.3.0 Resolution: Fixed > Inline type hint files for files

[jira] [Created] (SPARK-38857) test_mode test failed due to 1.4.1-1.4.3 bug

Yikun Jiang created SPARK-38857: --- Summary: test_mode test failed due to 1.4.1-1.4.3 bug Key: SPARK-38857 URL: https://issues.apache.org/jira/browse/SPARK-38857 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37402) Inline type hints for python/pyspark/mllib/clustering.py

[ https://issues.apache.org/jira/browse/SPARK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37402: -- Assignee: Maciej Szymkiewicz > Inline type hints for

[jira] [Resolved] (SPARK-37402) Inline type hints for python/pyspark/mllib/clustering.py

[ https://issues.apache.org/jira/browse/SPARK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37402. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-38856) Fix a rejectedExecutionException error when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-38856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38856: Assignee: Apache Spark > Fix a rejectedExecutionException error when push-based shuffle

[jira] [Assigned] (SPARK-38856) Fix a rejectedExecutionException error when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-38856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38856: Assignee: (was: Apache Spark) > Fix a rejectedExecutionException error when

[jira] [Commented] (SPARK-38856) Fix a rejectedExecutionException error when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-38856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520457#comment-17520457 ] Apache Spark commented on SPARK-38856: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Created] (SPARK-38856) Fix a rejectedExecutionException error when push-based shuffle is enabled

weixiuli created SPARK-38856: Summary: Fix a rejectedExecutionException error when push-based shuffle is enabled Key: SPARK-38856 URL: https://issues.apache.org/jira/browse/SPARK-38856 Project: Spark

[jira] [Assigned] (SPARK-38855) DS V2 supports push down math functions

[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38855: Assignee: (was: Apache Spark) > DS V2 supports push down math functions >

[jira] [Assigned] (SPARK-38855) DS V2 supports push down math functions

[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38855: Assignee: Apache Spark > DS V2 supports push down math functions >

[jira] [Commented] (SPARK-38855) DS V2 supports push down math functions

[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520445#comment-17520445 ] Apache Spark commented on SPARK-38855: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-38855) DS V2 supports push down math functions

[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38855: --- Description: Currently, Spark have a lot math functions of ANSI standard. LN, EXP, POWER, SQRT,

[jira] [Created] (SPARK-38855) DS V2 supports push down math functions

jiaan.geng created SPARK-38855: -- Summary: DS V2 supports push down math functions Key: SPARK-38855 URL: https://issues.apache.org/jira/browse/SPARK-38855 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-38855) DS V2 supports push down math functions

[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38855: --- Description: Currently, Spark have a lot misc non-aggregate functions of ANSI standard. abs,

[jira] [Commented] (SPARK-38854) Improve the test coverage for pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-38854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520426#comment-17520426 ] Hyukjin Kwon commented on SPARK-38854: -- Please go ahead. We don't have to assign someone. You'll be

[jira] [Resolved] (SPARK-38831) How to enable encryption for checkpoint data?

[ https://issues.apache.org/jira/browse/SPARK-38831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38831. -- Resolution: Invalid > How to enable encryption for checkpoint data? >

  1   2   >