[jira] [Assigned] (SPARK-34863) Support nested column in Spark Parquet vectorized readers

[ https://issues.apache.org/jira/browse/SPARK-34863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-34863: Assignee: Chao Sun (was: Apache Spark) > Support nested column in Spark Parquet vectorized reade

[jira] [Updated] (SPARK-38684) Stream-stream outer join has a possible correctness issue due to weakly read consistent on outer iterators

[ https://issues.apache.org/jira/browse/SPARK-38684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38684: - Labels: correctness releasenotes (was: correctness) > Stream-stream outer join has a possible c

[jira] [Updated] (SPARK-38320) (flat)MapGroupsWithState can timeout groups which just received inputs in the same microbatch

[ https://issues.apache.org/jira/browse/SPARK-38320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-38320: - Labels: correctness releasenotes (was: correctness) > (flat)MapGroupsWithState can timeout grou

[jira] [Commented] (SPARK-32838) Connot insert overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517242#comment-17517242 ] Apache Spark commented on SPARK-32838: -- User 'CHENXCHEN' has created a pull request

[jira] [Commented] (SPARK-32838) Connot insert overwite different partition with same table

[ https://issues.apache.org/jira/browse/SPARK-32838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517241#comment-17517241 ] Apache Spark commented on SPARK-32838: -- User 'CHENXCHEN' has created a pull request

[jira] [Updated] (SPARK-37375) Umbrella: Storage Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37375: -- Labels: (was: releasenotes) > Umbrella: Storage Partitioned Join > -

[jira] [Updated] (SPARK-37375) Umbrella: Storage Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37375: -- Labels: releasenotes (was: ) > Umbrella: Storage Partitioned Join > -

[jira] [Updated] (SPARK-37377) Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37377: -- Fix Version/s: (was: 3.4.0) > Initial implementation of Storage-Partitioned Join > ---

[jira] [Commented] (SPARK-37377) Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517238#comment-17517238 ] Dongjoon Hyun commented on SPARK-37377: --- This is backported to branch-3.3 via http

[jira] [Updated] (SPARK-37377) Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37377: -- Fix Version/s: 3.3.0 > Initial implementation of Storage-Partitioned Join > --

[jira] [Commented] (SPARK-31675) Fail to insert data to a table with remote location which causes by hive encryption check

[ https://issues.apache.org/jira/browse/SPARK-31675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517237#comment-17517237 ] CHC commented on SPARK-31675: - Met the same problem, the SQL to reproduce the problem is sho

[jira] [Commented] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

[ https://issues.apache.org/jira/browse/SPARK-38787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517220#comment-17517220 ] Anish Shrigondekar commented on SPARK-38787: Working on the PR for this fix.

[jira] [Commented] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

[ https://issues.apache.org/jira/browse/SPARK-38787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517217#comment-17517217 ] Anish Shrigondekar commented on SPARK-38787: CC - [~kabhwan]  > Possible co

[jira] [Updated] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

[ https://issues.apache.org/jira/browse/SPARK-38787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-38787: --- Shepherd: (was: Jungtaek Lim) > Possible correctness issue on stream-stream join w

[jira] [Created] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

Anish Shrigondekar created SPARK-38787: -- Summary: Possible correctness issue on stream-stream join when handling edge case Key: SPARK-38787 URL: https://issues.apache.org/jira/browse/SPARK-38787

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Epic Name: Error Message Improvements in Spark 3.3 (was: Improve errors of Spark 3.3) > Error Message

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Description: Get together all tickets related to improvements of error messages in Spark like migration

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-38781: Summary: Error Message Improvements in Spark 3.3 (was: Improve errors of Spark 3.3) > Error Message Impr

[jira] [Commented] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517189#comment-17517189 ] Apache Spark commented on SPARK-38767: -- User 'Yaohua628' has created a pull request

[jira] [Assigned] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38767: Assignee: Apache Spark > Support ignoreCorruptFiles and ignoreMissingFiles in Data Source

[jira] [Assigned] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38767: Assignee: (was: Apache Spark) > Support ignoreCorruptFiles and ignoreMissingFiles in

[jira] [Commented] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517188#comment-17517188 ] Apache Spark commented on SPARK-38767: -- User 'Yaohua628' has created a pull request

[jira] [Commented] (SPARK-37377) Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517185#comment-17517185 ] Apache Spark commented on SPARK-37377: -- User 'sunchao' has created a pull request f

[jira] [Updated] (SPARK-37378) Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog

[ https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37378: - Fix Version/s: 3.4.0 > Convert V2 Transform expressions into catalyst expressions and load their > asso

[jira] [Resolved] (SPARK-37378) Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog

[ https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-37378. -- Resolution: Duplicate This JIRA is covered as part of SPARK-37377 > Convert V2 Transform expressions

[jira] [Updated] (SPARK-37377) Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37377: - Description: This Jira tracks the initial implementation of storage-partitioned join. (was: Currently {

[jira] [Updated] (SPARK-37377) Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37377: - Summary: Initial implementation of Storage-Partitioned Join (was: Refactor V2 Partitioning interface an

[jira] [Resolved] (SPARK-37377) Refactor V2 Partitioning interface and remove deprecated usage of Distribution

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37377. --- Fix Version/s: 3.4.0 Assignee: Chao Sun Resolution: Fixed This is resolved v

[jira] [Reopened] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-38664: --- > Support compact EventLog when there are illegal characters in the path > -

[jira] [Resolved] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38664. --- Resolution: Not A Problem > Support compact EventLog when there are illegal characters in th

[jira] [Closed] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-38664. - > Support compact EventLog when there are illegal characters in the path > -

[jira] [Resolved] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] w l resolved SPARK-38664. - Resolution: Won't Fix > Support compact EventLog when there are illegal characters in the path > ---

[jira] [Resolved] (SPARK-38759) Add StreamingQueryListener support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38759. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36038 [https://gi

[jira] [Assigned] (SPARK-38759) Add StreamingQueryListener support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38759: Assignee: Hyukjin Kwon > Add StreamingQueryListener support in PySpark >

[jira] [Updated] (SPARK-38573) Support Auto Partition Statistics Collection

[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-38573: -- Summary: Support Auto Partition Statistics Collection (was: Support Auto Partition Le

[jira] [Created] (SPARK-38786) Test Bug in StatisticsSuite "change stats after add/drop partition command"

Kazuyuki Tanimura created SPARK-38786: - Summary: Test Bug in StatisticsSuite "change stats after add/drop partition command" Key: SPARK-38786 URL: https://issues.apache.org/jira/browse/SPARK-38786

[jira] [Commented] (SPARK-38573) Support Auto Partition Level Statistics Collection

[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517163#comment-17517163 ] Apache Spark commented on SPARK-38573: -- User 'kazuyukitanimura' has created a pull

[jira] [Assigned] (SPARK-38573) Support Auto Partition Level Statistics Collection

[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38573: Assignee: (was: Apache Spark) > Support Auto Partition Level Statistics Collection >

[jira] [Assigned] (SPARK-38573) Support Auto Partition Level Statistics Collection

[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38573: Assignee: Apache Spark > Support Auto Partition Level Statistics Collection > ---

[jira] [Updated] (SPARK-38573) Support Auto Partition Level Statistics Collection

[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-38573: -- Summary: Support Auto Partition Level Statistics Collection (was: Support Partition L

[jira] [Updated] (SPARK-38573) Support Partition Level Statistics Collection

[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-38573: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Support Partition L

[jira] [Assigned] (SPARK-38677) pyspark hangs in local mode running rdd map operation

[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reassigned SPARK-38677: -- Assignee: Ankur Dave > pyspark hangs in local mode running rdd map operation > --

[jira] [Commented] (SPARK-38677) pyspark hangs in local mode running rdd map operation

[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517063#comment-17517063 ] Apache Spark commented on SPARK-38677: -- User 'ankurdave' has created a pull request

[jira] [Assigned] (SPARK-38677) pyspark hangs in local mode running rdd map operation

[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38677: Assignee: Apache Spark > pyspark hangs in local mode running rdd map operation >

[jira] [Assigned] (SPARK-38677) pyspark hangs in local mode running rdd map operation

[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38677: Assignee: (was: Apache Spark) > pyspark hangs in local mode running rdd map operation

[jira] [Commented] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516862#comment-17516862 ] Apache Spark commented on SPARK-38108: -- User 'ivoson' has created a pull request fo

[jira] [Commented] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516861#comment-17516861 ] Apache Spark commented on SPARK-38108: -- User 'ivoson' has created a pull request fo

[jira] [Assigned] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38108: Assignee: Apache Spark > Use error classes in the compilation errors of UDF/UDAF > --

[jira] [Assigned] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38108: Assignee: (was: Apache Spark) > Use error classes in the compilation errors of UDF/UD

[jira] [Commented] (SPARK-38785) impl Series.ewm and DataFrame.ewm

[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516846#comment-17516846 ] zhengruifeng commented on SPARK-38785: -- h1. Pandas API on Spark: [EWM|https://pand

[jira] [Assigned] (SPARK-38785) impl Series.ewm and DataFrame.ewm

[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38785: Assignee: Apache Spark > impl Series.ewm and DataFrame.ewm >

[jira] [Commented] (SPARK-38785) impl Series.ewm and DataFrame.ewm

[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516845#comment-17516845 ] Apache Spark commented on SPARK-38785: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-38785) impl Series.ewm and DataFrame.ewm

[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38785: Assignee: (was: Apache Spark) > impl Series.ewm and DataFrame.ewm > -

[jira] [Commented] (SPARK-38785) impl Series.ewm and DataFrame.ewm

[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516844#comment-17516844 ] Apache Spark commented on SPARK-38785: -- User 'zhengruifeng' has created a pull requ

[jira] [Created] (SPARK-38785) impl Series.ewm and DataFrame.ewm

zhengruifeng created SPARK-38785: Summary: impl Series.ewm and DataFrame.ewm Key: SPARK-38785 URL: https://issues.apache.org/jira/browse/SPARK-38785 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-38683) It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connectio

[ https://issues.apache.org/jira/browse/SPARK-38683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516778#comment-17516778 ] Apache Spark commented on SPARK-38683: -- User 'weixiuli' has created a pull request

[jira] [Commented] (SPARK-38683) It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connectio

[ https://issues.apache.org/jira/browse/SPARK-38683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516772#comment-17516772 ] Apache Spark commented on SPARK-38683: -- User 'weixiuli' has created a pull request

[jira] [Commented] (SPARK-38683) It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connectio

[ https://issues.apache.org/jira/browse/SPARK-38683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516770#comment-17516770 ] Apache Spark commented on SPARK-38683: -- User 'weixiuli' has created a pull request

[jira] [Updated] (SPARK-36660) Cotangent is not supported by Dataframe

[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36660: - Epic Link: SPARK-38783 > Cotangent is not supported by Dataframe > -

[jira] [Updated] (SPARK-36683) Support secant and cosecant

[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36683: - Epic Link: SPARK-38783 > Support secant and cosecant > --- > > K

[jira] [Updated] (SPARK-36963) Add max_by/min_by to sql.functions

[ https://issues.apache.org/jira/browse/SPARK-36963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36963: - Epic Link: SPARK-38783 > Add max_by/min_by to sql.functions > -- > >

[jira] [Updated] (SPARK-37047) Add overloads for lpad and rpad for BINARY strings

[ https://issues.apache.org/jira/browse/SPARK-37047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37047: - Epic Link: SPARK-38783 > Add overloads for lpad and rpad for BINARY strings > --

[jira] [Updated] (SPARK-37520) Add the startswith() and endswith() string functions

[ https://issues.apache.org/jira/browse/SPARK-37520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37520: - Epic Link: SPARK-38783 > Add the startswith() and endswith() string functions >

[jira] [Updated] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions

[ https://issues.apache.org/jira/browse/SPARK-37475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37475: - Epic Link: SPARK-38783 > Add Scale Parameter to Floor and Ceil functions > -

[jira] [Updated] (SPARK-37508) Add CONTAINS() function

[ https://issues.apache.org/jira/browse/SPARK-37508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37508: - Epic Link: SPARK-38783 > Add CONTAINS() function > --- > > Key: SPAR

[jira] [Updated] (SPARK-37507) Add the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-37507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37507: - Epic Link: SPARK-38783 > Add the TO_BINARY() function > > >

[jira] [Updated] (SPARK-35161) Error-handling SQL functions

[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35161: - Epic Link: SPARK-38783 > Error-handling SQL functions > > >

[jira] [Updated] (SPARK-38345) Introduce SQL function ARRAY_SIZE

[ https://issues.apache.org/jira/browse/SPARK-38345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38345: - Epic Link: SPARK-38783 > Introduce SQL function ARRAY_SIZE > - > >

[jira] [Updated] (SPARK-37671) Support ANSI Aggregation Function of regression

[ https://issues.apache.org/jira/browse/SPARK-37671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37671: - Epic Link: SPARK-38783 > Support ANSI Aggregation Function of regression > -

[jira] [Updated] (SPARK-37584) New SQL function: map_contains_key

[ https://issues.apache.org/jira/browse/SPARK-37584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37584: - Epic Link: SPARK-38783 > New SQL function: map_contains_key > -- > >

[jira] [Updated] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-12567: - Epic Link: SPARK-38783 > Add aes_encrypt and aes_decrypt UDFs > > >

[jira] [Updated] (SPARK-36554) Error message while trying to use spark sql functions directly on dataframe columns without using select expression

[ https://issues.apache.org/jira/browse/SPARK-36554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36554: - Epic Link: SPARK-38783 > Error message while trying to use spark sql functions directly on dataframe >

[jira] [Updated] (SPARK-37552) Add the convert_timezone() function

[ https://issues.apache.org/jira/browse/SPARK-37552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37552: - Epic Link: SPARK-38783 > Add the convert_timezone() function > --- > >

[jira] [Updated] (SPARK-38332) Add the `DATEADD()` alias for `TIMESTAMPADD()`

[ https://issues.apache.org/jira/browse/SPARK-38332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38332: - Epic Link: SPARK-38783 > Add the `DATEADD()` alias for `TIMESTAMPADD()` > --

[jira] [Updated] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

[ https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38389: - Epic Link: SPARK-38783 > Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()` >

[jira] [Created] (SPARK-38784) Upgrade Jetty to 9.4.45

Hari Prasad G created SPARK-38784: - Summary: Upgrade Jetty to 9.4.45 Key: SPARK-38784 URL: https://issues.apache.org/jira/browse/SPARK-38784 Project: Spark Issue Type: Bug Component

[jira] [Updated] (SPARK-38284) Add the TIMESTAMPDIFF() function

[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38284: - Epic Link: SPARK-38783 > Add the TIMESTAMPDIFF() function > > >

[jira] [Updated] (SPARK-38195) Add the TIMESTAMPADD() function

[ https://issues.apache.org/jira/browse/SPARK-38195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38195: - Epic Link: SPARK-38783 > Add the TIMESTAMPADD() function > --- > >

[jira] [Created] (SPARK-38783) New functions in Spark SQL 3.3

Max Gekk created SPARK-38783: Summary: New functions in Spark SQL 3.3 Key: SPARK-38783 URL: https://issues.apache.org/jira/browse/SPARK-38783 Project: Spark Issue Type: Epic Components:

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-33539: - Epic Link: SPARK-38781 > Standardize exception messages in Spark > -

[jira] [Updated] (SPARK-38781) Improve errors of Spark 3.3

[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Epic Name: Improve errors of Spark 3.3 (was: Improve errors of Spark SQL 3.3) > Improve errors of Spar

[jira] [Updated] (SPARK-38781) Improve errors of Spark 3.3

[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Summary: Improve errors of Spark 3.3 (was: Improve errors of Spark SQL 3.3) > Improve errors of Spark 3

[jira] [Resolved] (SPARK-38782) Use error classes in Spark Core 3.3

[ https://issues.apache.org/jira/browse/SPARK-38782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38782. -- Resolution: Duplicate > Use error classes in Spark Core 3.3 > --- > >

[jira] [Updated] (SPARK-37935) Migrate onto error classes

[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37935: - Component/s: Spark Core > Migrate onto error classes > -- > > Ke

[jira] [Created] (SPARK-38782) Use error classes in Spark Core 3.3

Max Gekk created SPARK-38782: Summary: Use error classes in Spark Core 3.3 Key: SPARK-38782 URL: https://issues.apache.org/jira/browse/SPARK-38782 Project: Spark Issue Type: Epic Compon

[jira] [Resolved] (SPARK-38778) Replace http with https for project url in pom

[ https://issues.apache.org/jira/browse/SPARK-38778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38778. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36053 [https://gith

[jira] [Assigned] (SPARK-38778) Replace http with https for project url in pom

[ https://issues.apache.org/jira/browse/SPARK-38778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38778: --- Assignee: Kent Yao > Replace http with https for project url in pom > -

[jira] [Updated] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36870: - Epic Link: SPARK-38781 > Introduce INTERNAL_ERROR error class > > >

[jira] [Updated] (SPARK-38384) Improve error messages of ParseException from ANTLR

[ https://issues.apache.org/jira/browse/SPARK-38384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38384: - Epic Link: SPARK-38781 > Improve error messages of ParseException from ANTLR > -

[jira] [Updated] (SPARK-37935) Migrate onto error classes

[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37935: - Epic Link: SPARK-38781 > Migrate onto error classes > -- > > Key

[jira] [Updated] (SPARK-36094) Group SQL component error messages in Spark error class JSON file

[ https://issues.apache.org/jira/browse/SPARK-36094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36094: - Epic Link: SPARK-38781 > Group SQL component error messages in Spark error class JSON file > ---

[jira] [Created] (SPARK-38781) Improve errors of Spark SQL 3.3

Max Gekk created SPARK-38781: Summary: Improve errors of Spark SQL 3.3 Key: SPARK-38781 URL: https://issues.apache.org/jira/browse/SPARK-38781 Project: Spark Issue Type: Epic Components

[jira] [Commented] (SPARK-38780) PySpark docs build should fail when there is warning.

[ https://issues.apache.org/jira/browse/SPARK-38780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17516646#comment-17516646 ] Apache Spark commented on SPARK-38780: -- User 'itholic' has created a pull request f