[jira] [Commented] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

2022-04-04 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517220#comment-17517220 ] Anish Shrigondekar commented on SPARK-38787: Working on the PR for this fix. Will send it

[jira] [Commented] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

2022-04-04 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517217#comment-17517217 ] Anish Shrigondekar commented on SPARK-38787: CC - [~kabhwan]  > Possible correctness issue

[jira] [Updated] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

2022-04-04 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-38787: --- Shepherd: (was: Jungtaek Lim) > Possible correctness issue on stream-stream join

[jira] [Created] (SPARK-38787) Possible correctness issue on stream-stream join when handling edge case

2022-04-04 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-38787: -- Summary: Possible correctness issue on stream-stream join when handling edge case Key: SPARK-38787 URL: https://issues.apache.org/jira/browse/SPARK-38787

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Epic Name: Error Message Improvements in Spark 3.3 (was: Improve errors of Spark 3.3) > Error Message

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Description: Get together all tickets related to improvements of error messages in Spark like migration

[jira] [Updated] (SPARK-38781) Error Message Improvements in Spark 3.3

2022-04-04 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-38781: Summary: Error Message Improvements in Spark 3.3 (was: Improve errors of Spark 3.3) > Error Message

[jira] [Commented] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517189#comment-17517189 ] Apache Spark commented on SPARK-38767: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38767: Assignee: Apache Spark > Support ignoreCorruptFiles and ignoreMissingFiles in Data

[jira] [Assigned] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38767: Assignee: (was: Apache Spark) > Support ignoreCorruptFiles and ignoreMissingFiles in

[jira] [Commented] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517188#comment-17517188 ] Apache Spark commented on SPARK-38767: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Commented] (SPARK-37377) Initial implementation of Storage-Partitioned Join

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517185#comment-17517185 ] Apache Spark commented on SPARK-37377: -- User 'sunchao' has created a pull request for this issue:

[jira] [Updated] (SPARK-37378) Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog

2022-04-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37378: - Fix Version/s: 3.4.0 > Convert V2 Transform expressions into catalyst expressions and load their >

[jira] [Resolved] (SPARK-37378) Convert V2 Transform expressions into catalyst expressions and load their associated functions from V2 FunctionCatalog

2022-04-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-37378. -- Resolution: Duplicate This JIRA is covered as part of SPARK-37377 > Convert V2 Transform expressions

[jira] [Updated] (SPARK-37377) Initial implementation of Storage-Partitioned Join

2022-04-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37377: - Description: This Jira tracks the initial implementation of storage-partitioned join. (was: Currently

[jira] [Updated] (SPARK-37377) Initial implementation of Storage-Partitioned Join

2022-04-04 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-37377: - Summary: Initial implementation of Storage-Partitioned Join (was: Refactor V2 Partitioning interface

[jira] [Resolved] (SPARK-37377) Refactor V2 Partitioning interface and remove deprecated usage of Distribution

2022-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37377. --- Fix Version/s: 3.4.0 Assignee: Chao Sun Resolution: Fixed This is resolved

[jira] [Reopened] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

2022-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-38664: --- > Support compact EventLog when there are illegal characters in the path >

[jira] [Resolved] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

2022-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38664. --- Resolution: Not A Problem > Support compact EventLog when there are illegal characters in

[jira] [Closed] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

2022-04-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-38664. - > Support compact EventLog when there are illegal characters in the path >

[jira] [Resolved] (SPARK-38664) Support compact EventLog when there are illegal characters in the path

2022-04-04 Thread w l (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] w l resolved SPARK-38664. - Resolution: Won't Fix > Support compact EventLog when there are illegal characters in the path >

[jira] [Resolved] (SPARK-38759) Add StreamingQueryListener support in PySpark

2022-04-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38759. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36038

[jira] [Assigned] (SPARK-38759) Add StreamingQueryListener support in PySpark

2022-04-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38759: Assignee: Hyukjin Kwon > Add StreamingQueryListener support in PySpark >

[jira] [Updated] (SPARK-38573) Support Auto Partition Statistics Collection

2022-04-04 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-38573: -- Summary: Support Auto Partition Statistics Collection (was: Support Auto Partition

[jira] [Created] (SPARK-38786) Test Bug in StatisticsSuite "change stats after add/drop partition command"

2022-04-04 Thread Kazuyuki Tanimura (Jira)
Kazuyuki Tanimura created SPARK-38786: - Summary: Test Bug in StatisticsSuite "change stats after add/drop partition command" Key: SPARK-38786 URL: https://issues.apache.org/jira/browse/SPARK-38786

[jira] [Commented] (SPARK-38573) Support Auto Partition Level Statistics Collection

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517163#comment-17517163 ] Apache Spark commented on SPARK-38573: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Assigned] (SPARK-38573) Support Auto Partition Level Statistics Collection

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38573: Assignee: (was: Apache Spark) > Support Auto Partition Level Statistics Collection >

[jira] [Assigned] (SPARK-38573) Support Auto Partition Level Statistics Collection

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38573: Assignee: Apache Spark > Support Auto Partition Level Statistics Collection >

[jira] [Updated] (SPARK-38573) Support Auto Partition Level Statistics Collection

2022-04-04 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-38573: -- Summary: Support Auto Partition Level Statistics Collection (was: Support Partition

[jira] [Updated] (SPARK-38573) Support Partition Level Statistics Collection

2022-04-04 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-38573: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Support Partition

[jira] [Assigned] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-04-04 Thread Ankur Dave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reassigned SPARK-38677: -- Assignee: Ankur Dave > pyspark hangs in local mode running rdd map operation >

[jira] [Commented] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517063#comment-17517063 ] Apache Spark commented on SPARK-38677: -- User 'ankurdave' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38677: Assignee: Apache Spark > pyspark hangs in local mode running rdd map operation >

[jira] [Assigned] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38677: Assignee: (was: Apache Spark) > pyspark hangs in local mode running rdd map

[jira] [Commented] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516862#comment-17516862 ] Apache Spark commented on SPARK-38108: -- User 'ivoson' has created a pull request for this issue:

[jira] [Commented] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516861#comment-17516861 ] Apache Spark commented on SPARK-38108: -- User 'ivoson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38108: Assignee: Apache Spark > Use error classes in the compilation errors of UDF/UDAF >

[jira] [Assigned] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38108: Assignee: (was: Apache Spark) > Use error classes in the compilation errors of

[jira] [Commented] (SPARK-38785) impl Series.ewm and DataFrame.ewm

2022-04-04 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516846#comment-17516846 ] zhengruifeng commented on SPARK-38785: -- h1. Pandas API on Spark:

[jira] [Assigned] (SPARK-38785) impl Series.ewm and DataFrame.ewm

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38785: Assignee: Apache Spark > impl Series.ewm and DataFrame.ewm >

[jira] [Commented] (SPARK-38785) impl Series.ewm and DataFrame.ewm

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516845#comment-17516845 ] Apache Spark commented on SPARK-38785: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-38785) impl Series.ewm and DataFrame.ewm

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38785: Assignee: (was: Apache Spark) > impl Series.ewm and DataFrame.ewm >

[jira] [Commented] (SPARK-38785) impl Series.ewm and DataFrame.ewm

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516844#comment-17516844 ] Apache Spark commented on SPARK-38785: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-38785) impl Series.ewm and DataFrame.ewm

2022-04-04 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-38785: Summary: impl Series.ewm and DataFrame.ewm Key: SPARK-38785 URL: https://issues.apache.org/jira/browse/SPARK-38785 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-38683) It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connectio

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516778#comment-17516778 ] Apache Spark commented on SPARK-38683: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Commented] (SPARK-38683) It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connectio

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516772#comment-17516772 ] Apache Spark commented on SPARK-38683: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Commented] (SPARK-38683) It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connectio

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516770#comment-17516770 ] Apache Spark commented on SPARK-38683: -- User 'weixiuli' has created a pull request for this issue:

[jira] [Updated] (SPARK-36660) Cotangent is not supported by Dataframe

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36660: - Epic Link: SPARK-38783 > Cotangent is not supported by Dataframe >

[jira] [Updated] (SPARK-36683) Support secant and cosecant

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36683: - Epic Link: SPARK-38783 > Support secant and cosecant > --- > >

[jira] [Updated] (SPARK-36963) Add max_by/min_by to sql.functions

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36963: - Epic Link: SPARK-38783 > Add max_by/min_by to sql.functions > -- > >

[jira] [Updated] (SPARK-37475) Add Scale Parameter to Floor and Ceil functions

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37475: - Epic Link: SPARK-38783 > Add Scale Parameter to Floor and Ceil functions >

[jira] [Updated] (SPARK-37047) Add overloads for lpad and rpad for BINARY strings

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37047: - Epic Link: SPARK-38783 > Add overloads for lpad and rpad for BINARY strings >

[jira] [Updated] (SPARK-37520) Add the startswith() and endswith() string functions

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37520: - Epic Link: SPARK-38783 > Add the startswith() and endswith() string functions >

[jira] [Updated] (SPARK-37508) Add CONTAINS() function

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37508: - Epic Link: SPARK-38783 > Add CONTAINS() function > --- > > Key:

[jira] [Updated] (SPARK-37507) Add the TO_BINARY() function

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37507: - Epic Link: SPARK-38783 > Add the TO_BINARY() function > > >

[jira] [Updated] (SPARK-35161) Error-handling SQL functions

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35161: - Epic Link: SPARK-38783 > Error-handling SQL functions > > >

[jira] [Updated] (SPARK-38345) Introduce SQL function ARRAY_SIZE

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38345: - Epic Link: SPARK-38783 > Introduce SQL function ARRAY_SIZE > - > >

[jira] [Updated] (SPARK-37671) Support ANSI Aggregation Function of regression

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37671: - Epic Link: SPARK-38783 > Support ANSI Aggregation Function of regression >

[jira] [Updated] (SPARK-37584) New SQL function: map_contains_key

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37584: - Epic Link: SPARK-38783 > New SQL function: map_contains_key > -- > >

[jira] [Updated] (SPARK-12567) Add aes_encrypt and aes_decrypt UDFs

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-12567: - Epic Link: SPARK-38783 > Add aes_encrypt and aes_decrypt UDFs > >

[jira] [Updated] (SPARK-36554) Error message while trying to use spark sql functions directly on dataframe columns without using select expression

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36554: - Epic Link: SPARK-38783 > Error message while trying to use spark sql functions directly on dataframe >

[jira] [Updated] (SPARK-37552) Add the convert_timezone() function

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37552: - Epic Link: SPARK-38783 > Add the convert_timezone() function > --- > >

[jira] [Updated] (SPARK-38332) Add the `DATEADD()` alias for `TIMESTAMPADD()`

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38332: - Epic Link: SPARK-38783 > Add the `DATEADD()` alias for `TIMESTAMPADD()` >

[jira] [Updated] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38389: - Epic Link: SPARK-38783 > Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()` >

[jira] [Created] (SPARK-38784) Upgrade Jetty to 9.4.45

2022-04-04 Thread Hari Prasad G (Jira)
Hari Prasad G created SPARK-38784: - Summary: Upgrade Jetty to 9.4.45 Key: SPARK-38784 URL: https://issues.apache.org/jira/browse/SPARK-38784 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38284) Add the TIMESTAMPDIFF() function

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38284: - Epic Link: SPARK-38783 > Add the TIMESTAMPDIFF() function > > >

[jira] [Updated] (SPARK-38195) Add the TIMESTAMPADD() function

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38195: - Epic Link: SPARK-38783 > Add the TIMESTAMPADD() function > --- > >

[jira] [Created] (SPARK-38783) New functions in Spark SQL 3.3

2022-04-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-38783: Summary: New functions in Spark SQL 3.3 Key: SPARK-38783 URL: https://issues.apache.org/jira/browse/SPARK-38783 Project: Spark Issue Type: Epic

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-33539: - Epic Link: SPARK-38781 > Standardize exception messages in Spark >

[jira] [Updated] (SPARK-38781) Improve errors of Spark 3.3

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Epic Name: Improve errors of Spark 3.3 (was: Improve errors of Spark SQL 3.3) > Improve errors of

[jira] [Updated] (SPARK-38781) Improve errors of Spark 3.3

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38781: - Summary: Improve errors of Spark 3.3 (was: Improve errors of Spark SQL 3.3) > Improve errors of Spark

[jira] [Resolved] (SPARK-38782) Use error classes in Spark Core 3.3

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38782. -- Resolution: Duplicate > Use error classes in Spark Core 3.3 > --- > >

[jira] [Updated] (SPARK-37935) Migrate onto error classes

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37935: - Component/s: Spark Core > Migrate onto error classes > -- > >

[jira] [Created] (SPARK-38782) Use error classes in Spark Core 3.3

2022-04-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-38782: Summary: Use error classes in Spark Core 3.3 Key: SPARK-38782 URL: https://issues.apache.org/jira/browse/SPARK-38782 Project: Spark Issue Type: Epic

[jira] [Resolved] (SPARK-38778) Replace http with https for project url in pom

2022-04-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38778. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36053

[jira] [Assigned] (SPARK-38778) Replace http with https for project url in pom

2022-04-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38778: --- Assignee: Kent Yao > Replace http with https for project url in pom >

[jira] [Updated] (SPARK-36870) Introduce INTERNAL_ERROR error class

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36870: - Epic Link: SPARK-38781 > Introduce INTERNAL_ERROR error class > >

[jira] [Updated] (SPARK-38384) Improve error messages of ParseException from ANTLR

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38384: - Epic Link: SPARK-38781 > Improve error messages of ParseException from ANTLR >

[jira] [Updated] (SPARK-37935) Migrate onto error classes

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37935: - Epic Link: SPARK-38781 > Migrate onto error classes > -- > >

[jira] [Updated] (SPARK-36094) Group SQL component error messages in Spark error class JSON file

2022-04-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36094: - Epic Link: SPARK-38781 > Group SQL component error messages in Spark error class JSON file >

[jira] [Created] (SPARK-38781) Improve errors of Spark SQL 3.3

2022-04-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-38781: Summary: Improve errors of Spark SQL 3.3 Key: SPARK-38781 URL: https://issues.apache.org/jira/browse/SPARK-38781 Project: Spark Issue Type: Epic

[jira] [Commented] (SPARK-38780) PySpark docs build should fail when there is warning.

2022-04-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516646#comment-17516646 ] Apache Spark commented on SPARK-38780: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38780) PySpark docs build should fail when there is warning.

2022-04-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38780: Assignee: Haejoon Lee > PySpark docs build should fail when there is warning. >

[jira] [Resolved] (SPARK-38780) PySpark docs build should fail when there is warning.

2022-04-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38780. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36058