[jira] [Updated] (SPARK-43944) Add string functions to Scala and Python - part 2

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43944: -- Description: Add following functions: * replace * rlike * split_part * substr * parse_url * p

[jira] [Updated] (SPARK-43944) Add string functions to Scala and Python - part 2

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43944: -- Description: Add following functions: * replace * rlike * split_part * substr * parse_url * p

[jira] [Updated] (SPARK-43924) Add misc functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43924: -- Description: Add following functions: * uuid * aes_encrypt * aes_decrypt * sha * input_file_b

[jira] [Updated] (SPARK-43943) Add math functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43943: -- Description: Add following functions: * ceiling * e * pi * ln * mod * negative * positive * p

[jira] [Updated] (SPARK-43944) Add string functions to Scala and Python - part 2

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43944: -- Description: Add following functions: * replace * rlike * split_part * substr * parse_url * p

[jira] [Updated] (SPARK-43937) Add not,if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Summary: Add not,if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python (was: Add

[jira] [Updated] (SPARK-43937) Add if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Description: Add following functions: * not * if * ifnull * isnotnull * equal_null * nullif *

[jira] [Updated] (SPARK-43941) Add any_value, approx_percentile,count_if,first_value,histogram_numeric,last_value to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43941: -- Description: Add following functions: * any_value * approx_percentile * count_if * first_valu

[jira] [Updated] (SPARK-43929) Add date time functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43929: -- Description: Add following functions: * date_diff * date_from_unix_date * date_part * dateadd

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Summary: Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Description: Add array_agg, array_size, cardinality, count_min_sketch Add following functions

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,json_* to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Summary: Add array_agg, array_size, cardinality, count_min_sketch,mask,json_* to Scala and Pyt

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,json_* to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Description: Add array_agg, array_size, cardinality, count_min_sketch Add following functions

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,json_* to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Summary: Add array_agg, array_size, cardinality, count_min_sketch,json_* to Scala and Python

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Description: Add array_agg, array_size, cardinality, count_min_sketch Add following functions

[jira] [Updated] (SPARK-43929) Add date time functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43929: -- Description: Add following functions: * date_diff * date_from_unix_date * date_part * dateadd

[jira] [Updated] (SPARK-43943) Add math functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43943: -- Description: Add following functions: * ceiling * e * pi * ln * mod * negative * positive * p

[jira] [Updated] (SPARK-43924) Add misc functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43924: -- Description: Add following functions: * uuid * aes_encrypt * aes_decrypt * sha * input_file_b

[jira] [Updated] (SPARK-43943) Add math functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43943: -- Description: Add following functions: * ceiling * e * pi * ln * mod * negative * positive * p

[jira] [Created] (SPARK-43944) Add string functions to Scala and Python - part 2

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43944: - Summary: Add string functions to Scala and Python - part 2 Key: SPARK-43944 URL: https://issues.apache.org/jira/browse/SPARK-43944 Project: Spark Issue Typ

[jira] [Updated] (SPARK-43942) Add string functions to Scala and Python - part 1

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43942: -- Summary: Add string functions to Scala and Python - part 1 (was: Add string functions to Scal

[jira] [Updated] (SPARK-43943) Add math functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43943: -- Description: Add following functions: * ceiling * e * pi * ln * mod * negative * positive * p

[jira] [Updated] (SPARK-43943) Add math functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43943: -- Description: Add following functions: * ceiling * e * pi * ln * mod * negative * positive to

[jira] [Updated] (SPARK-43942) Add string functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43942: -- Description: Add following functions: * char * btrim * char_length * character_length * chr *

[jira] [Updated] (SPARK-43942) Add string functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43942: -- Description: Add following functions: * char * btrim * char_length * character_length * chr *

[jira] [Updated] (SPARK-43941) Add any_value, approx_percentile,count_if,first_value,histogram_numeric,last_value to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43941: -- Summary: Add any_value, approx_percentile,count_if,first_value,histogram_numeric,last_value to

[jira] [Updated] (SPARK-43941) Add any_value, approx_percentile,count_if,first_value,histogram_numeric to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43941: -- Description: Add following functions: * any_value * approx_percentile * count_if * first_valu

[jira] [Updated] (SPARK-43941) Add any_value, approx_percentile,count_if,first_value,histogram_numeric to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43941: -- Summary: Add any_value, approx_percentile,count_if,first_value,histogram_numeric to Scala and

[jira] [Updated] (SPARK-43941) Add any_value, approx_percentile,count_if to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43941: -- Description: Add following functions: * any_value * approx_percentile * count_if * first_valu

[jira] [Updated] (SPARK-43941) Add any_value, approx_percentile,count_if to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43941: -- Description: Add following functions: * any_value * approx_percentile * count_if * first_valu

[jira] [Created] (SPARK-43943) Add math functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43943: - Summary: Add math functions to Scala and Python Key: SPARK-43943 URL: https://issues.apache.org/jira/browse/SPARK-43943 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43942) Add string functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43942: - Summary: Add string functions to Scala and Python Key: SPARK-43942 URL: https://issues.apache.org/jira/browse/SPARK-43942 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-43941) Add any_value, approx_percentile,count_if to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43941: - Summary: Add any_value, approx_percentile,count_if to Scala and Python Key: SPARK-43941 URL: https://issues.apache.org/jira/browse/SPARK-43941 Project: Spark

[jira] [Updated] (SPARK-43929) Add date time functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43929: -- Description: Add following functions: * date_diff * date_from_unix_date * date_part * dateadd

[jira] [Updated] (SPARK-43929) Add date time functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43929: -- Description: Add following functions: * date_diff * date_from_unix_date * date_part * dateadd

[jira] [Resolved] (SPARK-43936) Fix bug for toSQLId

2023-06-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43936. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41430 [https://github.com

[jira] [Assigned] (SPARK-43936) Fix bug for toSQLId

2023-06-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43936: Assignee: BingKun Pan > Fix bug for toSQLId > --- > > Key: SPARK-

[jira] [Created] (SPARK-43939) Add try_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43939: - Summary: Add try_* functions to Scala and Python Key: SPARK-43939 URL: https://issues.apache.org/jira/browse/SPARK-43939 Project: Spark Issue Type: Sub-tas

[jira] [Created] (SPARK-43940) Write test for CANNOT_FIND_BATCH (Prev _LEGACY_ERROR_TEMP_2132)

2023-06-01 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-43940: -- Summary: Write test for CANNOT_FIND_BATCH (Prev _LEGACY_ERROR_TEMP_2132) Key: SPARK-43940 URL: https://issues.apache.org/jira/browse/SPARK-43940 Project: Spark

[jira] [Updated] (SPARK-43935) Add xpath_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43935: -- Description: Add following functions: * xpath * xpath_boolean * xpath_double * xpath_float *

[jira] [Updated] (SPARK-43935) Add xpath_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43935: -- Environment: (was: Add following functions: * xpath * xpath_boolean * xpath_double * xpath

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Summary: Add array_agg, array_size, cardinality, count_min_sketch to Scala and Python (was: A

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Description: Add array_agg, array_size, cardinality, count_min_sketch to: * Scala API * Py

[jira] [Updated] (SPARK-43925) Add any, some, bool_or,bool_and,every to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43925: -- Description: Add following functions: * any * some * bool_or * bool_and * every to: * Scala

[jira] [Commented] (SPARK-43936) Fix bug for toSQLId

2023-06-01 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728557#comment-17728557 ] Snoot.io commented on SPARK-43936: -- User 'panbingkun' has created a pull request for th

[jira] [Updated] (SPARK-43937) Add if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Description: Add following functions: * if * ifnull * isnotnull * nullif * nvl * nvl2 to: *

[jira] [Updated] (SPARK-43937) Add if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Description: Add following functions: * if * ifnull * isnotnull * equal_null * nullif * nvl *

[jira] [Updated] (SPARK-43937) Add if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Summary: Add if,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python (was: Add if,

[jira] [Updated] (SPARK-43924) Add misc functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43924: -- Description: Add following functions: * uuid * aes_encrypt * aes_decrypt * sha * input_file_b

[jira] [Updated] (SPARK-43924) Add misc functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43924: -- Summary: Add misc functions to Scala and Python (was: Add aes_decrypt, aes_encrypt to Scala a

[jira] [Created] (SPARK-43938) Add to_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43938: - Summary: Add to_* functions to Scala and Python Key: SPARK-43938 URL: https://issues.apache.org/jira/browse/SPARK-43938 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43937) Add if,ifnull,nullif,nvl,nvl2 to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43937: - Summary: Add if,ifnull,nullif,nvl,nvl2 to Scala and Python Key: SPARK-43937 URL: https://issues.apache.org/jira/browse/SPARK-43937 Project: Spark Issue Typ

[jira] [Commented] (SPARK-43297) Make improvement to LocalKMeans

2023-06-01 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728553#comment-17728553 ] Snoot.io commented on SPARK-43297: -- User 'wenwj0' has created a pull request for this i

[jira] [Commented] (SPARK-43936) Fix bug for toSQLId

2023-06-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728540#comment-17728540 ] BingKun Pan commented on SPARK-43936: - h4. Hi,[~maxgekk]  Do you have time to help

[jira] [Updated] (SPARK-43936) Fix bug for toSQLId

2023-06-01 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43936: Description: After SPARK-43910, {{__auto_generated_subquery_name}} from ids in errors should remov

[jira] [Updated] (SPARK-43925) Add any, some, bool_or,bool_and,every to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43925: -- Description: Add following functions: * any * some * bool_or * bool_and * bit_xor * every to

[jira] [Created] (SPARK-43936) Fix bug for toSQLId

2023-06-01 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-43936: --- Summary: Fix bug for toSQLId Key: SPARK-43936 URL: https://issues.apache.org/jira/browse/SPARK-43936 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-43925) Add any, some, bool_or,bool_and,every to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43925: -- Summary: Add any, some, bool_or,bool_and,every to Scala and Python (was: Add any, some, bool_

[jira] [Created] (SPARK-43935) Add xpath_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43935: - Summary: Add xpath_* functions to Scala and Python Key: SPARK-43935 URL: https://issues.apache.org/jira/browse/SPARK-43935 Project: Spark Issue Type: Sub-t

[jira] [Assigned] (SPARK-43368) Address DOI comments about /etc/passwd

2023-06-01 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-43368: --- Assignee: Yikun Jiang > Address DOI comments about /etc/passwd > --

[jira] [Resolved] (SPARK-43368) Address DOI comments about /etc/passwd

2023-06-01 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-43368. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 45 [https://github.

[jira] [Created] (SPARK-43934) Add regexp_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43934: - Summary: Add regexp_* functions to Scala and Python Key: SPARK-43934 URL: https://issues.apache.org/jira/browse/SPARK-43934 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-43933) Add regr_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43933: - Summary: Add regr_* functions to Scala and Python Key: SPARK-43933 URL: https://issues.apache.org/jira/browse/SPARK-43933 Project: Spark Issue Type: Sub-ta

[jira] [Resolved] (SPARK-43267) Support creating data frame from a Postgres table that contains user-defined array column

2023-06-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-43267. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40953 [https://github.com

[jira] [Assigned] (SPARK-43267) Support creating data frame from a Postgres table that contains user-defined array column

2023-06-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-43267: Assignee: Jia Fan > Support creating data frame from a Postgres table that contains user-defined

[jira] [Updated] (SPARK-43932) Add current_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43932: -- Description: Add following functions: * curdate * current_catalog * current_database * curren

[jira] [Created] (SPARK-43932) Add current_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43932: - Summary: Add current_* functions to Scala and Python Key: SPARK-43932 URL: https://issues.apache.org/jira/browse/SPARK-43932 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-43931) Add make_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43931: - Summary: Add make_* functions to Scala and Python Key: SPARK-43931 URL: https://issues.apache.org/jira/browse/SPARK-43931 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Summary: Add array_agg, array_size, cardinality to Scala and Python (was: Add array_agg, arra

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Description: Add array_agg, array_size, cardinality to: * Scala API * Python API * Spark Con

[jira] [Updated] (SPARK-43926) Add array_agg, array_size, cardinality to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43926: -- Description: Add array_agg, array_size, to: * Scala API * Python API * Spark Connect Scala C

[jira] [Created] (SPARK-43930) Add unix_* functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43930: - Summary: Add unix_* functions to Scala and Python Key: SPARK-43930 URL: https://issues.apache.org/jira/browse/SPARK-43930 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-43928) Add bit operations to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43928: -- Description: Add following functions: * bit_and * bit_count * bit_get * bit_or * bit_xor * get

[jira] [Created] (SPARK-43929) Add date time functions to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43929: - Summary: Add date time functions to Scala and Python Key: SPARK-43929 URL: https://issues.apache.org/jira/browse/SPARK-43929 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-43928) Add bit operations to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43928: - Summary: Add bit operations to Scala and Python Key: SPARK-43928 URL: https://issues.apache.org/jira/browse/SPARK-43928 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43927) Add cast alias to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43927: - Summary: Add cast alias to Scala and Python Key: SPARK-43927 URL: https://issues.apache.org/jira/browse/SPARK-43927 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-43926) Add array_agg, array_size to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43926: - Summary: Add array_agg, array_size to Scala and Python Key: SPARK-43926 URL: https://issues.apache.org/jira/browse/SPARK-43926 Project: Spark Issue Type: S

[jira] [Created] (SPARK-43925) Add any, some, bool_or to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43925: - Summary: Add any, some, bool_or to Scala and Python Key: SPARK-43925 URL: https://issues.apache.org/jira/browse/SPARK-43925 Project: Spark Issue Type: Sub-

[jira] [Created] (SPARK-43924) Add aes_decrypt, aes_encrypt to Scala and Python

2023-06-01 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-43924: - Summary: Add aes_decrypt, aes_encrypt to Scala and Python Key: SPARK-43924 URL: https://issues.apache.org/jira/browse/SPARK-43924 Project: Spark Issue Type

[jira] [Updated] (SPARK-43923) [CONNECT] Post listenerBus events during ExecutePlanRequest

2023-06-01 Thread Jean-Francois Desjeans Gauthier (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francois Desjeans Gauthier updated SPARK-43923: Summary: [CONNECT] Post listenerBus events during ExecutePl

[jira] [Commented] (SPARK-43907) Add SQL functions into Scala, Python and R API

2023-06-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728519#comment-17728519 ] Hyukjin Kwon commented on SPARK-43907: -- Yes, please go ahead. But I think we should

[jira] [Resolved] (SPARK-43892) Add support for df[|] suggest column

2023-06-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43892. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41396 [https://gi

[jira] [Assigned] (SPARK-43892) Add support for df[|] suggest column

2023-06-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43892: Assignee: Beishao Cao > Add support for df[|] suggest column > --

[jira] [Updated] (SPARK-43923) [Connect] Post listenerBus events during ExecutePlanRequest

2023-06-01 Thread Jean-Francois Desjeans Gauthier (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Francois Desjeans Gauthier updated SPARK-43923: Description: Post events SparkListenerConnectOperationStar

[jira] [Created] (SPARK-43923) [Connect] Post listenerBus events during ExecutePlanRequest

2023-06-01 Thread Jean-Francois Desjeans Gauthier (Jira)
Jean-Francois Desjeans Gauthier created SPARK-43923: --- Summary: [Connect] Post listenerBus events during ExecutePlanRequest Key: SPARK-43923 URL: https://issues.apache.org/jira/browse/SPARK-43923

[jira] [Updated] (SPARK-43922) Add named parameter support in parser for function call

2023-06-01 Thread Richard Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Description: Today, we are implementing named parameter support for user defined functions, some bu

[jira] [Updated] (SPARK-43922) Add named parameter support in parser for function call

2023-06-01 Thread Richard Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-43922: --- Description: Today, we are implementing named parameter support for user defined functions, some bu

[jira] [Created] (SPARK-43922) Add named parameter support in parser for function call

2023-06-01 Thread Richard Yu (Jira)
Richard Yu created SPARK-43922: -- Summary: Add named parameter support in parser for function call Key: SPARK-43922 URL: https://issues.apache.org/jira/browse/SPARK-43922 Project: Spark Issue Typ

[jira] [Created] (SPARK-43921) Generate Protobuf descriptor files at build time

2023-06-01 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-43921: Summary: Generate Protobuf descriptor files at build time Key: SPARK-43921 URL: https://issues.apache.org/jira/browse/SPARK-43921 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43920) Create sql/api module

2023-06-01 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43920: - Description: We need a sql/api module to host public API like DataType, Row, etc. This module can be sha

[jira] [Created] (SPARK-43920) Create sql/api module

2023-06-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-43920: Summary: Create sql/api module Key: SPARK-43920 URL: https://issues.apache.org/jira/browse/SPARK-43920 Project: Spark Issue Type: Task Components: Connect,

[jira] [Commented] (SPARK-41958) Disallow arbitrary custom classpath with proxy user in cluster mode

2023-06-01 Thread Degant Puri (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728449#comment-17728449 ] Degant Puri commented on SPARK-41958: - [~gurwls223] [~Ngone51] is it possible to bac

[jira] [Updated] (SPARK-43919) Extract JSON functionality out of Row

2023-06-01 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-43919: - Summary: Extract JSON functionality out of Row (was: Extract JSON functionality to Row) > Extract JSO

[jira] [Created] (SPARK-43919) Extract JSON functionality to Row

2023-06-01 Thread Rui Wang (Jira)
Rui Wang created SPARK-43919: Summary: Extract JSON functionality to Row Key: SPARK-43919 URL: https://issues.apache.org/jira/browse/SPARK-43919 Project: Spark Issue Type: Task Componen

[jira] [Resolved] (SPARK-43902) Use keyMayExist to avoid gets if key is absent for tracking rocksdb state store updates

2023-06-01 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar resolved SPARK-43902. Resolution: Won't Do > Use keyMayExist to avoid gets if key is absent for tracking

[jira] [Created] (SPARK-43918) Cannot CREATE VIEW despite columns explicitly aliased

2023-06-01 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-43918: Summary: Cannot CREATE VIEW despite columns explicitly aliased Key: SPARK-43918 URL: https://issues.apache.org/jira/browse/SPARK-43918 Project: Spark Issue

[jira] [Resolved] (SPARK-43899) Upgrade protobuf-java to 3.23.2

2023-06-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43899. --- Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed This is resolved v

[jira] [Created] (SPARK-43917) Upgrade pandas to 2.0.2

2023-06-01 Thread Jira
Bjørn Jørgensen created SPARK-43917: --- Summary: Upgrade pandas to 2.0.2 Key: SPARK-43917 URL: https://issues.apache.org/jira/browse/SPARK-43917 Project: Spark Issue Type: Dependency upgrade

[jira] [Commented] (SPARK-43910) Strip "__auto_generated_subquery_name" from ids in errors

2023-06-01 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728405#comment-17728405 ] Hudson commented on SPARK-43910: User 'MaxGekk' has created a pull request for this issu

[jira] [Commented] (SPARK-43916) Add percentile to Scala, Python and R API

2023-06-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17728345#comment-17728345 ] jiaan.geng commented on SPARK-43916: Because I involved in the development of percen

  1   2   >