[jira] [Created] (SPARK-33951) Distinguish the error between filter and distinct

2020-12-31 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33951: -- Summary: Distinguish the error between filter and distinct Key: SPARK-33951 URL: https://issues.apache.org/jira/browse/SPARK-33951 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte array

2020-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Summary: String functions: Trim/Ltrim/Rtrim support byte array (was: String functions:

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: String functions: Trim/Ltrim/Rtrim support byte arrays The mainstream database

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: String functions: Trim/Ltrim/Rtrim support byte arrays The mainstream database

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-31 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: String functions: Trim/Ltrim/Rtrim support byte arrays The mainstream database

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: https://docs.teradata.com/r/756LNiPSFdY~4JcCCcR5Cw/vd81iWAoGj0cEeGBMAfF9A The

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: The mainstream database support this feature show below: Teradata

[jira] [Updated] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33947: --- Description: The mainstream database support this feature show below: Teradata

[jira] [Created] (SPARK-33947) String functions: Trim/Ltrim/Rtrim support byte arrays

2020-12-30 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33947: -- Summary: String functions: Trim/Ltrim/Rtrim support byte arrays Key: SPARK-33947 URL: https://issues.apache.org/jira/browse/SPARK-33947 Project: Spark Issue

[jira] [Commented] (SPARK-33938) Optimize Like Any/All by LikeSimplification

2020-12-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256285#comment-17256285 ] jiaan.geng commented on SPARK-33938: I'm working on. > Optimize Like Any/All by LikeSimplification

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Description: All of LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE should support IGNORE NULLS |

[jira] [Updated] (SPARK-28123) String Functions: Add support btrim

2020-12-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28123: --- Affects Version/s: (was: 3.0.0) 3.2.0 > String Functions: Add support

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Support (IGNORE | RESPECT) NULLS

[jira] [Created] (SPARK-33890) Improve the implement of trim/trimleft/trimright

2020-12-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33890: -- Summary: Improve the implement of trim/trimleft/trimright Key: SPARK-33890 URL: https://issues.apache.org/jira/browse/SPARK-33890 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33866) Fix build error: Unused import CatalogV2Implicits

2020-12-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253951#comment-17253951 ] jiaan.geng commented on SPARK-33866: Sorry! This issue already solved. > Fix build error: Unused

[jira] [Resolved] (SPARK-33866) Fix build error: Unused import CatalogV2Implicits

2020-12-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-33866. Resolution: Won't Fix > Fix build error: Unused import CatalogV2Implicits >

[jira] [Commented] (SPARK-28123) String Functions: Add support btrim

2020-12-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253403#comment-17253403 ] jiaan.geng commented on SPARK-28123: I will do this work! > String Functions: Add support btrim >

[jira] [Commented] (SPARK-29591) Support data insertion in a different order if you wish or even omit some columns in spark sql also like postgresql

2020-12-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253395#comment-17253395 ] jiaan.geng commented on SPARK-29591: This ticket duplicate with SPARK-27462. I created a PR for this

[jira] [Commented] (SPARK-29699) Different answers in nested aggregates with window functions

2020-12-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253393#comment-17253393 ] jiaan.geng commented on SPARK-29699: The behavior of various mainstream databases is different, it

[jira] [Created] (SPARK-33866) Fix build error: Unused import CatalogV2Implicits

2020-12-21 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33866: -- Summary: Fix build error: Unused import CatalogV2Implicits Key: SPARK-33866 URL: https://issues.apache.org/jira/browse/SPARK-33866 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33541) Group exception messages in catalyst/expressions

2020-12-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252705#comment-17252705 ] jiaan.geng commented on SPARK-33541: I'm working on. > Group exception messages in

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Description: All of LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE support IGNORE NULLS | RESPECT

[jira] [Commented] (SPARK-33542) Group exception messages in catalyst/catalog

2020-12-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247818#comment-17247818 ] jiaan.geng commented on SPARK-33542: I'm working on. > Group exception messages in catalyst/catalog

[jira] [Updated] (SPARK-33752) Avoid the getSimpleMessage of AnalysisException adds semicolon repeatedly

2020-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33752: --- Summary: Avoid the getSimpleMessage of AnalysisException adds semicolon repeatedly (was: Avoid the

[jira] [Created] (SPARK-33752) Avoid the getSimpleMessage of AnalysisException add semicolon repeatedly

2020-12-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33752: -- Summary: Avoid the getSimpleMessage of AnalysisException add semicolon repeatedly Key: SPARK-33752 URL: https://issues.apache.org/jira/browse/SPARK-33752 Project: Spark

[jira] [Commented] (SPARK-33599) Group exception messages in catalyst/analysis

2020-12-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241330#comment-17241330 ] jiaan.geng commented on SPARK-33599: I'm working on. > Group exception messages in

[jira] [Updated] (SPARK-28325) Support ANSI SQL:SIMILAR TO ... ESCAPE syntax

2020-11-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28325: --- Description: {code:java} ::= ::= [ NOT ] SIMILAR TO [ ESCAPE ] ::= ::= | ::= |

[jira] [Created] (SPARK-33597) Support REGEXP_LIKE for consistent with mainstream databases

2020-11-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33597: -- Summary: Support REGEXP_LIKE for consistent with mainstream databases Key: SPARK-33597 URL: https://issues.apache.org/jira/browse/SPARK-33597 Project: Spark

[jira] [Updated] (SPARK-28325) Support ANSI SQL:SIMILAR TO ... ESCAPE syntax

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28325: --- Description: {code:java} ::= ::= [ NOT ] SIMILAR TO [ ESCAPE ] ::= ::= | ::= |

[jira] [Commented] (SPARK-28506) not handling usage of group function and window function at some conditions

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240505#comment-17240505 ] jiaan.geng commented on SPARK-28506: I runed the similar sql show below: {code:java} SELECT

[jira] [Comment Edited] (SPARK-29638) Spark handles 'NaN' as 0 in sums

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240498#comment-17240498 ] jiaan.geng edited comment on SPARK-29638 at 11/30/20, 6:18 AM: --- I runed

[jira] [Commented] (SPARK-29638) Spark handles 'NaN' as 0 in sums

2020-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240498#comment-17240498 ] jiaan.geng commented on SPARK-29638: {code:java} SELECT a, b, SUM(b) OVER(ORDER BY A ROWS

[jira] [Commented] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

2020-11-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239619#comment-17239619 ] jiaan.geng commented on SPARK-28646: I will take a look! > Allow usage of `count` only for

[jira] [Commented] (SPARK-28648) Adds support to `groups` unit type in window clauses

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238654#comment-17238654 ] jiaan.geng commented on SPARK-28648: it seems groups only exists in PgSQL > Adds support to

[jira] [Commented] (SPARK-28645) Throw an error on window redefinition

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238648#comment-17238648 ] jiaan.geng commented on SPARK-28645: I'm working on! > Throw an error on window redefinition >

[jira] [Resolved] (SPARK-28508) Support for range frame+row frame in the same query

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-28508. Resolution: Invalid > Support for range frame+row frame in the same query >

[jira] [Commented] (SPARK-28508) Support for range frame+row frame in the same query

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238638#comment-17238638 ] jiaan.geng commented on SPARK-28508: Spark has supported this feature. > Support for range

[jira] [Commented] (SPARK-28064) Order by does not accept a call to rank()

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238625#comment-17238625 ] jiaan.geng commented on SPARK-28064: Yeah! But it seems nothing useful. > Order by does not accept

[jira] [Commented] (SPARK-33429) Support drop column in spark also like in postgresql

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238615#comment-17238615 ] jiaan.geng commented on SPARK-33429: It seems Spark has supported {code:java} | ALTER TABLE

[jira] [Updated] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33527: --- Issue Type: New Feature (was: Bug) > Extend the function of decode so as consistent with

[jira] [Updated] (SPARK-33527) Extend the function of decode so as consistent with mainstream databases

2020-11-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33527: --- Summary: Extend the function of decode so as consistent with mainstream databases (was: Extend the

[jira] [Updated] (SPARK-33527) Extend the function of decode

2020-11-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33527: --- Description: In Spark, decode(bin, charset) - Decodes the first argument using the second argument

[jira] [Created] (SPARK-33527) Extend the function of decode

2020-11-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33527: -- Summary: Extend the function of decode Key: SPARK-33527 URL: https://issues.apache.org/jira/browse/SPARK-33527 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-11-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33443: --- Description: The current implement of LEAD/LAG don't support IGNORE/RESPECT NULLS, but the

[jira] [Commented] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-11-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231351#comment-17231351 ] jiaan.geng commented on SPARK-33443: I am working on. > LEAD/LAG should support [ IGNORE NULLS |

[jira] [Created] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-11-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33443: -- Summary: LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ] Key: SPARK-33443 URL: https://issues.apache.org/jira/browse/SPARK-33443 Project: Spark Issue

[jira] [Commented] (SPARK-30734) AnalysisException that window RangeFrame not match RowFrame

2020-11-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231198#comment-17231198 ] jiaan.geng commented on SPARK-30734: The fact is each mainstream database don't support specify

[jira] [Resolved] (SPARK-30734) AnalysisException that window RangeFrame not match RowFrame

2020-11-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-30734. Resolution: Won't Fix > AnalysisException that window RangeFrame not match RowFrame >

[jira] [Resolved] (SPARK-33186) Respect ANSI standard and change FIRST_VALUE as pure window function.

2020-11-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-33186. Resolution: Later > Respect ANSI standard and change FIRST_VALUE as pure window function. >

[jira] [Updated] (SPARK-33186) Respect ANSI standard and change FIRST_VALUE as pure window function.

2020-11-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33186: --- Description: FIRST_VALUE is an ANSI window function. But the current implement of FIRST_VALUE in

[jira] [Commented] (SPARK-33166) Provide Search Function in Spark docs site

2020-10-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223466#comment-17223466 ] jiaan.geng commented on SPARK-33166: I will take a look! > Provide Search Function in Spark docs

[jira] [Commented] (SPARK-33186) Respect ANSI standard and change FIRST_VALUE as pure window function.

2020-10-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222690#comment-17222690 ] jiaan.geng commented on SPARK-33186: Because this will lead to break change for first_value, we

[jira] [Updated] (SPARK-33278) Improve the performance for FIRST_VALUE

2020-10-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33278: --- Description: https://issues.apache.org/jira/browse/SPARK-32934 provides a performance improvement

[jira] [Updated] (SPARK-33278) Improve the performance for FIRST_VALUE

2020-10-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33278: --- Description: https://issues.apache.org/jira/browse/SPARK-32934 provides a performance improvement

[jira] [Updated] (SPARK-33278) Improve the performance for FIRST_VALUE

2020-10-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33278: --- Description: https://issues.apache.org/jira/browse/SPARK-32934 provides a performance improvement

[jira] [Created] (SPARK-33278) Improve the performance for FIRST_VALUE

2020-10-28 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33278: -- Summary: Improve the performance for FIRST_VALUE Key: SPARK-33278 URL: https://issues.apache.org/jira/browse/SPARK-33278 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33186) Respect ANSI standard and change FIRST_VALUE as pure window function.

2020-10-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33186: --- Description: FIRST_VALUE is an ANSI window function. But the current implement of FIRST_VALUE in

[jira] [Commented] (SPARK-33186) Respect ANSI standard and change FIRST_VALUE as pure window function.

2020-10-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217240#comment-17217240 ] jiaan.geng commented on SPARK-33186: I'm working on. > Respect ANSI standard and change FIRST_VALUE

[jira] [Created] (SPARK-33186) Respect ANSI standard and change FIRST_VALUE as pure window function.

2020-10-19 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33186: -- Summary: Respect ANSI standard and change FIRST_VALUE as pure window function. Key: SPARK-33186 URL: https://issues.apache.org/jira/browse/SPARK-33186 Project: Spark

[jira] [Updated] (SPARK-33126) Simplify offset window function(Remove direction field)

2020-10-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33126: --- Summary: Simplify offset window function(Remove direction field) (was: Improve offset window

[jira] [Created] (SPARK-33126) Improve offset window function(Remove direction field)

2020-10-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33126: -- Summary: Improve offset window function(Remove direction field) Key: SPARK-33126 URL: https://issues.apache.org/jira/browse/SPARK-33126 Project: Spark Issue

[jira] [Created] (SPARK-33125) Improve the error when Lead and Lag are not allowed to specify window frame

2020-10-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-33125: -- Summary: Improve the error when Lead and Lag are not allowed to specify window frame Key: SPARK-33125 URL: https://issues.apache.org/jira/browse/SPARK-33125 Project:

[jira] [Commented] (SPARK-33045) Implement built-in LIKE ANY and LIKE ALL UDF

2020-10-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211522#comment-17211522 ] jiaan.geng commented on SPARK-33045: I'm working on. > Implement built-in LIKE ANY and LIKE ALL UDF

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-09-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Summary: Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE (was:

[jira] [Comment Edited] (SPARK-31617) support drop multiple functions

2020-09-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203806#comment-17203806 ] jiaan.geng edited comment on SPARK-31617 at 9/29/20, 9:23 AM: -- It seems

[jira] [Commented] (SPARK-31617) support drop multiple functions

2020-09-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203806#comment-17203806 ] jiaan.geng commented on SPARK-31617: It seems deleting custom functions is a rare operation. So I

[jira] [Resolved] (SPARK-27640) Avoid duplicate lookups for datasource through provider

2020-09-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-27640. Resolution: Won't Fix > Avoid duplicate lookups for datasource through provider >

[jira] [Updated] (SPARK-30796) Add parameter position for REGEXP_REPLACE

2020-09-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30796: --- Description:   vertica REGEXP_REPLACE( _string_, _target_ [, _replacement_ [, _position_ [, 

[jira] [Updated] (SPARK-32934) Improve the performance for NTH_VALUE and Reactor the OffsetWindowFunction

2020-09-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32934: --- Description: Spark SQL support some window function like NTH_VALUE If we specify window frame like

[jira] [Updated] (SPARK-32934) Improve the performance for NTH_VALUE and Reactor the OffsetWindowFunction

2020-09-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32934: --- Summary: Improve the performance for NTH_VALUE and Reactor the OffsetWindowFunction (was: Improve

[jira] [Updated] (SPARK-32934) Improve the performance for NTH_VALUE,FIRST_VALUE,LAST_VALUE

2020-09-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32934: --- Summary: Improve the performance for NTH_VALUE,FIRST_VALUE,LAST_VALUE (was: Support a new window

[jira] [Created] (SPARK-32934) Support a new window frame could improve the performance for NTH_VALUE,FIRST_VALUE,LAST_VALUE

2020-09-18 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32934: -- Summary: Support a new window frame could improve the performance for NTH_VALUE,FIRST_VALUE,LAST_VALUE Key: SPARK-32934 URL: https://issues.apache.org/jira/browse/SPARK-32934

[jira] [Created] (SPARK-32875) TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the

2020-09-14 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32875: -- Summary: TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the Key: SPARK-32875 URL: https://issues.apache.org/jira/browse/SPARK-32875

[jira] [Updated] (SPARK-32875) TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract the general method.

2020-09-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32875: --- Summary: TaskSchedulerImplSuite: For the pattern of submitTasks + resourceOffers + assert, extract

[jira] [Updated] (SPARK-31848) DAGSchedulerSuite: Break down the very huge test files, each test suite should focus on one or several major features, but not all the related behaviors

2020-09-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31848: --- Summary: DAGSchedulerSuite: Break down the very huge test files, each test suite should focus on

[jira] [Updated] (SPARK-32777) Aggregation support aggregate function with multiple foldable expressions.

2020-09-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32777: --- Description: Spark SQL exists a bug show below: {code:java} spark.sql( " SELECT COUNT(DISTINCT

[jira] [Created] (SPARK-32777) Aggregation support aggregate function with multiple foldable expressions.

2020-09-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32777: -- Summary: Aggregation support aggregate function with multiple foldable expressions. Key: SPARK-32777 URL: https://issues.apache.org/jira/browse/SPARK-32777 Project:

[jira] [Updated] (SPARK-32777) Aggregation support aggregate function with multiple foldable expressions.

2020-09-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32777: --- Description: Spark SQL exists a bug show below: {code:java} spark.sql( " SELECT COUNT(DISTINCT

[jira] [Updated] (SPARK-32540) Eliminate filter clause in aggregate

2020-08-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32540: --- Summary: Eliminate filter clause in aggregate (was: Eliminate distinct that with filter clause) >

[jira] [Commented] (SPARK-32540) Eliminate distinct that with filter clause

2020-08-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171319#comment-17171319 ] jiaan.geng commented on SPARK-32540: I'm working on. > Eliminate distinct that with filter clause >

[jira] [Created] (SPARK-32540) Eliminate distinct that with filter clause

2020-08-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32540: -- Summary: Eliminate distinct that with filter clause Key: SPARK-32540 URL: https://issues.apache.org/jira/browse/SPARK-32540 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32365: --- Description: The current implement of regexp_extract will throws a unprocessed exception show

[jira] [Updated] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32365: --- Description: The current implement of regexp_extract will throws a unprocessed exception show

[jira] [Created] (SPARK-32365) Fix java.lang.IndexOutOfBoundsException: No group -1

2020-07-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-32365: -- Summary: Fix java.lang.IndexOutOfBoundsException: No group -1 Key: SPARK-32365 URL: https://issues.apache.org/jira/browse/SPARK-32365 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160854#comment-17160854 ] jiaan.geng commented on SPARK-32257: [~maropu]Thanks! > [SQL Parser] Report Error for invalid usage

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155175#comment-17155175 ] jiaan.geng commented on SPARK-32257: [~maropu] No problem. > [SQL Parser] Report Error for invalid

[jira] [Comment Edited] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155068#comment-17155068 ] jiaan.geng edited comment on SPARK-32257 at 7/10/20, 3:35 AM: --

[jira] [Commented] (SPARK-32257) [SQL Parser] Report Error for invalid usage of SET command

2020-07-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17155068#comment-17155068 ] jiaan.geng commented on SPARK-32257: [~smilegator]OK. Let me do it. > [SQL Parser] Report Error for

[jira] [Commented] (SPARK-31846) DAGSchedulerSuite: For the pattern of cancel + assert, extract the general method

2020-07-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149270#comment-17149270 ] jiaan.geng commented on SPARK-31846: According discussion between wuyi and me. It's not worth to do

[jira] [Commented] (SPARK-31844) DAGSchedulerSuite: For the pattern of failed + assert, extract the general method

2020-07-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149266#comment-17149266 ] jiaan.geng commented on SPARK-31844: According discussion between [~Ngone51] and me. It's not worth

[jira] [Commented] (SPARK-31842) DAGSchedulerSuite: For the pattern of runevent + assert, extract the general method

2020-07-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149265#comment-17149265 ] jiaan.geng commented on SPARK-31842: According discussion between [~Ngone51] and me. It's not worth

[jira] [Commented] (SPARK-31823) Improve the current Spark Scheduler test framework

2020-06-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17147224#comment-17147224 ] jiaan.geng commented on SPARK-31823: This ticket just used to improve test framework of Spark

[jira] [Updated] (SPARK-31845) DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure and support checkAnswer

2020-06-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31845: --- Description: DAGSchedulerSuite provides completeNextStageWithFetchFailure to make next stage

[jira] [Updated] (SPARK-31845) DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure and support checkAnswer

2020-06-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31845: --- Description: *First* DAGSchedulerSuite provides completeNextStageWithFetchFailure to make next

[jira] [Updated] (SPARK-31845) DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure and support checkAnswer

2020-06-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31845: --- Description: DAGSchedulerSuite provides completeNextStageWithFetchFailure to make next stage

[jira] [Updated] (SPARK-31845) DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure and support checkAnswer

2020-06-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31845: --- Summary: DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure and support checkAnswer (was:

[jira] [Updated] (SPARK-31845) DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure

2020-06-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31845: --- Summary: DAGSchedulerSuite: Reuse completeNextStageWithFetchFailure (was: DAGSchedulerSuite:

[jira] [Created] (SPARK-31847) DAGSchedulerSuite: Rewrite the test framework to cover most of the existing major features of the Spark Scheduler, mock the necessary part wisely, and make the test fram

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31847: -- Summary: DAGSchedulerSuite: Rewrite the test framework to cover most of the existing major features of the Spark Scheduler, mock the necessary part wisely, and make the test framework better extendable.

[jira] [Created] (SPARK-31848) Break down the very huge test files, each test suite should focus on one or several major features, but not all the related behaviors

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31848: -- Summary: Break down the very huge test files, each test suite should focus on one or several major features, but not all the related behaviors Key: SPARK-31848 URL:

[jira] [Created] (SPARK-31846) DAGSchedulerSuite: For the pattern of cancel + assert, extract the general method

2020-05-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31846: -- Summary: DAGSchedulerSuite: For the pattern of cancel + assert, extract the general method Key: SPARK-31846 URL: https://issues.apache.org/jira/browse/SPARK-31846

<    4   5   6   7   8   9   10   11   12   13   >