[jira] [Updated] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Description: Currently, Spark supports aggregate push down SUM(column) into JDBC data source.

[jira] [Updated] (SPARK-37960) Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Summary: Support aggregate push down SUM(CASE ... WHEN ... ELSE ... END) (was: Support complete

[jira] [Created] (SPARK-37960) Support complete push down SUM(CASE ... WHEN ... ELSE ... END)

2022-01-19 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37960: -- Summary: Support complete push down SUM(CASE ... WHEN ... ELSE ... END) Key: SPARK-37960 URL: https://issues.apache.org/jira/browse/SPARK-37960 Project: Spark

[jira] [Updated] (SPARK-37953) Improve the implement of UnevaluableAggregate

2022-01-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37953: --- Description: Currently, Spark provides UnevaluableAggregate to replace function with another

[jira] [Updated] (SPARK-37953) Improve the implement of UnevaluableAggregate

2022-01-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37953: --- Description: Currently, Spark provides RuntimeReplaceable to replace function with another

[jira] [Created] (SPARK-37953) Improve the implement of UnevaluableAggregate

2022-01-18 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37953: -- Summary: Improve the implement of UnevaluableAggregate Key: SPARK-37953 URL: https://issues.apache.org/jira/browse/SPARK-37953 Project: Spark Issue Type:

[jira] [Created] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-01-14 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37914: -- Summary: Make RuntimeReplaceable works for AggregateFunction Key: SPARK-37914 URL: https://issues.apache.org/jira/browse/SPARK-37914 Project: Spark Issue Type:

[jira] [Created] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

2022-01-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37867: -- Summary: Compile aggregate functions of build-in JDBC dialect Key: SPARK-37867 URL: https://issues.apache.org/jira/browse/SPARK-37867 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

2022-01-07 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37839: --- Description: Currently, DS V2 supports complete aggregate push-down AVG. But, supports partial

[jira] [Updated] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

2022-01-07 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37839: --- Summary: DS V2 supports partial aggregate push-down AVG (was: DS V2 supports partial aggregate

[jira] [Created] (SPARK-37839) DS V2 supports partial aggregate push-down for AVG

2022-01-07 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37839: -- Summary: DS V2 supports partial aggregate push-down for AVG Key: SPARK-37839 URL: https://issues.apache.org/jira/browse/SPARK-37839 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char`

2021-12-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466824#comment-17466824 ] jiaan.geng commented on SPARK-28516: I'm working on. > Data Type Formatting Functions: `to_char` >

[jira] [Commented] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17465971#comment-17465971 ] jiaan.geng commented on SPARK-37691: [~subkanthi] I'm sorry! I'm working on it. > Support ANSI

[jira] [Created] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202

2021-12-24 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37734: -- Summary: Upgrade h2 from 1.4.195 to 2.0.202 Key: SPARK-37734 URL: https://issues.apache.org/jira/browse/SPARK-37734 Project: Spark Issue Type: Dependency

[jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite

2021-12-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37732: --- Description: When I reading the implement of JDBCV2Suite, I find we can improve the code. (was:

[jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite

2021-12-23 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37732: --- Description: When I read the > Improve the implement of JDBCV2Suite >

[jira] [Created] (SPARK-37732) Improve the implement of JDBCV2Suite

2021-12-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37732: -- Summary: Improve the implement of JDBCV2Suite Key: SPARK-37732 URL: https://issues.apache.org/jira/browse/SPARK-37732 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses int64

2021-12-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses int64 (was: Read/Write Timestamp ntz from/to

[jira] [Commented] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463048#comment-17463048 ] jiaan.geng commented on SPARK-37702: I'm working on. > Support ANSI Aggregate Function: regr_syy >

[jira] [Created] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2021-12-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37702: -- Summary: Support ANSI Aggregate Function: regr_syy Key: SPARK-37702 URL: https://issues.apache.org/jira/browse/SPARK-37702 Project: Spark Issue Type: Sub-task

[jira] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681 ] jiaan.geng deleted comment on SPARK-37681: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_sxy > - > >

[jira] [Updated] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37691: --- Description: PERCENTILE_DISC is an ANSI aggregate function. many database support it. > Support

[jira] [Created] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37691: -- Summary: Support ANSI Aggregation Function: percentile_disc Key: SPARK-37691 URL: https://issues.apache.org/jira/browse/SPARK-37691 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461806#comment-17461806 ] jiaan.geng commented on SPARK-37681: I'm working on. > Support ANSI Aggregate Function: regr_sxy >

[jira] [Created] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-17 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37681: -- Summary: Support ANSI Aggregate Function: regr_sxy Key: SPARK-37681 URL: https://issues.apache.org/jira/browse/SPARK-37681 Project: Spark Issue Type: Sub-task

[jira] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx

2021-12-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37672 ] jiaan.geng deleted comment on SPARK-37672: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_sxx > - > >

[jira] [Updated] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont

2021-12-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37676: --- Description: PERCENTILE_CONT is an ANSI aggregate function. many database support it. (was:

[jira] [Created] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont

2021-12-17 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37676: -- Summary: Support ANSI Aggregation Function: percentile_cont Key: SPARK-37676 URL: https://issues.apache.org/jira/browse/SPARK-37676 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx

2021-12-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461204#comment-17461204 ] jiaan.geng commented on SPARK-37672: I'm working on. > Support ANSI Aggregate Function: regr_sxx >

[jira] [Created] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx

2021-12-16 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37672: -- Summary: Support ANSI Aggregate Function: regr_sxx Key: SPARK-37672 URL: https://issues.apache.org/jira/browse/SPARK-37672 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

2021-12-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37641: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept

2021-12-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37623: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy

2021-12-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37614: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Updated] (SPARK-37613) Support ANSI Aggregate Function: regr_count

2021-12-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37613: --- Parent: SPARK-37671 Issue Type: Sub-task (was: New Feature) > Support ANSI Aggregate

[jira] [Created] (SPARK-37671) Support ANSI Aggregation Function of regression

2021-12-16 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37671: -- Summary: Support ANSI Aggregation Function of regression Key: SPARK-37671 URL: https://issues.apache.org/jira/browse/SPARK-37671 Project: Spark Issue Type: New

[jira] (SPARK-37644) Support datasource v2 complete aggregate pushdown

2021-12-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37644 ] jiaan.geng deleted comment on SPARK-37644: was (Author: beliefer): I'm working on. > Support datasource v2 complete aggregate pushdown > --

[jira] [Commented] (SPARK-37644) Support datasource v2 complete aggregate pushdown

2021-12-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459117#comment-17459117 ] jiaan.geng commented on SPARK-37644: I'm working on. > Support datasource v2 complete aggregate

[jira] [Created] (SPARK-37644) Support datasource v2 complete aggregate pushdown

2021-12-14 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37644: -- Summary: Support datasource v2 complete aggregate pushdown Key: SPARK-37644 URL: https://issues.apache.org/jira/browse/SPARK-37644 Project: Spark Issue Type:

[jira] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

2021-12-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37641 ] jiaan.geng deleted comment on SPARK-37641: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_r2 > > >

[jira] [Commented] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

2021-12-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458968#comment-17458968 ] jiaan.geng commented on SPARK-37641: I'm working on. > Support ANSI Aggregate Function: regr_r2 >

[jira] [Updated] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

2021-12-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37641: --- Description: REGR_R2 is an ANSI aggregate function. many database support it. > Support ANSI

[jira] [Created] (SPARK-37641) Support ANSI Aggregate Function: regr_r2

2021-12-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37641: -- Summary: Support ANSI Aggregate Function: regr_r2 Key: SPARK-37641 URL: https://issues.apache.org/jira/browse/SPARK-37641 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-37518) inject an early scan pushdown rule

2021-12-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37518: --- Summary: inject an early scan pushdown rule (was: inject a early scan pushdown rule) > inject an

[jira] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept

2021-12-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37623 ] jiaan.geng deleted comment on SPARK-37623: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_slope & regr_intercept >

[jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept

2021-12-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37623: --- Summary: Support ANSI Aggregate Function: regr_slope & regr_intercept (was: Support ANSI Aggregate

[jira] [Commented] (SPARK-37623) Support ANSI Aggregate Function: regr_slope

2021-12-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458132#comment-17458132 ] jiaan.geng commented on SPARK-37623: I'm working on. > Support ANSI Aggregate Function: regr_slope

[jira] [Created] (SPARK-37623) Support ANSI Aggregate Function: regr_slope

2021-12-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37623: -- Summary: Support ANSI Aggregate Function: regr_slope Key: SPARK-37623 URL: https://issues.apache.org/jira/browse/SPARK-37623 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope

2021-12-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37623: --- Description: REGR_SLOPE is an ANSI aggregate functions. many database support it. > Support ANSI

[jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy

2021-12-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37614: --- Summary: Support ANSI Aggregate Function: regr_avgx & regr_avgy (was: Support ANSI Aggregate

[jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy

2021-12-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37614: --- Description: REGR_AVGX and REGR_AVGY are ANSI aggregate functions. many database support it. (was:

[jira] [Created] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx

2021-12-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37614: -- Summary: Support ANSI Aggregate Function: regr_avgx Key: SPARK-37614 URL: https://issues.apache.org/jira/browse/SPARK-37614 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx

2021-12-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37614: --- Description: REGR_AVGX is an ANSI aggregate function. many database support it. > Support ANSI

[jira] (SPARK-27974) Support ANSI Aggregate Function: array_agg

2021-12-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974 ] jiaan.geng deleted comment on SPARK-27974: was (Author: beliefer): I will take a look! > Support ANSI Aggregate Function: array_agg > -- > >

[jira] [Created] (SPARK-37613) Support ANSI Aggregate Function: regr_count

2021-12-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37613: -- Summary: Support ANSI Aggregate Function: regr_count Key: SPARK-37613 URL: https://issues.apache.org/jira/browse/SPARK-37613 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-37612) Support window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW

2021-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37612: --- Summary: Support window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND

[jira] [Created] (SPARK-37612) Support PostgreSql window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW

2021-12-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37612: -- Summary: Support PostgreSql window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW Key: SPARK-37612 URL:

[jira] [Updated] (SPARK-27974) Support ANSI Aggregate Function: array_agg

2021-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-27974: --- Summary: Support ANSI Aggregate Function: array_agg (was: Add built-in Aggregate Function:

[jira] [Commented] (SPARK-27974) Add built-in Aggregate Function: array_agg

2021-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457522#comment-17457522 ] jiaan.geng commented on SPARK-27974: I will take a look! > Add built-in Aggregate Function:

[jira] [Updated] (SPARK-37592) Improve performance of JoinSelection

2021-12-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37592: --- Summary: Improve performance of JoinSelection (was: Improve performance for JoinSelection) >

[jira] [Created] (SPARK-37592) Improve performance for JoinSelection

2021-12-08 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37592: -- Summary: Improve performance for JoinSelection Key: SPARK-37592 URL: https://issues.apache.org/jira/browse/SPARK-37592 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-37589) Improve the performance of PlanParserSuite

2021-12-08 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37589: -- Summary: Improve the performance of PlanParserSuite Key: SPARK-37589 URL: https://issues.apache.org/jira/browse/SPARK-37589 Project: Spark Issue Type:

[jira] (SPARK-37527) Translate more standard aggregate functions for pushdown

2021-12-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37527 ] jiaan.geng deleted comment on SPARK-37527: was (Author: beliefer): I'm working on. > Translate more standard aggregate functions for pushdown >

[jira] [Commented] (SPARK-37527) Translate more standard aggregate functions for pushdown

2021-12-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452721#comment-17452721 ] jiaan.geng commented on SPARK-37527: I'm working on. > Translate more standard aggregate functions

[jira] [Created] (SPARK-37527) Translate more standard aggregate functions for pushdown

2021-12-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37527: -- Summary: Translate more standard aggregate functions for pushdown Key: SPARK-37527 URL: https://issues.apache.org/jira/browse/SPARK-37527 Project: Spark Issue

[jira] [Updated] (SPARK-37518) inject a early scan pushdown rule

2021-12-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37518: --- Summary: inject a early scan pushdown rule (was: inject a early scan push down rule) > inject a

[jira] [Updated] (SPARK-37518) inject a early scan push down rule

2021-12-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37518: --- Description: Currently, Spark supports push down filters, aggregates and limit. All the job is

[jira] [Created] (SPARK-37518) inject a early scan push down rule

2021-12-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37518: -- Summary: inject a early scan push down rule Key: SPARK-37518 URL: https://issues.apache.org/jira/browse/SPARK-37518 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect

2021-12-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37286: --- Description: Currently, the method compileAggregates in JDBCRDD. But it is not reasonable, because

[jira] [Updated] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect

2021-12-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37286: --- Summary: Move compileAggregates from JDBCRDD to JdbcDialect (was: Move compileFilter and

[jira] [Updated] (SPARK-37513) date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1

2021-11-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37513: --- Summary: date +/- interval with only day-time fields returns different data type between Spark3.2

[jira] [Updated] (SPARK-37513) Additive expression of date and interval returns different data type between Spark3.2 and Spark3.1

2021-11-30 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37513: --- Summary: Additive expression of date and interval returns different data type between Spark3.2 and

[jira] [Created] (SPARK-37513) additive expression of date and interval returns different data type between Spark3.2 and Spark3.1

2021-11-30 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37513: -- Summary: additive expression of date and interval returns different data type between Spark3.2 and Spark3.1 Key: SPARK-37513 URL: https://issues.apache.org/jira/browse/SPARK-37513

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

2021-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Summary: Support push down top N to JDBC data source V2 (was: Support pushdown down top N to JDBC

[jira] [Created] (SPARK-37492) Optimize Orc test code with withAllNativeOrcReaders

2021-11-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37492: -- Summary: Optimize Orc test code with withAllNativeOrcReaders Key: SPARK-37492 URL: https://issues.apache.org/jira/browse/SPARK-37492 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC timestamp

2021-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses UTC timestamp (was: Read/Write Timestamp ntz to

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone

2021-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz from/to Orc uses UTC time zone (was: Read/Write Timestamp ntz

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz to Orc uses UTC timestamp

2021-11-29 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz to Orc uses UTC timestamp (was: Read/Write Timestamp ntz or ltz

[jira] [Created] (SPARK-37483) Support pushdown down top N to JDBC data source V2

2021-11-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37483: -- Summary: Support pushdown down top N to JDBC data source V2 Key: SPARK-37483 URL: https://issues.apache.org/jira/browse/SPARK-37483 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp

2021-11-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37463: --- Summary: Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp (was: read/write Timestamp ntz

[jira] [Created] (SPARK-37463) read/write Timestamp ntz or ltz to Orc uses UTC timestamp

2021-11-25 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37463: -- Summary: read/write Timestamp ntz or ltz to Orc uses UTC timestamp Key: SPARK-37463 URL: https://issues.apache.org/jira/browse/SPARK-37463 Project: Spark Issue

[jira] (SPARK-28880) ANSI SQL: Nested bracketed comments

2021-11-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28880 ] jiaan.geng deleted comment on SPARK-28880: was (Author: beliefer): [~lixiao] > ANSI SQL: Nested bracketed comments > --- > > Key: SPARK-28880

[jira] [Created] (SPARK-37389) Check unclosed bracketed comments

2021-11-19 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37389: -- Summary: Check unclosed bracketed comments Key: SPARK-37389 URL: https://issues.apache.org/jira/browse/SPARK-37389 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36180) Support TimestampNTZ type in Hive

2021-11-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36180: --- Summary: Support TimestampNTZ type in Hive (was: HMS can not recognize timestamp_ntz) > Support

[jira] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

2021-11-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36357 ] jiaan.geng deleted comment on SPARK-36357: was (Author: beliefer): I'm working on. > Support pushdown Timestamp with local time zone for orc >

[jira] [Updated] (SPARK-36357) Support pushdown Timestamp with local time zone for orc

2021-11-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36357: --- Description: Now that ORC datasources support timestampNTZ, it's great to be able to push down

[jira] (SPARK-36346) Support TimestampNTZ type in Orc file source

2021-11-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36346 ] jiaan.geng deleted comment on SPARK-36346: was (Author: beliefer): I'm working on. > Support TimestampNTZ type in Orc file source > > >

[jira] [Updated] (SPARK-37266) View text can only be SELECT queries

2021-11-12 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37266: --- Summary: View text can only be SELECT queries (was: Optimize the analysis for view text of

[jira] [Updated] (SPARK-37286) Move compileFilter and compileAggregates from JDBCRDD to JdbcDialect

2021-11-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37286: --- Description: Currently, the method compileFilter and compileAggregates in JDBCRDD. But it is not

[jira] [Updated] (SPARK-37286) Move compileFilter and compileAggregates from JDBCRDD to JdbcDialect

2021-11-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37286: --- Summary: Move compileFilter and compileAggregates from JDBCRDD to JdbcDialect (was: Move

[jira] [Created] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect

2021-11-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37286: -- Summary: Move compileAggregates from JDBCRDD to JdbcDialect Key: SPARK-37286 URL: https://issues.apache.org/jira/browse/SPARK-37286 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37266) Optimize the analysis for view text of persistent view and fix security vulnerabilities caused by sql tampering

2021-11-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37266: --- Description: The current implementation of persistent view is create hive table with view text.

[jira] [Updated] (SPARK-37266) Optimize the analysis for view text of persistent view and fix security vulnerabilities caused by sql tampering

2021-11-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37266: --- Summary: Optimize the analysis for view text of persistent view and fix security vulnerabilities

[jira] [Created] (SPARK-37266) Optimize the analysis for view text of persist view and fix security vulnerabilities caused by sql tampering

2021-11-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37266: -- Summary: Optimize the analysis for view text of persist view and fix security vulnerabilities caused by sql tampering Key: SPARK-37266 URL:

[jira] [Issue Comment Deleted] (SPARK-33245) Add built-in UDF - GETBIT

2021-11-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33245: --- Comment: was deleted (was: I'm working on.) > Add built-in UDF - GETBIT >

[jira] [Created] (SPARK-37212) Improve the implement of aggregate pushdown.

2021-11-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37212: -- Summary: Improve the implement of aggregate pushdown. Key: SPARK-37212 URL: https://issues.apache.org/jira/browse/SPARK-37212 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate

2021-11-04 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37203: --- Summary: Fix NotSerializableException when observe with TypedImperativeAggregate (was: Fix

[jira] [Commented] (SPARK-37203) Fix NotSerializableException when observe with percentile_approx

2021-11-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17437780#comment-17437780 ] jiaan.geng commented on SPARK-37203: I'm working on. > Fix NotSerializableException when observe

[jira] [Created] (SPARK-37203) Fix NotSerializableException when observe with percentile_approx

2021-11-03 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37203: -- Summary: Fix NotSerializableException when observe with percentile_approx Key: SPARK-37203 URL: https://issues.apache.org/jira/browse/SPARK-37203 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2021-10-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Comment: was deleted (was: I will working on.) > Support (IGNORE | RESPECT) NULLS for

[jira] [Issue Comment Deleted] (SPARK-37018) Spark SQL should support create function with Aggregator

2021-10-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37018: --- Comment: was deleted (was: I'm working.) > Spark SQL should support create function with

<    1   2   3   4   5   6   7   8   9   10   >