[jira] [Updated] (SPARK-39135) DS V2 aggregate partial push-down should supports group by without aggregate functions

2022-05-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39135: --- Description: Currently, the SQL show below not supported by DS V2 aggregate partial push-down.

[jira] [Updated] (SPARK-39135) DS V2 aggregate partial push-down should supports group by without aggregate functions

2022-05-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39135: --- Summary: DS V2 aggregate partial push-down should supports group by without aggregate functions

[jira] [Created] (SPARK-39135) DS V2 aggregate push-down should supports group by without aggregate functions

2022-05-09 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39135: -- Summary: DS V2 aggregate push-down should supports group by without aggregate functions Key: SPARK-39135 URL: https://issues.apache.org/jira/browse/SPARK-39135 Project:

[jira] [Created] (SPARK-39065) DS V2 Limit push-down should avoid out of memory

2022-04-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39065: -- Summary: DS V2 Limit push-down should avoid out of memory Key: SPARK-39065 URL: https://issues.apache.org/jira/browse/SPARK-39065 Project: Spark Issue Type:

[jira] [Created] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39057: -- Summary: Offset could work without Limit Key: SPARK-39057 URL: https://issues.apache.org/jira/browse/SPARK-39057 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-39037) DS V2 Top N push-down supports order by expressions

2022-04-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39037: --- Summary: DS V2 Top N push-down supports order by expressions (was: DS V2 aggregate push-down

[jira] [Updated] (SPARK-39037) DS V2 Top N push-down supports order by expressions

2022-04-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39037: --- Description: Currently, Spark DS V2 Top N push-down only supports order by column. But the SQL show

[jira] [Created] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

2022-04-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39037: -- Summary: DS V2 aggregate push-down supports order by expressions Key: SPARK-39037 URL: https://issues.apache.org/jira/browse/SPARK-39037 Project: Spark Issue

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-04-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Created] (SPARK-38997) DS V2 aggregate push-down supports group by expressions

2022-04-22 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38997: -- Summary: DS V2 aggregate push-down supports group by expressions Key: SPARK-38997 URL: https://issues.apache.org/jira/browse/SPARK-38997 Project: Spark Issue

[jira] [Created] (SPARK-38978) Support push down limit and offset to JDBC data source V2

2022-04-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38978: -- Summary: Support push down limit and offset to JDBC data source V2 Key: SPARK-38978 URL: https://issues.apache.org/jira/browse/SPARK-38978 Project: Spark Issue

[jira] [Resolved] (SPARK-37953) Improve the implement of UnevaluableAggregate

2022-04-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-37953. Resolution: Won't Fix > Improve the implement of UnevaluableAggregate >

[jira] [Resolved] (SPARK-37914) Make RuntimeReplaceable works for AggregateFunction

2022-04-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-37914. Resolution: Won't Fix > Make RuntimeReplaceable works for AggregateFunction >

[jira] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2022-04-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37702 ] jiaan.geng deleted comment on SPARK-37702: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_syy > - > >

[jira] [Updated] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2022-04-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37702: --- Affects Version/s: 3.4.0 (was: 3.3.0) > Support ANSI Aggregate Function:

[jira] [Updated] (SPARK-38933) Add examples of window functions into SQL docs

2022-04-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38933: --- Description: Currently, Spark SQL docs only display the window functions. (was: Currently, Spark

[jira] [Created] (SPARK-38933) Add examples of window functions into SQL docs

2022-04-18 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38933: -- Summary: Add examples of window functions into SQL docs Key: SPARK-38933 URL: https://issues.apache.org/jira/browse/SPARK-38933 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38901) DS V2 supports push down misc functions

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38901: --- Summary: DS V2 supports push down misc functions (was: Support for more misc functions to push

[jira] [Updated] (SPARK-38900) DS V2 supports push down collection functions

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38900: --- Summary: DS V2 supports push down collection functions (was: Support for more collection functions

[jira] [Updated] (SPARK-38899) DS V2 supports push down datetime functions

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38899: --- Summary: DS V2 supports push down datetime functions (was: Support for more datetime functions to

[jira] [Updated] (SPARK-38897) DS V2 supports push down string functions

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38897: --- Summary: DS V2 supports push down string functions (was: Support for more string functions to push

[jira] [Commented] (SPARK-38900) Support for more collection functions to push down to data source

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522716#comment-17522716 ] jiaan.geng commented on SPARK-38900: Could you do the job? > Support for more collection functions

[jira] [Commented] (SPARK-38899) Support for more datetime functions to push down to data source

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522715#comment-17522715 ] jiaan.geng commented on SPARK-38899: [~Zhixiong Chen] Could you do the job? > Support for more

[jira] [Commented] (SPARK-38901) Support for more misc functions to push down to data source

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522717#comment-17522717 ] jiaan.geng commented on SPARK-38901: Could you do the job? > Support for more misc functions to

[jira] [Commented] (SPARK-38897) Support for more string functions to push down to data source

2022-04-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522711#comment-17522711 ] jiaan.geng commented on SPARK-38897: [~Zhixiong Chen] Please do the job. > Support for more string

[jira] [Created] (SPARK-38865) Update document of JDBC options for pushDownAggregate and pushDownLimit

2022-04-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38865: -- Summary: Update document of JDBC options for pushDownAggregate and pushDownLimit Key: SPARK-38865 URL: https://issues.apache.org/jira/browse/SPARK-38865 Project: Spark

[jira] [Updated] (SPARK-38855) DS V2 supports push down math functions

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38855: --- Description: Currently, Spark have a lot math functions of ANSI standard. LN, EXP, POWER, SQRT,

[jira] [Created] (SPARK-38855) DS V2 supports push down math functions

2022-04-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38855: -- Summary: DS V2 supports push down math functions Key: SPARK-38855 URL: https://issues.apache.org/jira/browse/SPARK-38855 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-38855) DS V2 supports push down math functions

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38855: --- Description: Currently, Spark have a lot misc non-aggregate functions of ANSI standard. abs,

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Updated] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38761: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > DS V2 supports push down

[jira] [Updated] (SPARK-38560) If `Sum`, `Count`, `Any` accompany distinct, cannot do partial agg push down.

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38560: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > If `Sum`, `Count`, `Any`

[jira] [Updated] (SPARK-38633) Support push down Cast to JDBC data source V2

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38633: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Support push down Cast to

[jira] [Updated] (SPARK-38768) If limit could pushed down and Data source only have one partition, DS V2 should not do limit again

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38768: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > If limit could pushed down

[jira] [Updated] (SPARK-38391) Datasource v2 supports partial topN push-down

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38391: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Datasource v2 supports

[jira] [Updated] (SPARK-38644) DS V2 topN push-down supports project with alias

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38644: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > DS V2 topN push-down

[jira] [Updated] (SPARK-38533) DS V2 aggregate push-down supports project with alias

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38533: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > DS V2 aggregate push-down

[jira] [Updated] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38432: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Refactor framework so as

[jira] [Updated] (SPARK-38361) Add factory method getConnection into JDBCDialect.

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38361: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Add factory method

[jira] [Updated] (SPARK-38196) Reactor framework so as JDBC dialect could compile expression by self way

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38196: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Reactor framework so as JDBC

[jira] [Updated] (SPARK-37960) A new framework to represent catalyst expressions in DS v2 APIs

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > A new framework to represent

[jira] [Updated] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37867: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Compile aggregate functions

[jira] [Updated] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37839: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > DS V2 supports partial

[jira] [Updated] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37839: --- Epic Link: (was: SPARK-38788) > DS V2 supports partial aggregate push-down AVG >

[jira] [Updated] (SPARK-37527) Translate more standard aggregate functions for pushdown

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37527: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Translate more standard

[jira] [Updated] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37734: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Dependency upgrade) > Upgrade h2 from

[jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37732: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Improve the implement of

[jira] [Updated] (SPARK-37644) Support datasource v2 complete aggregate pushdown

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37644: --- Epic Link: (was: SPARK-38788) > Support datasource v2 complete aggregate pushdown >

[jira] [Updated] (SPARK-37644) Support datasource v2 complete aggregate pushdown

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37644: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Support datasource v2

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Epic Link: (was: SPARK-38788) > Support push down top N to JDBC data source V2 >

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Support push down top N to

[jira] [Updated] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37286: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Move compileAggregates from

[jira] [Updated] (SPARK-37212) Improve the implement of aggregate pushdown.

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37212: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Improve the implement of

[jira] [Updated] (SPARK-36574) pushDownPredicate=false should prevent push down filters to JDBC data source

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Bug) > pushDownPredicate=false should

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However,

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-04-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. But, the

[jira] [Created] (SPARK-38852) Better Data Source V2 operator pushdown framework

2022-04-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38852: -- Summary: Better Data Source V2 operator pushdown framework Key: SPARK-38852 URL: https://issues.apache.org/jira/browse/SPARK-38852 Project: Spark Issue Type:

[jira] [Created] (SPARK-38768) If limit could pushed down and Data source only have one partition, DS V2 should not do limit again

2022-04-01 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38768: -- Summary: If limit could pushed down and Data source only have one partition, DS V2 should not do limit again Key: SPARK-38768 URL: https://issues.apache.org/jira/browse/SPARK-38768

[jira] [Created] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

2022-04-01 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38761: -- Summary: DS V2 supports push down misc non-aggregate functions Key: SPARK-38761 URL: https://issues.apache.org/jira/browse/SPARK-38761 Project: Spark Issue

[jira] [Created] (SPARK-38685) Improve the implement of percentile_cont

2022-03-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38685: -- Summary: Improve the implement of percentile_cont Key: SPARK-38685 URL: https://issues.apache.org/jira/browse/SPARK-38685 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-38655) OffsetWindowFunctionFrameBase cannot find the offset row whose input is not null

2022-03-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38655: --- Summary: OffsetWindowFunctionFrameBase cannot find the offset row whose input is not null (was:

[jira] [Resolved] (SPARK-38658) Support PostgreSQL function generate_series

2022-03-25 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-38658. Resolution: Duplicate > Support PostgreSQL function generate_series >

[jira] [Created] (SPARK-38658) Support PostgreSQL function generate_series

2022-03-25 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38658: -- Summary: Support PostgreSQL function generate_series Key: SPARK-38658 URL: https://issues.apache.org/jira/browse/SPARK-38658 Project: Spark Issue Type: New

[jira] [Created] (SPARK-38655) UnboundedPrecedingOffsetWindowFunctionFrame cannot find the offset row whose input is not null

2022-03-25 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38655: -- Summary: UnboundedPrecedingOffsetWindowFunctionFrame cannot find the offset row whose input is not null Key: SPARK-38655 URL: https://issues.apache.org/jira/browse/SPARK-38655

[jira] [Updated] (SPARK-38644) DS V2 topN push-down supports project with alias

2022-03-24 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38644: --- Summary: DS V2 topN push-down supports project with alias (was: DS V2 aggregate push-down supports

[jira] [Updated] (SPARK-38644) DS V2 aggregate push-down supports project with alias

2022-03-24 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38644: --- Issue Type: Improvement (was: New Feature) > DS V2 aggregate push-down supports project with alias

[jira] [Created] (SPARK-38644) DS V2 aggregate push-down supports project with alias

2022-03-24 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38644: -- Summary: DS V2 aggregate push-down supports project with alias Key: SPARK-38644 URL: https://issues.apache.org/jira/browse/SPARK-38644 Project: Spark Issue

[jira] [Created] (SPARK-38633) Support push down Cast to JDBC data source V2

2022-03-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38633: -- Summary: Support push down Cast to JDBC data source V2 Key: SPARK-38633 URL: https://issues.apache.org/jira/browse/SPARK-38633 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-38560) If `Sum`, `Count`, `Any` accompany distinct, cannot do partial agg push down.

2022-03-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38560: --- Summary: If `Sum`, `Count`, `Any` accompany distinct, cannot do partial agg push down. (was: If

[jira] [Updated] (SPARK-38560) If `Sum`, `Count`, `Any` with distinct, cannot do partial agg push down.

2022-03-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38560: --- Summary: If `Sum`, `Count`, `Any` with distinct, cannot do partial agg push down. (was: If `Sum`,

[jira] [Created] (SPARK-38560) If `Sum`, `Count` with distinct, cannot do partial agg push down.

2022-03-15 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38560: -- Summary: If `Sum`, `Count` with distinct, cannot do partial agg push down. Key: SPARK-38560 URL: https://issues.apache.org/jira/browse/SPARK-38560 Project: Spark

[jira] [Updated] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

2022-03-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38432: --- Summary: Refactor framework so as JDBC dialect could compile filter by self way (was: Reactor

[jira] [Updated] (SPARK-38391) Datasource v2 supports partial topN push-down

2022-03-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38391: --- Summary: Datasource v2 supports partial topN push-down (was: Datasource v2 supports complete

[jira] [Updated] (SPARK-38391) Datasource v2 supports complete partial topN pushdown

2022-03-14 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38391: --- Summary: Datasource v2 supports complete partial topN pushdown (was: Datasource v2 supports

[jira] [Created] (SPARK-38539) Add document for ToNumber for DecimalFormat's compatibility

2022-03-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38539: -- Summary: Add document for ToNumber for DecimalFormat's compatibility Key: SPARK-38539 URL: https://issues.apache.org/jira/browse/SPARK-38539 Project: Spark

[jira] [Updated] (SPARK-38533) DS V2 aggregate push-down supports project with alias

2022-03-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38533: --- Summary: DS V2 aggregate push-down supports project with alias (was: Aggregate push-down supports

[jira] [Created] (SPARK-38533) Aggregate push-down supports project with alias

2022-03-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38533: -- Summary: Aggregate push-down supports project with alias Key: SPARK-38533 URL: https://issues.apache.org/jira/browse/SPARK-38533 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38504) Can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38504: --- Summary: Can't read TimestampNTZ as TimestampLTZ (was: can't read TimestampNTZ as TimestampLTZ) >

[jira] [Created] (SPARK-38504) can't read TimestampNTZ as TimestampLTZ

2022-03-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38504: -- Summary: can't read TimestampNTZ as TimestampLTZ Key: SPARK-38504 URL: https://issues.apache.org/jira/browse/SPARK-38504 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-38432) Reactor framework so as JDBC dialect could compile filter by self way

2022-03-06 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38432: -- Summary: Reactor framework so as JDBC dialect could compile filter by self way Key: SPARK-38432 URL: https://issues.apache.org/jira/browse/SPARK-38432 Project: Spark

[jira] [Updated] (SPARK-38361) Add factory method getConnection into JDBCDialect.

2022-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38361: --- Description: At present, the parameter of the factory method for obtaining JDBC connection is

[jira] [Updated] (SPARK-38361) Add factory method getConnection into JDBCDialect.

2022-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38361: --- Summary: Add factory method getConnection into JDBCDialect. (was: Let factory method getConnection

[jira] [Created] (SPARK-38391) Datasource v2 supports complete partial sort pushdown

2022-03-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38391: -- Summary: Datasource v2 supports complete partial sort pushdown Key: SPARK-38391 URL: https://issues.apache.org/jira/browse/SPARK-38391 Project: Spark Issue

[jira] [Created] (SPARK-38361) Let factory method getConnection take Partition as optional parameter.

2022-03-01 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38361: -- Summary: Let factory method getConnection take Partition as optional parameter. Key: SPARK-38361 URL: https://issues.apache.org/jira/browse/SPARK-38361 Project: Spark

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-03-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499424#comment-17499424 ] jiaan.geng commented on SPARK-38200: [~melin] It seems not consistent. > [SQL] Spark JDBC Savemode

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-02-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495305#comment-17495305 ] jiaan.geng commented on SPARK-38200: [~melin] OK. Does other SQL could finish the same work as

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports replace

2022-02-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493607#comment-17493607 ] jiaan.geng commented on SPARK-38200: [~melin] Thank you for the ping. Does the syntax is an ANSI

[jira] [Created] (SPARK-38219) Support ANSI aggregation function percentile_cont as window function

2022-02-15 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38219: -- Summary: Support ANSI aggregation function percentile_cont as window function Key: SPARK-38219 URL: https://issues.apache.org/jira/browse/SPARK-38219 Project: Spark

[jira] [Created] (SPARK-38196) Reactor framework so as JDBC dialect could compile expression by self way

2022-02-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38196: -- Summary: Reactor framework so as JDBC dialect could compile expression by self way Key: SPARK-38196 URL: https://issues.apache.org/jira/browse/SPARK-38196 Project: Spark

[jira] [Updated] (SPARK-37960) A new framework to represent catalyst expressions in DS v2 APIs

2022-02-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Description: Spark need a new framework to represent catalyst expressions in DS v2 APIs. CASE ...

[jira] [Updated] (SPARK-37960) A new framework to represent catalyst expressions in DS v2 APIs

2022-02-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Summary: A new framework to represent catalyst expressions in DS v2 APIs (was: Support aggregate

[jira] [Updated] (SPARK-38065) Improve the performance of DS V2 aggregate push-down

2022-01-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38065: --- Summary: Improve the performance of DS V2 aggregate push-down (was: Improve the implement of DS V2

[jira] [Created] (SPARK-38065) Improve the implement of DS V2 aggregate push-down

2022-01-28 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38065: -- Summary: Improve the implement of DS V2 aggregate push-down Key: SPARK-38065 URL: https://issues.apache.org/jira/browse/SPARK-38065 Project: Spark Issue Type:

[jira] [Created] (SPARK-38054) DS V2 supports list namespaces of MySQL

2022-01-28 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38054: -- Summary: DS V2 supports list namespaces of MySQL Key: SPARK-38054 URL: https://issues.apache.org/jira/browse/SPARK-38054 Project: Spark Issue Type: New Feature

[jira] (SPARK-38035) Add docker tests for build-in JDBC dialect

2022-01-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38035 ] jiaan.geng deleted comment on SPARK-38035: was (Author: beliefer): I'm working on. > Add docker tests for build-in JDBC dialect > -- > >

[jira] [Created] (SPARK-38035) Add docker tests for build-in JDBC dialect

2022-01-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38035: -- Summary: Add docker tests for build-in JDBC dialect Key: SPARK-38035 URL: https://issues.apache.org/jira/browse/SPARK-38035 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-38035) Add docker tests for build-in JDBC dialect

2022-01-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482395#comment-17482395 ] jiaan.geng commented on SPARK-38035: I'm working on. > Add docker tests for build-in JDBC dialect >

[jira] (SPARK-28516) Data Type Formatting Functions: `to_char`

2022-01-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28516 ] jiaan.geng deleted comment on SPARK-28516: was (Author: beliefer): I'm working on. > Data Type Formatting Functions: `to_char` > - > >

[jira] [Reopened] (SPARK-28516) Data Type Formatting Functions: `to_char`

2022-01-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng reopened SPARK-28516: > Data Type Formatting Functions: `to_char` > - > >

[jira] [Updated] (SPARK-37960) Support aggregate push down with CASE ... WHEN ... ELSE ... END

2022-01-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Summary: Support aggregate push down with CASE ... WHEN ... ELSE ... END (was: Support aggregate

<    1   2   3   4   5   6   7   8   9   10   >