[jira] [Created] (SPARK-43763) Assign a name to the error class _LEGACY_ERROR_TEMP_2407

2023-05-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43763: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2407 Key: SPARK-43763 URL: https://issues.apache.org/jira/browse/SPARK-43763 Project: Spark Issue

[jira] [Created] (SPARK-43764) Assign a name to the error class _LEGACY_ERROR_TEMP_2408

2023-05-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43764: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2408 Key: SPARK-43764 URL: https://issues.apache.org/jira/browse/SPARK-43764 Project: Spark Issue

[jira] [Created] (SPARK-43762) Assign a name to the error class _LEGACY_ERROR_TEMP_2406

2023-05-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43762: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2406 Key: SPARK-43762 URL: https://issues.apache.org/jira/browse/SPARK-43762 Project: Spark Issue

[jira] [Created] (SPARK-43750) Assign a name to the error class _LEGACY_ERROR_TEMP_2405

2023-05-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43750: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2405 Key: SPARK-43750 URL: https://issues.apache.org/jira/browse/SPARK-43750 Project: Spark Issue

[jira] [Created] (SPARK-43749) Assign a name to the error class _LEGACY_ERROR_TEMP_2404

2023-05-23 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43749: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2404 Key: SPARK-43749 URL: https://issues.apache.org/jira/browse/SPARK-43749 Project: Spark Issue

[jira] [Updated] (SPARK-43651) Assign a name to the error class _LEGACY_ERROR_TEMP_2403

2023-05-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43651: --- Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Assign a name to the error

[jira] [Updated] (SPARK-43649) Assign a name to the error class _LEGACY_ERROR_TEMP_2401

2023-05-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43649: --- Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Assign a name to the error

[jira] [Updated] (SPARK-43650) Assign a name to the error class _LEGACY_ERROR_TEMP_2402

2023-05-22 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43650: --- Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Assign a name to the error

[jira] [Created] (SPARK-43651) Assign a name to the error class _LEGACY_ERROR_TEMP_2403

2023-05-22 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43651: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2403 Key: SPARK-43651 URL: https://issues.apache.org/jira/browse/SPARK-43651 Project: Spark Issue

[jira] [Created] (SPARK-43650) Assign a name to the error class _LEGACY_ERROR_TEMP_2402

2023-05-22 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43650: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2402 Key: SPARK-43650 URL: https://issues.apache.org/jira/browse/SPARK-43650 Project: Spark Issue

[jira] [Created] (SPARK-43649) Assign a name to the error class _LEGACY_ERROR_TEMP_2401

2023-05-22 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43649: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2401 Key: SPARK-43649 URL: https://issues.apache.org/jira/browse/SPARK-43649 Project: Spark Issue

[jira] (SPARK-43598) Assign a name to the error class _LEGACY_ERROR_TEMP_2400

2023-05-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43598 ] jiaan.geng deleted comment on SPARK-43598: was (Author: beliefer): I'm working on. > Assign a name to the error class _LEGACY_ERROR_TEMP_2400 >

[jira] [Created] (SPARK-43598) Assign a name to the error class _LEGACY_ERROR_TEMP_2400

2023-05-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43598: -- Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_2400 Key: SPARK-43598 URL: https://issues.apache.org/jira/browse/SPARK-43598 Project: Spark Issue

[jira] [Commented] (SPARK-43598) Assign a name to the error class _LEGACY_ERROR_TEMP_2400

2023-05-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724504#comment-17724504 ] jiaan.geng commented on SPARK-43598: I'm working on. > Assign a name to the error class

[jira] [Updated] (SPARK-43573) Make SparkBuilder could config the heap size of test JVM.

2023-05-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43573: --- Description: build/sbt "sql/Test/runMain --dsdgenDir --location --scaleFactor 1" causes OOM, if

[jira] [Updated] (SPARK-43573) Make SparkBuilder could config the heap size of test JVM.

2023-05-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43573: --- Description: {code:java} build/sbt "sql/Test/runMain --dsdgenDir --location --scaleFactor 1"

[jira] [Updated] (SPARK-43573) Make SparkBuilder could config the heap size of test JVM.

2023-05-18 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43573: --- Description: {code:java} [info] 16:43:41.618 ERROR

[jira] [Created] (SPARK-43573) Make SparkBuilder could config the heap size of test JVM.

2023-05-18 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43573: -- Summary: Make SparkBuilder could config the heap size of test JVM. Key: SPARK-43573 URL: https://issues.apache.org/jira/browse/SPARK-43573 Project: Spark Issue

[jira] [Created] (SPARK-43483) Adds SQL references for OFFSET clause.

2023-05-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43483: -- Summary: Adds SQL references for OFFSET clause. Key: SPARK-43483 URL: https://issues.apache.org/jira/browse/SPARK-43483 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-43162) Runtime filter should extracts multiple filter creation side plans

2023-04-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43162: --- Description: Currently, runtime filter only extract one filter creation side plan. In some scene,

[jira] [Updated] (SPARK-43162) Runtime filter should extracts multiple filter creation side plans

2023-04-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43162: --- Description: Currently, Runtime filter only extract one > Runtime filter should extracts multiple

[jira] [Created] (SPARK-43162) Runtime filter should extracts multiple filter creation side plans

2023-04-17 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43162: -- Summary: Runtime filter should extracts multiple filter creation side plans Key: SPARK-43162 URL: https://issues.apache.org/jira/browse/SPARK-43162 Project: Spark

[jira] [Created] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero.

2023-04-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43137: -- Summary: Improve ArrayInsert if the position is foldable and equals to zero. Key: SPARK-43137 URL: https://issues.apache.org/jira/browse/SPARK-43137 Project: Spark

[jira] [Updated] (SPARK-43025) Eliminate Union if filters have the same child plan

2023-04-04 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43025: --- Summary: Eliminate Union if filters have the same child plan (was: Eliminate Union if filters on

[jira] [Commented] (SPARK-43025) Eliminate Union if filters on the same child plan

2023-04-04 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17708229#comment-17708229 ] jiaan.geng commented on SPARK-43025: I'm working on. > Eliminate Union if filters on the same child

[jira] [Updated] (SPARK-43025) Eliminate Union if filters on the same child plan

2023-04-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-43025: --- Description: There are a lot of SQL in user scenarios. Take an example, SELECT ss_item_sk,

[jira] [Created] (SPARK-43025) Eliminate Union if filters on the same child plan

2023-04-03 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-43025: -- Summary: Eliminate Union if filters on the same child plan Key: SPARK-43025 URL: https://issues.apache.org/jira/browse/SPARK-43025 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42636) Audit annotation usage

2023-03-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701703#comment-17701703 ] jiaan.geng commented on SPARK-42636: I will take a look! > Audit annotation usage >

[jira] (SPARK-42584) Improve output of Column.explain

2023-03-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42584 ] jiaan.geng deleted comment on SPARK-42584: was (Author: beliefer): I will take a look! > Improve output of Column.explain > > > Key:

[jira] [Created] (SPARK-42835) Add test cases for Column.explain

2023-03-17 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42835: -- Summary: Add test cases for Column.explain Key: SPARK-42835 URL: https://issues.apache.org/jira/browse/SPARK-42835 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-42584) Improve output of Column.explain

2023-03-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701498#comment-17701498 ] jiaan.geng commented on SPARK-42584: I will take a look! > Improve output of Column.explain >

[jira] [Resolved] (SPARK-42415) The built-in dialects support OFFSET and paging query.

2023-03-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-42415. Resolution: Won't Fix > The built-in dialects support OFFSET and paging query. >

[jira] [Created] (SPARK-42790) Abstract the excluded method for better test for JDBC docker tests.

2023-03-14 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42790: -- Summary: Abstract the excluded method for better test for JDBC docker tests. Key: SPARK-42790 URL: https://issues.apache.org/jira/browse/SPARK-42790 Project: Spark

[jira] [Created] (SPARK-42783) Infer window group limit should run as late as possible

2023-03-14 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42783: -- Summary: Infer window group limit should run as late as possible Key: SPARK-42783 URL: https://issues.apache.org/jira/browse/SPARK-42783 Project: Spark Issue

[jira] [Created] (SPARK-42772) Adjust the default value of JDBC options about push down to true

2023-03-13 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42772: -- Summary: Adjust the default value of JDBC options about push down to true Key: SPARK-42772 URL: https://issues.apache.org/jira/browse/SPARK-42772 Project: Spark

[jira] [Updated] (SPARK-42772) Change the default value of JDBC options about push down to true

2023-03-13 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42772: --- Summary: Change the default value of JDBC options about push down to true (was: Adjust the default

[jira] [Commented] (SPARK-42669) Short circuit local relation rpcs

2023-03-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699213#comment-17699213 ] jiaan.geng commented on SPARK-42669: I will take a look! > Short circuit local relation rpcs >

[jira] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691 ] jiaan.geng deleted comment on SPARK-42691: was (Author: beliefer): I will take a look! > Implement Dataset.semanticHash > -- > > Key: SPARK-42691

[jira] [Commented] (SPARK-42691) Implement Dataset.semanticHash

2023-03-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698872#comment-17698872 ] jiaan.geng commented on SPARK-42691: I will take a look! > Implement Dataset.semanticHash >

[jira] [Created] (SPARK-42740) Fix the bug that pushdown offset or paging is invalid for some built-in dialect

2023-03-09 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42740: -- Summary: Fix the bug that pushdown offset or paging is invalid for some built-in dialect Key: SPARK-42740 URL: https://issues.apache.org/jira/browse/SPARK-42740

[jira] (SPARK-42604) Implement functions.typedlit

2023-03-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42604 ] jiaan.geng deleted comment on SPARK-42604: was (Author: beliefer): I'm working on. > Implement functions.typedlit > > > Key: SPARK-42604 >

[jira] [Comment Edited] (SPARK-42604) Implement functions.typedlit

2023-03-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695964#comment-17695964 ] jiaan.geng edited comment on SPARK-42604 at 3/9/23 10:43 AM: - I'm working

[jira] (SPARK-42680) Create the helper function withSQLConf for connect's test

2023-03-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42680 ] jiaan.geng deleted comment on SPARK-42680: was (Author: beliefer): I'm working on. > Create the helper function withSQLConf for connect's test >

[jira] [Commented] (SPARK-42680) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696739#comment-17696739 ] jiaan.geng commented on SPARK-42680: I'm working on. > Create the helper function withSQLConf for

[jira] [Resolved] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-42678. Resolution: Duplicate > Create the helper function withSQLConf for connect's test >

[jira] [Created] (SPARK-42680) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42680: -- Summary: Create the helper function withSQLConf for connect's test Key: SPARK-42680 URL: https://issues.apache.org/jira/browse/SPARK-42680 Project: Spark Issue

[jira] [Commented] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696738#comment-17696738 ] jiaan.geng commented on SPARK-42678: https://issues.apache.org/jira/browse/SPARK-42680 duplicated >

[jira] [Updated] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42678: --- Parent: (was: SPARK-42554) Issue Type: New Feature (was: Sub-task) > Create the helper

[jira] [Created] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42678: -- Summary: Create the helper function withSQLConf for connect's test Key: SPARK-42678 URL: https://issues.apache.org/jira/browse/SPARK-42678 Project: Spark Issue

[jira] [Updated] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42677: --- Description: Currently, there are a lot of test cases for broadcast hint is invalid. Because the

[jira] [Updated] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42677: --- Description: Currently, there are a lot of test cases for > Fix the invalid tests for broadcast

[jira] [Created] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42677: -- Summary: Fix the invalid tests for broadcast hint Key: SPARK-42677 URL: https://issues.apache.org/jira/browse/SPARK-42677 Project: Spark Issue Type: Bug

[jira] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562 ] jiaan.geng deleted comment on SPARK-42562: was (Author: beliefer): I will take a look! > UnresolvedLambdaVariables in python do not need unique names >

[jira] [Commented] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-04 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696429#comment-17696429 ] jiaan.geng commented on SPARK-42562: I got it ! > UnresolvedLambdaVariables in python do not need

[jira] [Commented] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696390#comment-17696390 ] jiaan.geng commented on SPARK-42562: [~hvanhovell]I don't understand this issue. Could you tell me

[jira] [Comment Edited] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696390#comment-17696390 ] jiaan.geng edited comment on SPARK-42562 at 3/4/23 2:59 AM: [~hvanhovell] I

[jira] (SPARK-42557) Add Broadcast to functions

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42557 ] jiaan.geng deleted comment on SPARK-42557: was (Author: beliefer): I will take a look! > Add Broadcast to functions > -- > > Key: SPARK-42557 >

[jira] [Commented] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696386#comment-17696386 ] jiaan.geng commented on SPARK-42562: I will take a look! > UnresolvedLambdaVariables in python do

[jira] [Commented] (SPARK-42557) Add Broadcast to functions

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696097#comment-17696097 ] jiaan.geng commented on SPARK-42557: I will take a look! > Add Broadcast to functions >

[jira] (SPARK-42555) Add JDBC to DataFrameReader

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42555 ] jiaan.geng deleted comment on SPARK-42555: was (Author: beliefer): I will take a look! > Add JDBC to DataFrameReader > --- > > Key: SPARK-42555 >

[jira] (SPARK-42556) Dataset.colregex should link a plan_id when it only matches a single column.

2023-03-03 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42556 ] jiaan.geng deleted comment on SPARK-42556: was (Author: beliefer): I'm working on. > Dataset.colregex should link a plan_id when it only matches a single column. >

[jira] [Commented] (SPARK-42556) Dataset.colregex should link a plan_id when it only matches a single column.

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695965#comment-17695965 ] jiaan.geng commented on SPARK-42556: I'm working on. > Dataset.colregex should link a plan_id when

[jira] [Commented] (SPARK-42604) Implement functions.typedlit

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695964#comment-17695964 ] jiaan.geng commented on SPARK-42604: I will take a look! > Implement functions.typedlit >

[jira] [Commented] (SPARK-42578) Add JDBC to DataFrameWriter

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695650#comment-17695650 ] jiaan.geng commented on SPARK-42578: I will take a look! > Add JDBC to DataFrameWriter >

[jira] [Commented] (SPARK-42555) Add JDBC to DataFrameReader

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695633#comment-17695633 ] jiaan.geng commented on SPARK-42555: I will take a look! > Add JDBC to DataFrameReader >

[jira] [Created] (SPARK-42601) New physical type Decimal128 for DecimalType

2023-02-27 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42601: -- Summary: New physical type Decimal128 for DecimalType Key: SPARK-42601 URL: https://issues.apache.org/jira/browse/SPARK-42601 Project: Spark Issue Type:

[jira] [Created] (SPARK-42590) Introduce Decimal128 as the physical type for DecimalType

2023-02-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42590: -- Summary: Introduce Decimal128 as the physical type for DecimalType Key: SPARK-42590 URL: https://issues.apache.org/jira/browse/SPARK-42590 Project: Spark Issue

[jira] [Commented] (SPARK-42509) WindowGroupLimitExec supports codegen

2023-02-21 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691458#comment-17691458 ] jiaan.geng commented on SPARK-42509: I'm working on. > WindowGroupLimitExec supports codegen >

[jira] [Created] (SPARK-42509) WindowGroupLimitExec supports codegen

2023-02-21 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42509: -- Summary: WindowGroupLimitExec supports codegen Key: SPARK-42509 URL: https://issues.apache.org/jira/browse/SPARK-42509 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42415) The built-in dialects support OFFSET and paging query.

2023-02-12 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42415: -- Summary: The built-in dialects support OFFSET and paging query. Key: SPARK-42415 URL: https://issues.apache.org/jira/browse/SPARK-42415 Project: Spark Issue

[jira] [Updated] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset and limit

2023-02-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42289: --- Summary: DS V2 pushdown could let JDBC dialect decide to push down offset and limit (was: DS V2

[jira] [Created] (SPARK-42289) DS V2 pushdown could let JDBC dialect decide to push down offset

2023-02-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42289: -- Summary: DS V2 pushdown could let JDBC dialect decide to push down offset Key: SPARK-42289 URL: https://issues.apache.org/jira/browse/SPARK-42289 Project: Spark

[jira] [Updated] (SPARK-42278) DS V2 pushdown supports supports JDBC dialects compile `SortOrder` by themselves

2023-02-01 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42278: --- Summary: DS V2 pushdown supports supports JDBC dialects compile `SortOrder` by themselves (was: DS

[jira] [Created] (SPARK-42278) DS V2 pushdown supports compile SortOrder by JDBC dialects themselves

2023-02-01 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42278: -- Summary: DS V2 pushdown supports compile SortOrder by JDBC dialects themselves Key: SPARK-42278 URL: https://issues.apache.org/jira/browse/SPARK-42278 Project: Spark

[jira] [Updated] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-01-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42131: --- Description: Currently, JDBCRDD uses fixed format for SELECT statement. {code:java} val sqlText =

[jira] [Updated] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-01-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42131: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Extract the function that

[jira] [Updated] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-01-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42131: --- Issue Type: New Feature (was: Improvement) > Extract the function that construct the select

[jira] [Created] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-01-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42131: -- Summary: Extract the function that construct the select statement for JDBC dialect. Key: SPARK-42131 URL: https://issues.apache.org/jira/browse/SPARK-42131 Project:

[jira] [Commented] (SPARK-42032) Map data show in different order

2023-01-16 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677235#comment-17677235 ] jiaan.geng commented on SPARK-42032: After my investigation, the fact is the result of connect is

[jira] [Commented] (SPARK-41988) Fix map_filter and map_zip_with output order

2023-01-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677141#comment-17677141 ] jiaan.geng commented on SPARK-41988: After my investigation, the fact is the result of connect is

[jira] [Commented] (SPARK-42032) Map data show in different order

2023-01-15 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17677106#comment-17677106 ] jiaan.geng commented on SPARK-42032: This issue duplicated with

[jira] [Updated] (SPARK-41988) Fix map_filter and map_zip_with output order

2023-01-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41988: --- Description: {code:java} File

[jira] [Created] (SPARK-41988) Fix map_filter and map_zip_with output order

2023-01-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-41988: -- Summary: Fix map_filter and map_zip_with output order Key: SPARK-41988 URL: https://issues.apache.org/jira/browse/SPARK-41988 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41987) createDataFrame supports column with map type.

2023-01-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41987: --- Description: Currently, Connect API createDataFrame does not support create dataframe with map

[jira] [Updated] (SPARK-41987) createDataFrame supports column with map type.

2023-01-11 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41987: --- Description: Currently, Connect API > createDataFrame supports column with map type. >

[jira] [Created] (SPARK-41987) createDataFrame supports column with map type.

2023-01-11 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-41987: -- Summary: createDataFrame supports column with map type. Key: SPARK-41987 URL: https://issues.apache.org/jira/browse/SPARK-41987 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41838) DataFrame.show() fix map printing

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657041#comment-17657041 ] jiaan.geng commented on SPARK-41838: I want take a look! > DataFrame.show() fix map printing >

[jira] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876 ] jiaan.geng deleted comment on SPARK-41876: was (Author: beliefer): I will take a look! > Implement DataFrame `toLocalIterator` > - > >

[jira] [Commented] (SPARK-41876) Implement DataFrame `toLocalIterator`

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17657028#comment-17657028 ] jiaan.geng commented on SPARK-41876: I will take a look! > Implement DataFrame `toLocalIterator` >

[jira] (SPARK-41886) `DataFrame.intersect` doctest output has different order

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41886 ] jiaan.geng deleted comment on SPARK-41886: was (Author: beliefer): I want take a look! > `DataFrame.intersect` doctest output has different order >

[jira] [Commented] (SPARK-41886) `DataFrame.intersect` doctest output has different order

2023-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656529#comment-17656529 ] jiaan.geng commented on SPARK-41886: I want take a look! > `DataFrame.intersect` doctest output has

[jira] (SPARK-41907) Function `sampleby` return parity

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41907 ] jiaan.geng deleted comment on SPARK-41907: was (Author: beliefer): I want take a look. > Function `sampleby` return parity > - > > Key:

[jira] [Commented] (SPARK-41907) Function `sampleby` return parity

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656429#comment-17656429 ] jiaan.geng commented on SPARK-41907: The root cause is the plan is different from pyspark, so the

[jira] [Commented] (SPARK-41907) Function `sampleby` return parity

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656376#comment-17656376 ] jiaan.geng commented on SPARK-41907: I want take a look. > Function `sampleby` return parity >

[jira] [Resolved] (SPARK-41904) Fix Function `nth_value` functions output

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-41904. Resolution: Won't Fix > Fix Function `nth_value` functions output >

[jira] [Commented] (SPARK-41904) Fix Function `nth_value` functions output

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17656374#comment-17656374 ] jiaan.geng commented on SPARK-41904: The root reason caused by

[jira] (SPARK-41945) Python: connect client lost column data with pyarrow.Table.to_pylist

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41945 ] jiaan.geng deleted comment on SPARK-41945: was (Author: beliefer): I'm working on. > Python: connect client lost column data with pyarrow.Table.to_pylist >

[jira] [Updated] (SPARK-41945) Python: connect client lost column data with pyarrow.Table.to_pylist

2023-01-09 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41945: --- Description: Python: connect client should not use pyarrow.Table.to_pylist to transform fetched

[jira] [Updated] (SPARK-41945) Python: connect client lost column data with pyarrow.Table.to_pylist

2023-01-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41945: --- Description: Python: connect client should not use pyarrow.Table.to_pylist to transform fetched

[jira] [Updated] (SPARK-41945) Python: connect client lost column data with pyarrow.Table.to_pylist

2023-01-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-41945: --- Description: Python: connect client should not use pyarrow.Table.to_pylist to transform fetched

<    1   2   3   4   5   6   7   8   9   10   >