[jira] [Updated] (SPARK-34188) Char varchar length check blocks CBO statistics

[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34188: - Description: !screenshot-1.png! the char varchar length check changes the output by projection and

[jira] [Updated] (SPARK-34188) Char varchar length check blocks CBO statistics

[ https://issues.apache.org/jira/browse/SPARK-34188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34188: - Attachment: screenshot-1.png > Char varchar length check blocks CBO statistics >

[jira] [Created] (SPARK-34188) Char varchar length check blocks CBO statistics

Kent Yao created SPARK-34188: Summary: Char varchar length check blocks CBO statistics Key: SPARK-34188 URL: https://issues.apache.org/jira/browse/SPARK-34188 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34187: Assignee: L. C. Hsieh (was: Apache Spark) > Use available offset range obtained during

[jira] [Commented] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269097#comment-17269097 ] Apache Spark commented on SPARK-34187: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34187: Assignee: Apache Spark (was: L. C. Hsieh) > Use available offset range obtained during

[jira] [Updated] (SPARK-34187) Use available offset range obtained during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34187: Summary: Use available offset range obtained during polling when checking offset validation

[jira] [Resolved] (SPARK-34096) Improve performance for nth_value ignore nulls over offset window

[ https://issues.apache.org/jira/browse/SPARK-34096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34096. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31178

[jira] [Assigned] (SPARK-34096) Improve performance for nth_value ignore nulls over offset window

[ https://issues.apache.org/jira/browse/SPARK-34096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34096: --- Assignee: jiaan.geng > Improve performance for nth_value ignore nulls over offset window >

[jira] [Updated] (SPARK-34187) Use available offset range obtainted during polling when checking offset validation

[ https://issues.apache.org/jira/browse/SPARK-34187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-34187: Description: We support non-consecutive offsets for Kafka since 2.4.0. In `fetchRecord`, we do

[jira] [Created] (SPARK-34187) Use available offset range obtainted during polling when checking offset validation

L. C. Hsieh created SPARK-34187: --- Summary: Use available offset range obtainted during polling when checking offset validation Key: SPARK-34187 URL: https://issues.apache.org/jira/browse/SPARK-34187

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269044#comment-17269044 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34186) Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34186: Assignee: Apache Spark (was: Kousuke Saruta) > Fix DockerJDBCIntegrationSuites to

[jira] [Assigned] (SPARK-34186) Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34186: Assignee: Kousuke Saruta (was: Apache Spark) > Fix DockerJDBCIntegrationSuites to

[jira] [Commented] (SPARK-34186) Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269043#comment-17269043 ] Apache Spark commented on SPARK-34186: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34164) Improve write side varchar check to visit only last few tailing spaces

[ https://issues.apache.org/jira/browse/SPARK-34164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34164: --- Assignee: Kent Yao > Improve write side varchar check to visit only last few tailing

[jira] [Resolved] (SPARK-34164) Improve write side varchar check to visit only last few tailing spaces

[ https://issues.apache.org/jira/browse/SPARK-34164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34164. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31253

[jira] [Created] (SPARK-34186) Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888

Kousuke Saruta created SPARK-34186: -- Summary: Fix DockerJDBCIntegrationSuites to reflect the change of SPARK-33888 Key: SPARK-34186 URL: https://issues.apache.org/jira/browse/SPARK-34186 Project:

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression brought by SPARK-33888 for PostgresDialect (was: Fix the

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269035#comment-17269035 ] Apache Spark commented on SPARK-34152: -- User 'imback82' has created a pull request for this issue:

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: A regression brought by SPARK-33888 affects PostgresDialect causing

[jira] [Assigned] (SPARK-34152) CreateViewStatement.child should be a real child

[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34152: Assignee: Apache Spark > CreateViewStatement.child should be a real child >

[jira] [Assigned] (SPARK-34152) CreateViewStatement.child should be a real child

[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34152: Assignee: Apache Spark > CreateViewStatement.child should be a real child >

[jira] [Assigned] (SPARK-34152) CreateViewStatement.child should be a real child

[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34152: Assignee: (was: Apache Spark) > CreateViewStatement.child should be a real child >

[jira] [Commented] (SPARK-31634) "show tables like" support for SQL wildcard characters (% and _)

[ https://issues.apache.org/jira/browse/SPARK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269033#comment-17269033 ] Apache Spark commented on SPARK-31634: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31634) "show tables like" support for SQL wildcard characters (% and _)

[ https://issues.apache.org/jira/browse/SPARK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269032#comment-17269032 ] Apache Spark commented on SPARK-31634: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-31634) "show tables like" support for SQL wildcard characters (% and _)

[ https://issues.apache.org/jira/browse/SPARK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31634: Assignee: (was: Apache Spark) > "show tables like" support for SQL wildcard

[jira] [Assigned] (SPARK-31634) "show tables like" support for SQL wildcard characters (% and _)

[ https://issues.apache.org/jira/browse/SPARK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31634: Assignee: Apache Spark > "show tables like" support for SQL wildcard characters (% and

[jira] [Commented] (SPARK-34185) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269031#comment-17269031 ] Apache Spark commented on SPARK-34185: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-34185) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269030#comment-17269030 ] Apache Spark commented on SPARK-34185: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-34185) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34185: Assignee: Apache Spark > Review and fix issues in API docs >

[jira] [Assigned] (SPARK-34185) Review and fix issues in API docs

[ https://issues.apache.org/jira/browse/SPARK-34185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34185: Assignee: (was: Apache Spark) > Review and fix issues in API docs >

[jira] [Created] (SPARK-34185) Review and fix issues in API docs

Yuanjian Li created SPARK-34185: --- Summary: Review and fix issues in API docs Key: SPARK-34185 URL: https://issues.apache.org/jira/browse/SPARK-34185 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: SPARK-33888 PR has the two serious problems. 1. A regression which affects

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression brought by SPARK-33888 (was: Fix the regression brought by

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269022#comment-17269022 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269021#comment-17269021 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269020#comment-17269020 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269019#comment-17269019 ] Apache Spark commented on SPARK-34180: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269018#comment-17269018 ] Apache Spark commented on SPARK-34180: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269014#comment-17269014 ] Apache Spark commented on SPARK-33933: -- User 'zhongyu09' has created a pull request for this issue:

[jira] [Updated] (SPARK-34181) Update build doc help document

[ https://issues.apache.org/jira/browse/SPARK-34181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34181: - Fix Version/s: 3.1.2 3.0.2 > Update build doc help document >

[jira] [Resolved] (SPARK-34181) Update build doc help document

[ https://issues.apache.org/jira/browse/SPARK-34181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34181. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/31263 > Update build doc

[jira] [Resolved] (SPARK-34047) save tree models in single partition

[ https://issues.apache.org/jira/browse/SPARK-34047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-34047. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31090

[jira] [Assigned] (SPARK-34047) save tree models in single partition

[ https://issues.apache.org/jira/browse/SPARK-34047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-34047: Assignee: zhengruifeng > save tree models in single partition >

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268971#comment-17268971 ] Apache Spark commented on SPARK-32165: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-32165) SessionState leaks SparkListener with multiple SparkSession

[ https://issues.apache.org/jira/browse/SPARK-32165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268969#comment-17268969 ] Apache Spark commented on SPARK-32165: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268961#comment-17268961 ] Apache Spark commented on SPARK-21195: -- User 'robert3005' has created a pull request for this

[jira] [Commented] (SPARK-21195) MetricSystem should pick up dynamically registered metrics in sources

[ https://issues.apache.org/jira/browse/SPARK-21195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268962#comment-17268962 ] Apache Spark commented on SPARK-21195: -- User 'robert3005' has created a pull request for this

[jira] [Commented] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268960#comment-17268960 ] Dongjoon Hyun commented on SPARK-34154: --- I also observed the hanged instance at branch-3.0 GitHub

[jira] [Updated] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34154: -- Affects Version/s: 3.1.1 3.0.2 > Flaky Test:

[jira] [Updated] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34154: -- Description: `LocalityPlacementStrategySuite` hangs sometimes like the following. We can

[jira] [Updated] (SPARK-34178) Copy tags for the new node created by MultiInstanceRelation.newInstance

[ https://issues.apache.org/jira/browse/SPARK-34178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34178: - Fix Version/s: (was: 3.0.2) > Copy tags for the new node created by

[jira] [Resolved] (SPARK-27733) Upgrade to Avro 1.10.1

[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27733. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31232

[jira] [Assigned] (SPARK-27733) Upgrade to Avro 1.10.1

[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27733: - Assignee: Ismaël Mejía > Upgrade to Avro 1.10.1 > -- > >

[jira] [Resolved] (SPARK-34176) Java UT failed when testing sql/hive module independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-34176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34176. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31259

[jira] [Assigned] (SPARK-34176) Java UT failed when testing sql/hive module independently in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-34176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34176: - Assignee: Yang Jie > Java UT failed when testing sql/hive module independently in

[jira] [Created] (SPARK-34184) Remove redundant repartition nodes in the optimizer

Anton Okolnychyi created SPARK-34184: Summary: Remove redundant repartition nodes in the optimizer Key: SPARK-34184 URL: https://issues.apache.org/jira/browse/SPARK-34184 Project: Spark

[jira] [Updated] (SPARK-34183) DataSource V2: Support required distribution and ordering in SS

[ https://issues.apache.org/jira/browse/SPARK-34183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-34183: - Priority: Blocker (was: Major) > DataSource V2: Support required distribution and

[jira] [Created] (SPARK-34183) DataSource V2: Support required distribution and ordering in SS

Anton Okolnychyi created SPARK-34183: Summary: DataSource V2: Support required distribution and ordering in SS Key: SPARK-34183 URL: https://issues.apache.org/jira/browse/SPARK-34183 Project:

[jira] [Updated] (SPARK-34133) [AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching

[ https://issues.apache.org/jira/browse/SPARK-34133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-34133: Summary: [AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching (was:

[jira] [Updated] (SPARK-34133) [AVRO] Respect case sensitivity when performing Catalyst-to-Avro field matching

[ https://issues.apache.org/jira/browse/SPARK-34133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-34133: Description: Spark SQL is normally case-insensitive (by default), but currently when

[jira] [Updated] (SPARK-34182) [AVRO] Improve error messages when matching Catalyst-to-Avro schemas

[ https://issues.apache.org/jira/browse/SPARK-34182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-34182: Issue Type: Improvement (was: Bug) > [AVRO] Improve error messages when matching

[jira] [Created] (SPARK-34182) [AVRO] Improve error messages when matching Catalyst-to-Avro schemas

Erik Krogen created SPARK-34182: --- Summary: [AVRO] Improve error messages when matching Catalyst-to-Avro schemas Key: SPARK-34182 URL: https://issues.apache.org/jira/browse/SPARK-34182 Project: Spark

[jira] [Commented] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled when writing to tables

[ https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268721#comment-17268721 ] Apache Spark commented on SPARK-34144: -- User 'cristichircu' has created a pull request for this

[jira] [Commented] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled when writing to tables

[ https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268720#comment-17268720 ] Apache Spark commented on SPARK-34144: -- User 'cristichircu' has created a pull request for this

[jira] [Assigned] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled when writing to tables

[ https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34144: Assignee: Apache Spark > java.time.Instant and java.time.LocalDate not handled when

[jira] [Assigned] (SPARK-34144) java.time.Instant and java.time.LocalDate not handled when writing to tables

[ https://issues.apache.org/jira/browse/SPARK-34144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34144: Assignee: (was: Apache Spark) > java.time.Instant and java.time.LocalDate not

[jira] [Updated] (SPARK-34180) Fix the regression brought by SPARK-33888 for PostgresDialect

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression brought by SPARK-33888 for PostgresDialect (was: Fix the

[jira] [Resolved] (SPARK-34178) Copy tags for the new node created by MultiInstanceRelation.newInstance

[ https://issues.apache.org/jira/browse/SPARK-34178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34178. - Fix Version/s: 3.1.2 3.0.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34178) Copy tags for the new node created by MultiInstanceRelation.newInstance

[ https://issues.apache.org/jira/browse/SPARK-34178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34178: --- Assignee: wuyi > Copy tags for the new node created by MultiInstanceRelation.newInstance >

[jira] [Commented] (SPARK-32048) PySpark: error in serializing ML pipelines with training strategy and pipeline as estimator

[ https://issues.apache.org/jira/browse/SPARK-32048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268561#comment-17268561 ] Hyukjin Kwon commented on SPARK-32048: -- I think the commits you pointed out would likely be ported

[jira] [Commented] (SPARK-32048) PySpark: error in serializing ML pipelines with training strategy and pipeline as estimator

[ https://issues.apache.org/jira/browse/SPARK-32048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268560#comment-17268560 ] Hyukjin Kwon commented on SPARK-32048: -- Thanks [~nmarcott] for assessing tickets. > PySpark: error

[jira] [Resolved] (SPARK-32048) PySpark: error in serializing ML pipelines with training strategy and pipeline as estimator

[ https://issues.apache.org/jira/browse/SPARK-32048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32048. -- Resolution: Cannot Reproduce > PySpark: error in serializing ML pipelines with training

[jira] [Commented] (SPARK-32048) PySpark: error in serializing ML pipelines with training strategy and pipeline as estimator

[ https://issues.apache.org/jira/browse/SPARK-32048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268546#comment-17268546 ] Nicholas Brett Marcott commented on SPARK-32048: friendly ping + others [~hyukjin.kwon]

[jira] [Updated] (SPARK-34005) Update peak memory metrics for each Executor on task end.

[ https://issues.apache.org/jira/browse/SPARK-34005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34005: --- Affects Version/s: 3.1.0 > Update peak memory metrics for each Executor on task end. >

[jira] [Updated] (SPARK-34005) Update peak memory metrics for each Executor on task end.

[ https://issues.apache.org/jira/browse/SPARK-34005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34005: --- Fix Version/s: 3.1.0 > Update peak memory metrics for each Executor on task end. >

[jira] [Updated] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat updated SPARK-34179: Description: *Issue 1 :* *array_sort examples provided in

[jira] [Commented] (SPARK-34181) Update build doc help document

[ https://issues.apache.org/jira/browse/SPARK-34181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268525#comment-17268525 ] Apache Spark commented on SPARK-34181: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34181) Update build doc help document

[ https://issues.apache.org/jira/browse/SPARK-34181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34181: Assignee: Apache Spark > Update build doc help document > --

[jira] [Assigned] (SPARK-34181) Update build doc help document

[ https://issues.apache.org/jira/browse/SPARK-34181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34181: Assignee: (was: Apache Spark) > Update build doc help document >

[jira] [Created] (SPARK-34181) Update build doc help document

angerszhu created SPARK-34181: - Summary: Update build doc help document Key: SPARK-34181 URL: https://issues.apache.org/jira/browse/SPARK-34181 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat updated SPARK-34179: Description: *array_sort examples provided in

[jira] [Updated] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat updated SPARK-34179: Description: *array_sort examples provided in

[jira] [Updated] (SPARK-34179) examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not working

[ https://issues.apache.org/jira/browse/SPARK-34179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat updated SPARK-34179: Summary: examples provided in https://spark.apache.org/docs/latest/api/sql/index.html link not

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268512#comment-17268512 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268510#comment-17268510 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268511#comment-17268511 ] Apache Spark commented on SPARK-33888: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34180: Assignee: Apache Spark (was: Kousuke Saruta) > Fix the regression for PostgresDialect

[jira] [Assigned] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34180: Assignee: Apache Spark (was: Kousuke Saruta) > Fix the regression for PostgresDialect

[jira] [Commented] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268508#comment-17268508 ] Apache Spark commented on SPARK-34180: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34180: Assignee: Kousuke Saruta (was: Apache Spark) > Fix the regression for PostgresDialect

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: PostgresDIalect#getCatalystType throws Exception for array types. It's a

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Description: PostgresDIalect#getCatalystType throws Exception for ArrayTypes. It's a

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-33888

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Summary: Fix the regression for PostgresDialect brought by SPARK-33888 (was: Fix the

[jira] [Created] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-

Kousuke Saruta created SPARK-34180: -- Summary: Fix the regression for PostgresDialect brought by SPARK- Key: SPARK-34180 URL: https://issues.apache.org/jira/browse/SPARK-34180 Project: Spark

[jira] [Updated] (SPARK-34180) Fix the regression for PostgresDialect brought by SPARK-

[ https://issues.apache.org/jira/browse/SPARK-34180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34180: --- Issue Type: Bug (was: Improvement) > Fix the regression for PostgresDialect brought by

[jira] [Created] (SPARK-34179) array_sort examples provided in https://spark.apache.org/docs/latest/api/sql/index.html#array_sort link not working

Chetan Bhat created SPARK-34179: --- Summary: array_sort examples provided in https://spark.apache.org/docs/latest/api/sql/index.html#array_sort link not working Key: SPARK-34179 URL:

[jira] [Commented] (SPARK-34005) Update peak memory metrics for each Executor on task end.

[ https://issues.apache.org/jira/browse/SPARK-34005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268480#comment-17268480 ] Apache Spark commented on SPARK-34005: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34178) Copy tags for the new node created by MultiInstanceRelation.newInstance

[ https://issues.apache.org/jira/browse/SPARK-34178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34178: Assignee: Apache Spark > Copy tags for the new node created by

  1   2   >