[jira] [Updated] (SPARK-46453) SessionHolder doesn't throw exceptions from internalError()

[ https://issues.apache.org/jira/browse/SPARK-46453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46453: --- Labels: pull-request-available (was: ) > SessionHolder doesn't throw exceptions from

[jira] [Created] (SPARK-46453) SessionHolder doesn't throw exceptions from internalError()

Max Gekk created SPARK-46453: Summary: SessionHolder doesn't throw exceptions from internalError() Key: SPARK-46453 URL: https://issues.apache.org/jira/browse/SPARK-46453 Project: Spark Issue

[jira] [Updated] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

[ https://issues.apache.org/jira/browse/SPARK-46452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46452: --- Labels: pull-request-available (was: ) > Add a new API in DSv2 DataWriter to write an

[jira] [Created] (SPARK-46452) Add a new API in DSv2 DataWriter to write an iterator of records

Allison Wang created SPARK-46452: Summary: Add a new API in DSv2 DataWriter to write an iterator of records Key: SPARK-46452 URL: https://issues.apache.org/jira/browse/SPARK-46452 Project: Spark

[jira] [Updated] (SPARK-46451) Reorganize `GroupbyStatTests`

[ https://issues.apache.org/jira/browse/SPARK-46451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46451: --- Labels: pull-request-available (was: ) > Reorganize `GroupbyStatTests` >

[jira] [Created] (SPARK-46451) Reorganize `GroupbyStatTests`

Ruifeng Zheng created SPARK-46451: - Summary: Reorganize `GroupbyStatTests` Key: SPARK-46451 URL: https://issues.apache.org/jira/browse/SPARK-46451 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46446. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44401

[jira] [Assigned] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46446: --- Assignee: Jack Chen > Correctness bug in correlated subquery with OFFSET >

[jira] [Assigned] (SPARK-46308) Forbid recursive error handling by adding recursion guards

[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46308: Assignee: Alice Sayutina > Forbid recursive error handling by adding recursion guards >

[jira] [Resolved] (SPARK-46308) Forbid recursive error handling by adding recursion guards

[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46308. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44210

[jira] [Commented] (SPARK-46450) session_window doesn't identify sessions with provided gap when used as a window function

[ https://issues.apache.org/jira/browse/SPARK-46450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798381#comment-17798381 ] Jungtaek Lim commented on SPARK-46450: -- It's a missing one and maybe we will have to document -

[jira] [Comment Edited] (SPARK-46450) session_window doesn't identify sessions with provided gap when used as a window function

[ https://issues.apache.org/jira/browse/SPARK-46450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798381#comment-17798381 ] Jungtaek Lim edited comment on SPARK-46450 at 12/18/23 11:37 PM: - It's a

[jira] [Created] (SPARK-46450) session_window doesn't identify sessions with provided gap when used as a window function

Juan Pumarino created SPARK-46450: - Summary: session_window doesn't identify sessions with provided gap when used as a window function Key: SPARK-46450 URL: https://issues.apache.org/jira/browse/SPARK-46450

[jira] [Resolved] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46411. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44359

[jira] [Assigned] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test

[ https://issues.apache.org/jira/browse/SPARK-46411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46411: - Assignee: Yang Jie > Change to use bcprov/bcpkix-jdk18on for test >

[jira] [Updated] (SPARK-46447) Remove the legacy datetime rebasing SQL configs

[ https://issues.apache.org/jira/browse/SPARK-46447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46447: --- Labels: pull-request-available (was: ) > Remove the legacy datetime rebasing SQL configs >

[jira] [Resolved] (SPARK-46439) Move IO-related tests to `pyspark.pandas.tests.io.*`

[ https://issues.apache.org/jira/browse/SPARK-46439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46439. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44395

[jira] [Resolved] (SPARK-46420) Remove unused transport from SparkSQLCLIDriver

[ https://issues.apache.org/jira/browse/SPARK-46420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46420. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44370

[jira] [Assigned] (SPARK-46289) Exception when ordering by UDT in interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-46289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46289: - Assignee: Bruce Robbins > Exception when ordering by UDT in interpreted mode >

[jira] [Resolved] (SPARK-46289) Exception when ordering by UDT in interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-46289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46289. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44361

[jira] [Resolved] (SPARK-46438) Fix the scope of toggleFlamegraph and improve test

[ https://issues.apache.org/jira/browse/SPARK-46438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46438. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44394

[jira] [Created] (SPARK-46449) Add ability to create databases via Catalog API

Nicholas Chammas created SPARK-46449: Summary: Add ability to create databases via Catalog API Key: SPARK-46449 URL: https://issues.apache.org/jira/browse/SPARK-46449 Project: Spark

[jira] [Updated] (SPARK-46448) InlineTable column should be nullable when converted to Decimal might cause null

[ https://issues.apache.org/jira/browse/SPARK-46448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-46448: - Summary: InlineTable column should be nullable when converted to Decimal might cause null (was:

[jira] [Created] (SPARK-46448) InlineTable column should be nullable when converted to Decimal and overflow

Rui Wang created SPARK-46448: Summary: InlineTable column should be nullable when converted to Decimal and overflow Key: SPARK-46448 URL: https://issues.apache.org/jira/browse/SPARK-46448 Project: Spark

[jira] [Updated] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46446: --- Labels: pull-request-available (was: ) > Correctness bug in correlated subquery with

[jira] [Updated] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Chen updated SPARK-46446: -- Description: Subqueries with correlation under LIMIT with OFFSET have a correctness bug, introduced

[jira] [Updated] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

[ https://issues.apache.org/jira/browse/SPARK-46446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jack Chen updated SPARK-46446: -- Description: Subqueries with correlation under LIMIT with OFFSET have a correctness bug, introduced

[jira] [Commented] (SPARK-33144) Connot insert overwite multiple partition, get exception "get partition: Value for key name is null or empty"

[ https://issues.apache.org/jira/browse/SPARK-33144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17798232#comment-17798232 ] Wan Kun commented on SPARK-33144: - Speculative task also can cause this issue:   Spark Driver Log

[jira] [Created] (SPARK-46446) Correctness bug in correlated subquery with OFFSET

Jack Chen created SPARK-46446: - Summary: Correctness bug in correlated subquery with OFFSET Key: SPARK-46446 URL: https://issues.apache.org/jira/browse/SPARK-46446 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-43474) Add support to create DataFrame Reference in Spark connect

[ https://issues.apache.org/jira/browse/SPARK-43474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43474: --- Labels: pull-request-available (was: ) > Add support to create DataFrame Reference in

[jira] [Updated] (SPARK-37377) SPJ: Initial implementation of Storage-Partitioned Join

[ https://issues.apache.org/jira/browse/SPARK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37377: --- Labels: pull-request-available (was: ) > SPJ: Initial implementation of

[jira] [Updated] (SPARK-40295) Allow v2 functions with literal args in write distribution and ordering

[ https://issues.apache.org/jira/browse/SPARK-40295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-40295: --- Labels: pull-request-available (was: ) > Allow v2 functions with literal args in write

[jira] [Created] (SPARK-46445) V2ExpressionUtils.toCatalystTransformOpt throws when resolving the bucket/sorted_bucket functions

Никита Соколов created SPARK-46445: -- Summary: V2ExpressionUtils.toCatalystTransformOpt throws when resolving the bucket/sorted_bucket functions Key: SPARK-46445 URL:

[jira] [Updated] (SPARK-46444) V2SessionCatalog#createTable should not load the table

[ https://issues.apache.org/jira/browse/SPARK-46444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46444: --- Labels: pull-request-available (was: ) > V2SessionCatalog#createTable should not load the

[jira] [Created] (SPARK-46444) V2SessionCatalog#createTable should not load the table

Wenchen Fan created SPARK-46444: --- Summary: V2SessionCatalog#createTable should not load the table Key: SPARK-46444 URL: https://issues.apache.org/jira/browse/SPARK-46444 Project: Spark Issue

[jira] [Updated] (SPARK-46443) Decimal precision and scale should decided by JDBC dialect.

[ https://issues.apache.org/jira/browse/SPARK-46443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46443: --- Summary: Decimal precision and scale should decided by JDBC dialect. (was: Ensure Decimal

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45525: -- Assignee: (was: Apache Spark) > Initial support for Python data source write API

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45525: -- Assignee: Apache Spark > Initial support for Python data source write API >

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45525: -- Assignee: (was: Apache Spark) > Initial support for Python data source write API

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45525: -- Assignee: Apache Spark > Initial support for Python data source write API >

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-40876: -- Assignee: (was: Apache Spark) > Spark's Vectorized ParquetReader should support

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45525: -- Assignee: (was: Apache Spark) > Initial support for Python data source write API

[jira] [Assigned] (SPARK-45525) Initial support for Python data source write API

[ https://issues.apache.org/jira/browse/SPARK-45525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45525: -- Assignee: Apache Spark > Initial support for Python data source write API >

[jira] [Assigned] (SPARK-40876) Spark's Vectorized ParquetReader should support type promotions

[ https://issues.apache.org/jira/browse/SPARK-40876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-40876: -- Assignee: Apache Spark > Spark's Vectorized ParquetReader should support type

[jira] [Resolved] (SPARK-46440) Set the rebase configs to the CORRECTED mode by default

[ https://issues.apache.org/jira/browse/SPARK-46440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46440. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44388