[jira] [Created] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

2024-01-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46606: --- Summary: Refine docstring of `convert_timezone/make_dt_interval/make_interval` Key: SPARK-46606 URL: https://issues.apache.org/jira/browse/SPARK-46606 Project: Spark

[jira] [Resolved] (SPARK-46568) Python data source options should be a case insensitive dictionary

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46568. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44564

[jira] [Updated] (SPARK-46605) Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46605: --- Labels: pull-request-available (was: ) > Make `lit/typedLit` function in connect module

[jira] [Assigned] (SPARK-46568) Python data source options should be a case insensitive dictionary

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46568: - Assignee: Allison Wang > Python data source options should be a case insensitive

[jira] [Created] (SPARK-46605) Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46605: Summary: Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq` Key: SPARK-46605 URL: https://issues.apache.org/jira/browse/SPARK-46605 Project:

[jira] [Updated] (SPARK-46604) Make `Literal.apply` support `s.c.immuable.ArraySeq`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46604: --- Labels: pull-request-available (was: ) > Make `Literal.apply` support

[jira] [Created] (SPARK-46604) Make `Literal.apply` support `s.c.immuable.ArraySeq`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46604: Summary: Make `Literal.apply` support `s.c.immuable.ArraySeq` Key: SPARK-46604 URL: https://issues.apache.org/jira/browse/SPARK-46604 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46601) Fix log error in handleStatusMessage

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46601: --- Labels: pull-request-available (was: ) > Fix log error in handleStatusMessage >

[jira] [Updated] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46603: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Created] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46603: Summary: Refine docstring of `parse_url/url_encode/url_decode` Key: SPARK-46603 URL: https://issues.apache.org/jira/browse/SPARK-46603 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46595. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44595

[jira] [Assigned] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46595: Assignee: Yang Jie > Refine docstring of `map_from_arrays/map_from_entries/map_concat` >

[jira] [Updated] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46602: --- Labels: pull-request-available (was: ) > CREATE VIEW IF NOT EXISTS should never throw

[jira] [Resolved] (SPARK-46560) Refine docstring `reverse/map_contains_key`

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46560. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44561

[jira] [Assigned] (SPARK-46560) Refine docstring `reverse/map_contains_key`

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46560: - Assignee: BingKun Pan > Refine docstring `reverse/map_contains_key` >

[jira] [Created] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

2024-01-04 Thread Xinyi Yu (Jira)
Xinyi Yu created SPARK-46602: Summary: CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception Key: SPARK-46602 URL: https://issues.apache.org/jira/browse/SPARK-46602

[jira] [Assigned] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46586: - Assignee: BingKun Pan > Support `s.c.immutable.ArraySeq` as `customCollectionCls` in

[jira] [Resolved] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46586. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44591

[jira] [Resolved] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

2024-01-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46179. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44084

[jira] [Assigned] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

2024-01-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46179: --- Assignee: Andy Lam > Generate golden files for SQLQueryTestSuites with Postgres >

[jira] [Updated] (SPARK-46600) Move shared code between SqlConf and SqlApiConf to another object

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46600: --- Labels: pull-request-available (was: ) > Move shared code between SqlConf and SqlApiConf

[jira] [Created] (SPARK-46601) Fix log error in handleStatusMessage

2024-01-04 Thread qingbo jiao (Jira)
qingbo jiao created SPARK-46601: --- Summary: Fix log error in handleStatusMessage Key: SPARK-46601 URL: https://issues.apache.org/jira/browse/SPARK-46601 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46600) Move shared code between SqlConf and SqlApiConf to another object

2024-01-04 Thread Rui Wang (Jira)
Rui Wang created SPARK-46600: Summary: Move shared code between SqlConf and SqlApiConf to another object Key: SPARK-46600 URL: https://issues.apache.org/jira/browse/SPARK-46600 Project: Spark

[jira] [Updated] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46599: --- Labels: pull-request-available (was: ) > XML: Use TypeCoercion.findTightestCommonType for

[jira] [Created] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

2024-01-04 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-46599: --- Summary: XML: Use TypeCoercion.findTightestCommonType for compatibility check Key: SPARK-46599 URL: https://issues.apache.org/jira/browse/SPARK-46599 Project:

[jira] [Resolved] (SPARK-46593) Refactor `data_type_ops` tests

2024-01-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46593. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44592

[jira] [Assigned] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46596: Assignee: Yang Jie > Correct package name of `SslTestUtils` >

[jira] [Resolved] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46596. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44596

[jira] [Resolved] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

2024-01-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46597. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44597

[jira] [Assigned] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

2024-01-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46597: Assignee: Yang Jie > Optimize the command used to execute tests in the doc of >

[jira] [Resolved] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

2024-01-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46592. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44594

[jira] [Assigned] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

2024-01-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46592: Assignee: Kent Yao > OracleIntegrationSuite is flaky because of ORA-04021 >

[jira] [Resolved] (SPARK-45527) Task fraction resource request is not expected

2024-01-04 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-45527. --- Resolution: Fixed > Task fraction resource request is not expected >

[jira] [Updated] (SPARK-45527) Task fraction resource request is not expected

2024-01-04 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-45527: -- Fix Version/s: 4.0.0 > Task fraction resource request is not expected >

[jira] [Assigned] (SPARK-45527) Task fraction resource request is not expected

2024-01-04 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-45527: - Assignee: Bobby Wang > Task fraction resource request is not expected >

[jira] [Updated] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46598: --- Labels: pull-request-available (was: ) > OrcColumnarBatchReader should respect the memory

[jira] [Created] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

2024-01-04 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46598: --- Summary: OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column Key: SPARK-46598 URL:

[jira] [Updated] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46597: --- Labels: pull-request-available (was: ) > Optimize the command used to execute tests in the

[jira] [Updated] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46596: - Priority: Minor (was: Major) > Correct package name of `SslTestUtils` >

[jira] [Created] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46597: Summary: Optimize the command used to execute tests in the doc of `docker-integration-tests` Key: SPARK-46597 URL: https://issues.apache.org/jira/browse/SPARK-46597 Project:

[jira] [Updated] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46596: --- Labels: pull-request-available (was: ) > Correct package name of `SslTestUtils` >

[jira] [Created] (SPARK-46596) Correct package name of `SslTestUtils`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46596: Summary: Correct package name of `SslTestUtils` Key: SPARK-46596 URL: https://issues.apache.org/jira/browse/SPARK-46596 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46595: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Created] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

2024-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-46595: Summary: Refine docstring of `map_from_arrays/map_from_entries/map_concat` Key: SPARK-46595 URL: https://issues.apache.org/jira/browse/SPARK-46595 Project: Spark

[jira] [Resolved] (SPARK-46569) Remove ThreadLocal due to SecureRandom is thread safe since JDK9

2024-01-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46569. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44577

[jira] [Updated] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46592: --- Labels: pull-request-available (was: ) > OracleIntegrationSuite is flaky because of

[jira] [Updated] (SPARK-46594) The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46594: --- Labels: pull-request-available (was: ) > The description of

[jira] [Created] (SPARK-46594) The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service`

2024-01-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46594: --- Summary: The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service` Key: SPARK-46594 URL:

[jira] [Updated] (SPARK-46593) Refactor `data_type_ops` tests

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46593: --- Labels: pull-request-available (was: ) > Refactor `data_type_ops` tests >

[jira] [Created] (SPARK-46593) Refactor `data_type_ops` tests

2024-01-04 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46593: - Summary: Refactor `data_type_ops` tests Key: SPARK-46593 URL: https://issues.apache.org/jira/browse/SPARK-46593 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

2024-01-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-46592: Summary: OracleIntegrationSuite is flaky because of ORA-04021 Key: SPARK-46592 URL: https://issues.apache.org/jira/browse/SPARK-46592 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46590) Coalesce partiton assert error after skew join optimization

2024-01-04 Thread Jackey Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jackey Lee updated SPARK-46590: --- Attachment: problem.log > Coalesce partiton assert error after skew join optimization >

[jira] [Created] (SPARK-46590) Coalesce partiton assert error after skew join optimization

2024-01-04 Thread Jackey Lee (Jira)
Jackey Lee created SPARK-46590: -- Summary: Coalesce partiton assert error after skew join optimization Key: SPARK-46590 URL: https://issues.apache.org/jira/browse/SPARK-46590 Project: Spark

[jira] [Resolved] (SPARK-46585) `metricPeaks` can be directly constructed as an immutable.ArraySeq instead of use `mutable.ArraySeq.toSeq` in `Executor`

2024-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46585. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44586

[jira] [Updated] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

2024-01-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46586: --- Labels: pull-request-available (was: ) > Support `s.c.immutable.ArraySeq` as