[jira] [Created] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

BingKun Pan created SPARK-46606: --- Summary: Refine docstring of `convert_timezone/make_dt_interval/make_interval` Key: SPARK-46606 URL: https://issues.apache.org/jira/browse/SPARK-46606 Project: Spark

[jira] [Resolved] (SPARK-46568) Python data source options should be a case insensitive dictionary

[ https://issues.apache.org/jira/browse/SPARK-46568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46568. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44564 [https://

[jira] [Updated] (SPARK-46605) Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq`

[ https://issues.apache.org/jira/browse/SPARK-46605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46605: --- Labels: pull-request-available (was: ) > Make `lit/typedLit` function in connect module sup

[jira] [Assigned] (SPARK-46568) Python data source options should be a case insensitive dictionary

[ https://issues.apache.org/jira/browse/SPARK-46568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46568: - Assignee: Allison Wang > Python data source options should be a case insensitive dictio

[jira] [Created] (SPARK-46605) Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq`

Yang Jie created SPARK-46605: Summary: Make `lit/typedLit` function in connect module support `s.c.immutable.ArraySeq` Key: SPARK-46605 URL: https://issues.apache.org/jira/browse/SPARK-46605 Project: Spar

[jira] [Updated] (SPARK-46604) Make `Literal.apply` support `s.c.immuable.ArraySeq`

[ https://issues.apache.org/jira/browse/SPARK-46604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46604: --- Labels: pull-request-available (was: ) > Make `Literal.apply` support `s.c.immuable.ArraySe

[jira] [Created] (SPARK-46604) Make `Literal.apply` support `s.c.immuable.ArraySeq`

Yang Jie created SPARK-46604: Summary: Make `Literal.apply` support `s.c.immuable.ArraySeq` Key: SPARK-46604 URL: https://issues.apache.org/jira/browse/SPARK-46604 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-46601) Fix log error in handleStatusMessage

[ https://issues.apache.org/jira/browse/SPARK-46601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46601: --- Labels: pull-request-available (was: ) > Fix log error in handleStatusMessage > ---

[jira] [Updated] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

[ https://issues.apache.org/jira/browse/SPARK-46603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46603: --- Labels: pull-request-available (was: ) > Refine docstring of `parse_url/url_encode/url_deco

[jira] [Created] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

Yang Jie created SPARK-46603: Summary: Refine docstring of `parse_url/url_encode/url_decode` Key: SPARK-46603 URL: https://issues.apache.org/jira/browse/SPARK-46603 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46595. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44595 [https://github.com

[jira] [Assigned] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46595: Assignee: Yang Jie > Refine docstring of `map_from_arrays/map_from_entries/map_concat` >

[jira] [Updated] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

[ https://issues.apache.org/jira/browse/SPARK-46602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46602: --- Labels: pull-request-available (was: ) > CREATE VIEW IF NOT EXISTS should never throw `TABL

[jira] [Resolved] (SPARK-46560) Refine docstring `reverse/map_contains_key`

[ https://issues.apache.org/jira/browse/SPARK-46560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46560. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44561 [https://

[jira] [Assigned] (SPARK-46560) Refine docstring `reverse/map_contains_key`

[ https://issues.apache.org/jira/browse/SPARK-46560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46560: - Assignee: BingKun Pan > Refine docstring `reverse/map_contains_key` > -

[jira] [Created] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception

Xinyi Yu created SPARK-46602: Summary: CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception Key: SPARK-46602 URL: https://issues.apache.org/jira/browse/SPARK-46602 Project

[jira] [Assigned] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46586: - Assignee: BingKun Pan > Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `M

[jira] [Resolved] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46586. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44591 [https://

[jira] [Resolved] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46179. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44084 [https://gith

[jira] [Assigned] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

[ https://issues.apache.org/jira/browse/SPARK-46179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46179: --- Assignee: Andy Lam > Generate golden files for SQLQueryTestSuites with Postgres > -

[jira] [Updated] (SPARK-46600) Move shared code between SqlConf and SqlApiConf to another object

[ https://issues.apache.org/jira/browse/SPARK-46600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46600: --- Labels: pull-request-available (was: ) > Move shared code between SqlConf and SqlApiConf to

[jira] [Created] (SPARK-46601) Fix log error in handleStatusMessage

qingbo jiao created SPARK-46601: --- Summary: Fix log error in handleStatusMessage Key: SPARK-46601 URL: https://issues.apache.org/jira/browse/SPARK-46601 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46600) Move shared code between SqlConf and SqlApiConf to another object

Rui Wang created SPARK-46600: Summary: Move shared code between SqlConf and SqlApiConf to another object Key: SPARK-46600 URL: https://issues.apache.org/jira/browse/SPARK-46600 Project: Spark Is

[jira] [Updated] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

[ https://issues.apache.org/jira/browse/SPARK-46599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46599: --- Labels: pull-request-available (was: ) > XML: Use TypeCoercion.findTightestCommonType for c

[jira] [Created] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

Sandip Agarwala created SPARK-46599: --- Summary: XML: Use TypeCoercion.findTightestCommonType for compatibility check Key: SPARK-46599 URL: https://issues.apache.org/jira/browse/SPARK-46599 Project: S

[jira] [Resolved] (SPARK-46593) Refactor `data_type_ops` tests

[ https://issues.apache.org/jira/browse/SPARK-46593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46593. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44592 [https://

[jira] [Assigned] (SPARK-46596) Correct package name of `SslTestUtils`

[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46596: Assignee: Yang Jie > Correct package name of `SslTestUtils` > ---

[jira] [Resolved] (SPARK-46596) Correct package name of `SslTestUtils`

[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46596. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44596 [https://github.com

[jira] [Resolved] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

[ https://issues.apache.org/jira/browse/SPARK-46597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46597. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44597 [https://github.com

[jira] [Assigned] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

[ https://issues.apache.org/jira/browse/SPARK-46597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46597: Assignee: Yang Jie > Optimize the command used to execute tests in the doc of > `docker-integrat

[jira] [Assigned] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

[ https://issues.apache.org/jira/browse/SPARK-46592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46592: Assignee: Kent Yao > OracleIntegrationSuite is flaky because of ORA-04021 > -

[jira] [Resolved] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

[ https://issues.apache.org/jira/browse/SPARK-46592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46592. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44594 [https://github.com

[jira] [Resolved] (SPARK-45527) Task fraction resource request is not expected

[ https://issues.apache.org/jira/browse/SPARK-45527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-45527. --- Resolution: Fixed > Task fraction resource request is not expected > ---

[jira] [Updated] (SPARK-45527) Task fraction resource request is not expected

[ https://issues.apache.org/jira/browse/SPARK-45527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-45527: -- Fix Version/s: 4.0.0 > Task fraction resource request is not expected > --

[jira] [Assigned] (SPARK-45527) Task fraction resource request is not expected

[ https://issues.apache.org/jira/browse/SPARK-45527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-45527: - Assignee: Bobby Wang > Task fraction resource request is not expected > ---

[jira] [Updated] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

[ https://issues.apache.org/jira/browse/SPARK-46598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46598: --- Labels: pull-request-available (was: ) > OrcColumnarBatchReader should respect the memory m

[jira] [Created] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column

Wenchen Fan created SPARK-46598: --- Summary: OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column Key: SPARK-46598 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

[ https://issues.apache.org/jira/browse/SPARK-46597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46597: --- Labels: pull-request-available (was: ) > Optimize the command used to execute tests in the

[jira] [Updated] (SPARK-46596) Correct package name of `SslTestUtils`

[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46596: - Priority: Minor (was: Major) > Correct package name of `SslTestUtils` > ---

[jira] [Created] (SPARK-46597) Optimize the command used to execute tests in the doc of `docker-integration-tests`

Yang Jie created SPARK-46597: Summary: Optimize the command used to execute tests in the doc of `docker-integration-tests` Key: SPARK-46597 URL: https://issues.apache.org/jira/browse/SPARK-46597 Project:

[jira] [Updated] (SPARK-46596) Correct package name of `SslTestUtils`

[ https://issues.apache.org/jira/browse/SPARK-46596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46596: --- Labels: pull-request-available (was: ) > Correct package name of `SslTestUtils` > -

[jira] [Created] (SPARK-46596) Correct package name of `SslTestUtils`

Yang Jie created SPARK-46596: Summary: Correct package name of `SslTestUtils` Key: SPARK-46596 URL: https://issues.apache.org/jira/browse/SPARK-46596 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

[ https://issues.apache.org/jira/browse/SPARK-46595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46595: --- Labels: pull-request-available (was: ) > Refine docstring of `map_from_arrays/map_from_entr

[jira] [Created] (SPARK-46595) Refine docstring of `map_from_arrays/map_from_entries/map_concat`

Yang Jie created SPARK-46595: Summary: Refine docstring of `map_from_arrays/map_from_entries/map_concat` Key: SPARK-46595 URL: https://issues.apache.org/jira/browse/SPARK-46595 Project: Spark Is

[jira] [Resolved] (SPARK-46569) Remove ThreadLocal due to SecureRandom is thread safe since JDK9

[ https://issues.apache.org/jira/browse/SPARK-46569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46569. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44577 [https://

[jira] [Updated] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

[ https://issues.apache.org/jira/browse/SPARK-46592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46592: --- Labels: pull-request-available (was: ) > OracleIntegrationSuite is flaky because of ORA-040

[jira] [Updated] (SPARK-46594) The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service`

[ https://issues.apache.org/jira/browse/SPARK-46594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46594: --- Labels: pull-request-available (was: ) > The description of `spark.yarn.shuffle.server.reco

[jira] [Created] (SPARK-46594) The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service`

BingKun Pan created SPARK-46594: --- Summary: The description of `spark.yarn.shuffle.server.recovery.disabled` should be in chapter `Configuring the External Shuffle Service` Key: SPARK-46594 URL: https://issues.apach

[jira] [Updated] (SPARK-46593) Refactor `data_type_ops` tests

[ https://issues.apache.org/jira/browse/SPARK-46593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46593: --- Labels: pull-request-available (was: ) > Refactor `data_type_ops` tests > -

[jira] [Created] (SPARK-46593) Refactor `data_type_ops` tests

Ruifeng Zheng created SPARK-46593: - Summary: Refactor `data_type_ops` tests Key: SPARK-46593 URL: https://issues.apache.org/jira/browse/SPARK-46593 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46592) OracleIntegrationSuite is flaky because of ORA-04021

Kent Yao created SPARK-46592: Summary: OracleIntegrationSuite is flaky because of ORA-04021 Key: SPARK-46592 URL: https://issues.apache.org/jira/browse/SPARK-46592 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-46590) Coalesce partiton assert error after skew join optimization

[ https://issues.apache.org/jira/browse/SPARK-46590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jackey Lee updated SPARK-46590: --- Attachment: problem.log > Coalesce partiton assert error after skew join optimization >

[jira] [Created] (SPARK-46590) Coalesce partiton assert error after skew join optimization

Jackey Lee created SPARK-46590: -- Summary: Coalesce partiton assert error after skew join optimization Key: SPARK-46590 URL: https://issues.apache.org/jira/browse/SPARK-46590 Project: Spark Issu

[jira] [Resolved] (SPARK-46585) `metricPeaks` can be directly constructed as an immutable.ArraySeq instead of use `mutable.ArraySeq.toSeq` in `Executor`

[ https://issues.apache.org/jira/browse/SPARK-46585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46585. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44586 [https://github.com

[jira] [Updated] (SPARK-46586) Support `s.c.immutable.ArraySeq` as `customCollectionCls` in `MapObjects`

[ https://issues.apache.org/jira/browse/SPARK-46586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46586: --- Labels: pull-request-available (was: ) > Support `s.c.immutable.ArraySeq` as `customCollect