[jira] [Resolved] (SPARK-37039) np.nan series.astype(bool) should be True

[ https://issues.apache.org/jira/browse/SPARK-37039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37039. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44570

[jira] [Resolved] (SPARK-46633) Reading a non-empty Avro file with empty blocks returns 0 records

[ https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46633. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44635

[jira] [Assigned] (SPARK-46633) Reading a non-empty Avro file with empty blocks returns 0 records

[ https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46633: Assignee: Ivan Sadikov > Reading a non-empty Avro file with empty blocks returns 0

[jira] [Assigned] (SPARK-46437) Enable conditional includes in Jekyll documentation

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46437: Assignee: Nicholas Chammas > Enable conditional includes in Jekyll documentation >

[jira] [Resolved] (SPARK-46437) Enable conditional includes in Jekyll documentation

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44630

[jira] [Resolved] (SPARK-46593) Refactor `data_type_ops` tests

[ https://issues.apache.org/jira/browse/SPARK-46593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46593. -- Resolution: Fixed Issue resolved by pull request 44637

[jira] [Resolved] (SPARK-46637) Enhancing the Visual Appeal of Spark doc website

[ https://issues.apache.org/jira/browse/SPARK-46637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46637. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44642

[jira] [Resolved] (SPARK-46630) XML: Validate XML element name on write

[ https://issues.apache.org/jira/browse/SPARK-46630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46630. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44634

[jira] [Assigned] (SPARK-46630) XML: Validate XML element name on write

[ https://issues.apache.org/jira/browse/SPARK-46630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46630: Assignee: Sandip Agarwala > XML: Validate XML element name on write >

[jira] [Assigned] (SPARK-46626) Bump jekyll version to support Ruby 3.3

[ https://issues.apache.org/jira/browse/SPARK-46626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46626: Assignee: Nicholas Chammas > Bump jekyll version to support Ruby 3.3 >

[jira] [Resolved] (SPARK-46626) Bump jekyll version to support Ruby 3.3

[ https://issues.apache.org/jira/browse/SPARK-46626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46626. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44628

[jira] [Updated] (SPARK-46621) Address null from Exception.getMessage in Py4J captured exception

[ https://issues.apache.org/jira/browse/SPARK-46621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46621: - Priority: Minor (was: Major) > Address null from Exception.getMessage in Py4J captured

[jira] [Updated] (SPARK-46621) Address null from Exception.getMessage in Py4J captured exception

[ https://issues.apache.org/jira/browse/SPARK-46621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46621: - Description: If JVM throws an exception without a message, the message becomes null and

[jira] [Assigned] (SPARK-46601) Fix log error in handleStatusMessage

[ https://issues.apache.org/jira/browse/SPARK-46601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46601: Assignee: qingbo jiao > Fix log error in handleStatusMessage >

[jira] [Resolved] (SPARK-46601) Fix log error in handleStatusMessage

[ https://issues.apache.org/jira/browse/SPARK-46601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46601. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44606

[jira] [Resolved] (SPARK-46522) Block Python data source registration with name conflicts

[ https://issues.apache.org/jira/browse/SPARK-46522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46522. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44507

[jira] [Assigned] (SPARK-46522) Block Python data source registration with name conflicts

[ https://issues.apache.org/jira/browse/SPARK-46522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46522: Assignee: Allison Wang > Block Python data source registration with name conflicts >

[jira] [Reopened] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-46437: -- Assignee: (was: Nicholas Chammas) Reverted at

[jira] [Updated] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46437: - Fix Version/s: (was: 4.0.0) > Remove unnecessary cruft from SQL built-in functions docs >

[jira] [Resolved] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46613. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44617

[jira] [Assigned] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46613: Assignee: Hyukjin Kwon > Log full exception when failed to lookup Python Data Sources >

[jira] [Assigned] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

[ https://issues.apache.org/jira/browse/SPARK-46603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46603: Assignee: Yang Jie > Refine docstring of `parse_url/url_encode/url_decode` >

[jira] [Resolved] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

[ https://issues.apache.org/jira/browse/SPARK-46603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46603. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44604

[jira] [Resolved] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

[ https://issues.apache.org/jira/browse/SPARK-46606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46606. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44610

[jira] [Assigned] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

[ https://issues.apache.org/jira/browse/SPARK-46606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46606: Assignee: BingKun Pan > Refine docstring of

[jira] [Updated] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

[ https://issues.apache.org/jira/browse/SPARK-46613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46613: - Description: See https://github.com/apache/spark/pull/44617 > Log full exception when failed to

[jira] [Created] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

Hyukjin Kwon created SPARK-46613: Summary: Log full exception when failed to lookup Python Data Sources Key: SPARK-46613 URL: https://issues.apache.org/jira/browse/SPARK-46613 Project: Spark

[jira] [Assigned] (SPARK-46248) Support ignoreCorruptFiles and ignoreMissingFiles options in XML

[ https://issues.apache.org/jira/browse/SPARK-46248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46248: Assignee: Shujing Yang > Support ignoreCorruptFiles and ignoreMissingFiles options in

[jira] [Assigned] (SPARK-46607) Check the testing mode

[ https://issues.apache.org/jira/browse/SPARK-46607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46607: Assignee: Ruifeng Zheng > Check the testing mode > -- > >

[jira] [Resolved] (SPARK-46248) Support ignoreCorruptFiles and ignoreMissingFiles options in XML

[ https://issues.apache.org/jira/browse/SPARK-46248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46248. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44163

[jira] [Resolved] (SPARK-46607) Check the testing mode

[ https://issues.apache.org/jira/browse/SPARK-46607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46607. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44611

[jira] [Resolved] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

[ https://issues.apache.org/jira/browse/SPARK-46599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46599. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44601

[jira] [Assigned] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

[ https://issues.apache.org/jira/browse/SPARK-46599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46599: Assignee: Sandip Agarwala > XML: Use TypeCoercion.findTightestCommonType for

[jira] [Resolved] (SPARK-46587) XML: Fix XSD big integer conversion

[ https://issues.apache.org/jira/browse/SPARK-46587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46587. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44587

[jira] [Created] (SPARK-46582) Upgrade R Tools version from 4.0.2 to 4.3.2 in AppVeyor

Hyukjin Kwon created SPARK-46582: Summary: Upgrade R Tools version from 4.0.2 to 4.3.2 in AppVeyor Key: SPARK-46582 URL: https://issues.apache.org/jira/browse/SPARK-46582 Project: Spark

[jira] [Assigned] (SPARK-46571) Re-enable TODOs that are resolved from recent Pandas

[ https://issues.apache.org/jira/browse/SPARK-46571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46571: Assignee: Haejoon Lee > Re-enable TODOs that are resolved from recent Pandas >

[jira] [Resolved] (SPARK-46571) Re-enable TODOs that are resolved from recent Pandas

[ https://issues.apache.org/jira/browse/SPARK-46571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46571. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44568

[jira] [Assigned] (SPARK-46565) Improve Python data source error classes and messages

[ https://issues.apache.org/jira/browse/SPARK-46565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46565: Assignee: Allison Wang > Improve Python data source error classes and messages >

[jira] [Resolved] (SPARK-46565) Improve Python data source error classes and messages

[ https://issues.apache.org/jira/browse/SPARK-46565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46565. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44560

[jira] [Resolved] (SPARK-44001) Improve parsing of well known wrapper types

[ https://issues.apache.org/jira/browse/SPARK-44001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44001. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43767

[jira] [Resolved] (SPARK-46570) Run Python 3.11 and 3.12 test independently

[ https://issues.apache.org/jira/browse/SPARK-46570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46570. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44566

[jira] [Assigned] (SPARK-46570) Run Python 3.11 and 3.12 test independently

[ https://issues.apache.org/jira/browse/SPARK-46570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46570: Assignee: Dongjoon Hyun > Run Python 3.11 and 3.12 test independently >

[jira] [Resolved] (SPARK-46553) FutureWarning for interpolate with object dtype

[ https://issues.apache.org/jira/browse/SPARK-46553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46553. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44550

[jira] [Assigned] (SPARK-46553) FutureWarning for interpolate with object dtype

[ https://issues.apache.org/jira/browse/SPARK-46553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46553: Assignee: Haejoon Lee > FutureWarning for interpolate with object dtype >

[jira] [Created] (SPARK-46564) Exclude unrelated files via using omit options properly in PySpark coverage report

Hyukjin Kwon created SPARK-46564: Summary: Exclude unrelated files via using omit options properly in PySpark coverage report Key: SPARK-46564 URL: https://issues.apache.org/jira/browse/SPARK-46564

[jira] [Assigned] (SPARK-46557) Refine docstring for DataFrame.schema/explain/printSchema

[ https://issues.apache.org/jira/browse/SPARK-46557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46557: Assignee: Hyukjin Kwon > Refine docstring for DataFrame.schema/explain/printSchema >

[jira] [Resolved] (SPARK-46557) Refine docstring for DataFrame.schema/explain/printSchema

[ https://issues.apache.org/jira/browse/SPARK-46557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46557. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44553

[jira] [Resolved] (SPARK-46540) Respect column names when Python data source read function outputs named Row objects

[ https://issues.apache.org/jira/browse/SPARK-46540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46540. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44531

[jira] [Assigned] (SPARK-46540) Respect column names when Python data source read function outputs named Row objects

[ https://issues.apache.org/jira/browse/SPARK-46540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46540: Assignee: Allison Wang > Respect column names when Python data source read function

[jira] [Resolved] (SPARK-46556) Refine docstring for DataFrame.createGlobalTempView/createOrReplaceGlobalTempView

[ https://issues.apache.org/jira/browse/SPARK-46556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46556. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44552

[jira] [Assigned] (SPARK-46556) Refine docstring for DataFrame.createGlobalTempView/createOrReplaceGlobalTempView

[ https://issues.apache.org/jira/browse/SPARK-46556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46556: Assignee: Hyukjin Kwon > Refine docstring for >

[jira] [Assigned] (SPARK-46555) Refine docstring for DataFrame.createTempView/createOrReplaceTempView

[ https://issues.apache.org/jira/browse/SPARK-46555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46555: Assignee: Hyukjin Kwon > Refine docstring for

[jira] [Resolved] (SPARK-46555) Refine docstring for DataFrame.createTempView/createOrReplaceTempView

[ https://issues.apache.org/jira/browse/SPARK-46555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46555. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44551

[jira] [Updated] (SPARK-46557) Refine docstring for DataFrame.schema/explain/printSchema

[ https://issues.apache.org/jira/browse/SPARK-46557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46557: - Summary: Refine docstring for DataFrame.schema/explain/printSchema (was: Refine docstring for

[jira] [Created] (SPARK-46557) Refine docstring for DataFrame.explain/printSchema

Hyukjin Kwon created SPARK-46557: Summary: Refine docstring for DataFrame.explain/printSchema Key: SPARK-46557 URL: https://issues.apache.org/jira/browse/SPARK-46557 Project: Spark Issue

[jira] [Created] (SPARK-46556) Refine docstring for DataFrame.createGlobalTempView/createOrReplaceGlobalTempView

Hyukjin Kwon created SPARK-46556: Summary: Refine docstring for DataFrame.createGlobalTempView/createOrReplaceGlobalTempView Key: SPARK-46556 URL: https://issues.apache.org/jira/browse/SPARK-46556

[jira] [Updated] (SPARK-46555) Refine docstring for DataFrame.createTempView/createOrReplaceTempView

[ https://issues.apache.org/jira/browse/SPARK-46555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46555: - Summary: Refine docstring for DataFrame.createTempView/createOrReplaceTempView (was: Refine

[jira] [Created] (SPARK-46555) Refine docstring for DataFrame.registerTempTable/createTempView/createOrReplaceTempView

Hyukjin Kwon created SPARK-46555: Summary: Refine docstring for DataFrame.registerTempTable/createTempView/createOrReplaceTempView Key: SPARK-46555 URL: https://issues.apache.org/jira/browse/SPARK-46555

[jira] [Resolved] (SPARK-45914) Support `commit` and `abort` API for Python data source write

[ https://issues.apache.org/jira/browse/SPARK-45914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45914. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44497

[jira] [Assigned] (SPARK-45914) Support `commit` and `abort` API for Python data source write

[ https://issues.apache.org/jira/browse/SPARK-45914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45914: Assignee: Allison Wang > Support `commit` and `abort` API for Python data source write >

[jira] [Assigned] (SPARK-46382) XML: Capture values interspersed between elements

[ https://issues.apache.org/jira/browse/SPARK-46382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46382: Assignee: Shujing Yang > XML: Capture values interspersed between elements >

[jira] [Resolved] (SPARK-46382) XML: Capture values interspersed between elements

[ https://issues.apache.org/jira/browse/SPARK-46382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46382. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44318

[jira] [Created] (SPARK-46530) Check Python executable when looking up available Data Sources

Hyukjin Kwon created SPARK-46530: Summary: Check Python executable when looking up available Data Sources Key: SPARK-46530 URL: https://issues.apache.org/jira/browse/SPARK-46530 Project: Spark

[jira] [Resolved] (SPARK-45917) Statically register Python Data Source

[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45917. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44504

[jira] [Assigned] (SPARK-45917) Statically register Python Data Source

[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45917: Assignee: Hyukjin Kwon > Statically register Python Data Source >

[jira] [Resolved] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46521. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44506

[jira] [Assigned] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46521: Assignee: Yang Jie > Refine docstring of `array_compact/array_distinct/array_remove` >

[jira] [Assigned] (SPARK-46528) Upgrade zstd-jni to 1.5.5-11

[ https://issues.apache.org/jira/browse/SPARK-46528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46528: Assignee: Dongjoon Hyun > Upgrade zstd-jni to 1.5.5-11 > >

[jira] [Resolved] (SPARK-46528) Upgrade zstd-jni to 1.5.5-11

[ https://issues.apache.org/jira/browse/SPARK-46528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46528. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44515

[jira] [Assigned] (SPARK-46520) Support overwrite mode for Python data source write

[ https://issues.apache.org/jira/browse/SPARK-46520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46520: Assignee: Allison Wang > Support overwrite mode for Python data source write >

[jira] [Resolved] (SPARK-46520) Support overwrite mode for Python data source write

[ https://issues.apache.org/jira/browse/SPARK-46520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46520. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44505

[jira] [Resolved] (SPARK-46513) Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*`

[ https://issues.apache.org/jira/browse/SPARK-46513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46513. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44499

[jira] [Assigned] (SPARK-46513) Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*`

[ https://issues.apache.org/jira/browse/SPARK-46513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46513: Assignee: Ruifeng Zheng > Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*`

[jira] [Resolved] (SPARK-45559) Support spark.read.schema(...) for Python data source API

[ https://issues.apache.org/jira/browse/SPARK-45559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45559. -- Resolution: Invalid It is supported, and I see some test cases in `PythonDataSourceSuite` >

[jira] [Resolved] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46503. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44482

[jira] [Assigned] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46503: Assignee: Ruifeng Zheng > Move test_default_index to `pyspark.pandas.tests.indexes.*` >

[jira] [Resolved] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44393

[jira] [Assigned] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46437: Assignee: Nicholas Chammas > Remove unnecessary cruft from SQL built-in functions docs >

[jira] [Assigned] (SPARK-46465) Implement Column.isNaN

[ https://issues.apache.org/jira/browse/SPARK-46465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46465: Assignee: Ruifeng Zheng > Implement Column.isNaN > -- > >

[jira] [Resolved] (SPARK-46465) Implement Column.isNaN

[ https://issues.apache.org/jira/browse/SPARK-46465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46465. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44422

[jira] [Assigned] (SPARK-46462) Reorganize `OpsOnDiffFramesGroupByRollingTests`

[ https://issues.apache.org/jira/browse/SPARK-46462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46462: Assignee: Ruifeng Zheng > Reorganize `OpsOnDiffFramesGroupByRollingTests` >

[jira] [Resolved] (SPARK-46462) Reorganize `OpsOnDiffFramesGroupByRollingTests`

[ https://issues.apache.org/jira/browse/SPARK-46462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46462. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44420

[jira] [Resolved] (SPARK-46463) Reorganize `OpsOnDiffFramesGroupByExpandingTests`

[ https://issues.apache.org/jira/browse/SPARK-46463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46463. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44421

[jira] [Assigned] (SPARK-46463) Reorganize `OpsOnDiffFramesGroupByExpandingTests`

[ https://issues.apache.org/jira/browse/SPARK-46463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46463: Assignee: Ruifeng Zheng > Reorganize `OpsOnDiffFramesGroupByExpandingTests` >

[jira] [Resolved] (SPARK-46413) Validate returnType of Arrow Python UDF

[ https://issues.apache.org/jira/browse/SPARK-46413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46413. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44362

[jira] [Resolved] (SPARK-46398) Test rangeBetween window function (pyspark.sql.window)

[ https://issues.apache.org/jira/browse/SPARK-46398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46398. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44339

[jira] [Assigned] (SPARK-46398) Test rangeBetween window function (pyspark.sql.window)

[ https://issues.apache.org/jira/browse/SPARK-46398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46398: Assignee: Xinrong Meng > Test rangeBetween window function (pyspark.sql.window) >

[jira] [Assigned] (SPARK-46308) Forbid recursive error handling by adding recursion guards

[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46308: Assignee: Alice Sayutina > Forbid recursive error handling by adding recursion guards >

[jira] [Resolved] (SPARK-46308) Forbid recursive error handling by adding recursion guards

[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46308. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44210

[jira] [Resolved] (SPARK-46386) Improve assertions of observation (pyspark.sql.observation)

[ https://issues.apache.org/jira/browse/SPARK-46386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46386. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44324

[jira] [Resolved] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46424. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44375

[jira] [Assigned] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46424: Assignee: Hyukjin Kwon > Support PythonSQLMetrics.pythonMetrics >

[jira] [Resolved] (SPARK-46427) Change Python Data Source's description to be pretty in explain

[ https://issues.apache.org/jira/browse/SPARK-46427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44379

[jira] [Assigned] (SPARK-46427) Change Python Data Source's description to be pretty in explain

[ https://issues.apache.org/jira/browse/SPARK-46427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46427: Assignee: Hyukjin Kwon > Change Python Data Source's description to be pretty in explain

[jira] [Created] (SPARK-46427) Change Python Data Source's description to be pretty in explain

Hyukjin Kwon created SPARK-46427: Summary: Change Python Data Source's description to be pretty in explain Key: SPARK-46427 URL: https://issues.apache.org/jira/browse/SPARK-46427 Project: Spark

[jira] [Resolved] (SPARK-46425) Pin the bundler version in CI

[ https://issues.apache.org/jira/browse/SPARK-46425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46425. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44376

[jira] [Assigned] (SPARK-46425) Pin the bundler version in CI

[ https://issues.apache.org/jira/browse/SPARK-46425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46425: Assignee: Hyukjin Kwon > Pin the bundler version in CI > - >

[jira] [Resolved] (SPARK-46414) Use prependBaseUri to render javascript imports

[ https://issues.apache.org/jira/browse/SPARK-46414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46414. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44363

[jira] [Deleted] (SPARK-46426) Uses sum metrics for number of output length

[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46426: - > Uses sum metrics for number of output length > > >

[jira] [Updated] (SPARK-46426) Uses sum metrics for number of output length

[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46426: - Attachment: Screenshot 2023-12-15 at 3.23.09 PM.png > Uses sum metrics for number of output

<    1   2   3   4   5   6   7   8   9   10   >