[jira] [Updated] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40943: -- Issue Type: Improvement (was: Task) > Make MSCK optional in MSCK REPAIR TABLE commands >

[jira] [Updated] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40943: -- Affects Version/s: 3.4.0 (was: 3.3.1) > Make MSCK optional in MSCK

[jira] [Resolved] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40943. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38433

[jira] [Assigned] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40943: - Assignee: Ben Zhang > Make MSCK optional in MSCK REPAIR TABLE commands >

[jira] [Commented] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689571#comment-17689571 ] Apache Spark commented on SPARK-42463: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42463: Assignee: Apache Spark > Clean up the third-party Java source code introduced by

[jira] [Assigned] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42463: Assignee: (was: Apache Spark) > Clean up the third-party Java source code introduced

[jira] [Commented] (SPARK-27180) Fix testing issues with yarn module in Hadoop-3

[ https://issues.apache.org/jira/browse/SPARK-27180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689569#comment-17689569 ] Apache Spark commented on SPARK-27180: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689568#comment-17689568 ] Apache Spark commented on SPARK-42463: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42460) E2E test should clean-up results

[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42460: - Assignee: Herman van Hövell > E2E test should clean-up results >

[jira] [Resolved] (SPARK-42460) E2E test should clean-up results

[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42460. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40048

[jira] [Created] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

Yang Jie created SPARK-42463: Summary: Clean up the third-party Java source code introduced by SPARK-27180 Key: SPARK-42463 URL: https://issues.apache.org/jira/browse/SPARK-42463 Project: Spark

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Fix Version/s: 3.3.3 (was: 3.3.2) > Prevent `docker-image-tool.sh`

[jira] [Assigned] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42462: - Assignee: Dongjoon Hyun > Prevent `docker-image-tool.sh` from publishing OCI manifests

[jira] [Resolved] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42462. --- Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Affects Version/s: 3.2.3 > Prevent `docker-image-tool.sh` from publishing OCI manifests >

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Affects Version/s: 3.2.4 3.3.3 (was: 3.2.3)

[jira] [Commented] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689511#comment-17689511 ] Apache Spark commented on SPARK-42462: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42462: Assignee: Apache Spark > Prevent `docker-image-tool.sh` from publishing OCI manifests >

[jira] [Commented] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689509#comment-17689509 ] Apache Spark commented on SPARK-42462: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42462: Assignee: (was: Apache Spark) > Prevent `docker-image-tool.sh` from publishing OCI

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Summary: Prevent `docker-image-tool.sh` from publishing OCI manifests (was: Prevent `docker

[jira] [Created] (SPARK-42462) Prevent `docker buildx` from publishing OCI manifests

Dongjoon Hyun created SPARK-42462: - Summary: Prevent `docker buildx` from publishing OCI manifests Key: SPARK-42462 URL: https://issues.apache.org/jira/browse/SPARK-42462 Project: Spark

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689484#comment-17689484 ] Yang Jie commented on SPARK-42452: -- Thanks for your explanation [~dongjoon] . Let's wait until the

[jira] [Commented] (SPARK-42461) Scala Client - Initial Set of Functions

[ https://issues.apache.org/jira/browse/SPARK-42461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689476#comment-17689476 ] Apache Spark commented on SPARK-42461: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42461) Scala Client - Initial Set of Functions

[ https://issues.apache.org/jira/browse/SPARK-42461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42461: Assignee: Apache Spark > Scala Client - Initial Set of Functions >

[jira] [Assigned] (SPARK-42461) Scala Client - Initial Set of Functions

[ https://issues.apache.org/jira/browse/SPARK-42461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42461: Assignee: (was: Apache Spark) > Scala Client - Initial Set of Functions >

[jira] [Commented] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689474#comment-17689474 ] Apache Spark commented on SPARK-42398: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-42398) refine default column value framework

[ https://issues.apache.org/jira/browse/SPARK-42398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689473#comment-17689473 ] Apache Spark commented on SPARK-42398: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-42461) Scala Client - Initial Set of Functions

Herman van Hövell created SPARK-42461: - Summary: Scala Client - Initial Set of Functions Key: SPARK-42461 URL: https://issues.apache.org/jira/browse/SPARK-42461 Project: Spark Issue

[jira] [Assigned] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42459: Assignee: Hyukjin Kwon > Create pyspark.sql.connect.utils to keep common codes >

[jira] [Resolved] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42459. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40047

[jira] [Assigned] (SPARK-42460) E2E test should clean-up results

[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42460: Assignee: (was: Apache Spark) > E2E test should clean-up results >

[jira] [Assigned] (SPARK-42460) E2E test should clean-up results

[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42460: Assignee: Apache Spark > E2E test should clean-up results >

[jira] [Commented] (SPARK-42460) E2E test should clean-up results

[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689459#comment-17689459 ] Apache Spark commented on SPARK-42460: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-42460) E2E test should clean-up results

Herman van Hövell created SPARK-42460: - Summary: E2E test should clean-up results Key: SPARK-42460 URL: https://issues.apache.org/jira/browse/SPARK-42460 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42451: --- Assignee: Yang Jie > Remove 3.1 and Java 17 check from filter condition of

[jira] [Resolved] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42451. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40039

[jira] [Assigned] (SPARK-41817) SparkSession.read support reading with schema

[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41817: Assignee: Sandeep Singh > SparkSession.read support reading with schema >

[jira] [Resolved] (SPARK-41817) SparkSession.read support reading with schema

[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41817. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40046

[jira] [Resolved] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42453. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40041

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42453: --- Assignee: Rui Wang > Implement function max in Scala client >

[jira] [Resolved] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42456. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40044

[jira] [Assigned] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42456: Assignee: Allan Folting > Consolidating the PySpark version upgrade note pages into a

[jira] [Commented] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689421#comment-17689421 ] Apache Spark commented on SPARK-42459: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42459: Assignee: Apache Spark > Create pyspark.sql.connect.utils to keep common codes >

[jira] [Assigned] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

[ https://issues.apache.org/jira/browse/SPARK-42459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42459: Assignee: (was: Apache Spark) > Create pyspark.sql.connect.utils to keep common

[jira] [Assigned] (SPARK-41817) SparkSession.read support reading with schema

[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41817: Assignee: (was: Apache Spark) > SparkSession.read support reading with schema >

[jira] [Assigned] (SPARK-41817) SparkSession.read support reading with schema

[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41817: Assignee: Apache Spark > SparkSession.read support reading with schema >

[jira] [Commented] (SPARK-41817) SparkSession.read support reading with schema

[ https://issues.apache.org/jira/browse/SPARK-41817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689420#comment-17689420 ] Apache Spark commented on SPARK-41817: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-42459) Create pyspark.sql.connect.utils to keep common codes

Hyukjin Kwon created SPARK-42459: Summary: Create pyspark.sql.connect.utils to keep common codes Key: SPARK-42459 URL: https://issues.apache.org/jira/browse/SPARK-42459 Project: Spark Issue

[jira] [Created] (SPARK-42458) createDataFrame should support DDL string as schema

Takuya Ueshin created SPARK-42458: - Summary: createDataFrame should support DDL string as schema Key: SPARK-42458 URL: https://issues.apache.org/jira/browse/SPARK-42458 Project: Spark Issue

[jira] [Resolved] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42426. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40024

[jira] [Assigned] (SPARK-42426) insertInto fails when the column names are different from the table columns

[ https://issues.apache.org/jira/browse/SPARK-42426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42426: Assignee: Takuya Ueshin > insertInto fails when the column names are different from the

[jira] [Resolved] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42455. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40042

[jira] [Resolved] (SPARK-42384) Mask function's generated code does not handle null input

[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42384. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39945

[jira] [Assigned] (SPARK-42384) Mask function's generated code does not handle null input

[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42384: -- Assignee: Bruce Robbins > Mask function's generated code does not handle null input

[jira] [Commented] (SPARK-41591) Implement functionality for training a PyTorch file locally

[ https://issues.apache.org/jira/browse/SPARK-41591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689407#comment-17689407 ] Apache Spark commented on SPARK-41591: -- User 'rithwik-db' has created a pull request for this

[jira] [Commented] (SPARK-41591) Implement functionality for training a PyTorch file locally

[ https://issues.apache.org/jira/browse/SPARK-41591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689405#comment-17689405 ] Apache Spark commented on SPARK-41591: -- User 'rithwik-db' has created a pull request for this

[jira] [Assigned] (SPARK-42457) Scala Client Session Read API

[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42457: Assignee: Apache Spark > Scala Client Session Read API > - >

[jira] [Assigned] (SPARK-42457) Scala Client Session Read API

[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42457: Assignee: (was: Apache Spark) > Scala Client Session Read API >

[jira] [Commented] (SPARK-42457) Scala Client Session Read API

[ https://issues.apache.org/jira/browse/SPARK-42457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689370#comment-17689370 ] Apache Spark commented on SPARK-42457: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Created] (SPARK-42457) Scala Client Session Read API

Zhen Li created SPARK-42457: --- Summary: Scala Client Session Read API Key: SPARK-42457 URL: https://issues.apache.org/jira/browse/SPARK-42457 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42456: Assignee: (was: Apache Spark) > Consolidating the PySpark version upgrade note pages

[jira] [Assigned] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42456: Assignee: Apache Spark > Consolidating the PySpark version upgrade note pages into a

[jira] [Commented] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689365#comment-17689365 ] Apache Spark commented on SPARK-42456: -- User 'allanf-db' has created a pull request for this issue:

[jira] [Updated] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42456: -- Description: Creating a new PySpark migration guide sub page and consolidating the existing

[jira] [Created] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

Allan Folting created SPARK-42456: - Summary: Consolidating the PySpark version upgrade note pages into a single page to make it easier to read Key: SPARK-42456 URL:

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689354#comment-17689354 ] Dongjoon Hyun commented on SPARK-42452: --- Not yet~ I simply removed the broken one because no one

[jira] [Commented] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689349#comment-17689349 ] Apache Spark commented on SPARK-39904: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42455: Assignee: Gengliang Wang (was: Apache Spark) > Rename JDBC option inferTimestampNTZType

[jira] [Assigned] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42455: Assignee: Apache Spark (was: Gengliang Wang) > Rename JDBC option inferTimestampNTZType

[jira] [Commented] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689343#comment-17689343 ] Apache Spark commented on SPARK-42455: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

Gengliang Wang created SPARK-42455: -- Summary: Rename JDBC option inferTimestampNTZType as preferTimestampNTZ Key: SPARK-42455 URL: https://issues.apache.org/jira/browse/SPARK-42455 Project: Spark

[jira] [Created] (SPARK-42454) SPJ: encapsulate all SPJ related parameters in BatchScanExec

Chao Sun created SPARK-42454: Summary: SPJ: encapsulate all SPJ related parameters in BatchScanExec Key: SPARK-42454 URL: https://issues.apache.org/jira/browse/SPARK-42454 Project: Spark Issue

[jira] [Resolved] (SPARK-40653) Protobuf Support in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-40653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi resolved SPARK-40653. -- Fix Version/s: 3.4.0 Resolution: Fixed Protobuf functions have been in use for couple

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42453: Assignee: (was: Apache Spark) > Implement function max in Scala client >

[jira] [Commented] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689307#comment-17689307 ] Apache Spark commented on SPARK-42453: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42453: Assignee: Apache Spark > Implement function max in Scala client >

[jira] [Resolved] (SPARK-42441) Scala Client - Implement Column API

[ https://issues.apache.org/jira/browse/SPARK-42441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42441. --- Fix Version/s: 3.4.0 Assignee: Herman van Hövell Resolution: Fixed

[jira] [Created] (SPARK-42453) Implement function max in Scala client

Rui Wang created SPARK-42453: Summary: Implement function max in Scala client Key: SPARK-42453 URL: https://issues.apache.org/jira/browse/SPARK-42453 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42445: -- Fix Version/s: 3.3.3 > Fix SparkR install.spark function > -

[jira] [Resolved] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42445. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40031

[jira] [Assigned] (SPARK-42445) Fix SparkR install.spark function

[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42445: - Assignee: Dongjoon Hyun > Fix SparkR install.spark function >

[jira] [Assigned] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42399: Assignee: Apache Spark > CONV() silently overflows returning wrong results >

[jira] [Commented] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689226#comment-17689226 ] Apache Spark commented on SPARK-42399: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42399: Assignee: (was: Apache Spark) > CONV() silently overflows returning wrong results >

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689222#comment-17689222 ] Yang Jie commented on SPARK-42452: -- Is it time to clean up hadoop-2 profile ? [~dongjoon]  [~gurwls223] 

[jira] [Updated] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42452: - Summary: Remove hadoop-2 profile from Apache Spark (was: Remove hadoop-2 profile from Spark) > Remove

[jira] [Updated] (SPARK-42452) Remove hadoop-2 profile from Spark

[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42452: - Description: SPARK-40651 Drop Hadoop2 binary distribtuion from release process and SPARK-42447 Remove

[jira] [Created] (SPARK-42452) Remove hadoop-2 profile from Spark

Yang Jie created SPARK-42452: Summary: Remove hadoop-2 profile from Spark Key: SPARK-42452 URL: https://issues.apache.org/jira/browse/SPARK-42452 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689215#comment-17689215 ] Apache Spark commented on SPARK-42451: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42451: Assignee: (was: Apache Spark) > Remove 3.1 and Java 17 check from filter condition

[jira] [Commented] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689214#comment-17689214 ] Apache Spark commented on SPARK-42451: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42451: Assignee: Apache Spark > Remove 3.1 and Java 17 check from filter condition of

[jira] [Updated] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42451: - Summary: Remove 3.1 and Java 17 check from filter condition of `testingVersions` in

[jira] [Updated] (SPARK-42451) Remove 3.1 and Java 17 check from `testingVersions` in `HiveExternalCatalogVersionsSuite`

[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42451: - Summary: Remove 3.1 and Java 17 check from `testingVersions` in `HiveExternalCatalogVersionsSuite`

[jira] [Created] (SPARK-42451) Remove 3.1 and Java 17 condition check from `testingVersions` in `HiveExternalCatalogVersionsSuite`

Yang Jie created SPARK-42451: Summary: Remove 3.1 and Java 17 condition check from `testingVersions` in `HiveExternalCatalogVersionsSuite` Key: SPARK-42451 URL: https://issues.apache.org/jira/browse/SPARK-42451

[jira] [Updated] (SPARK-42449) Fix `native-image.propertie` in Scala Client

[ https://issues.apache.org/jira/browse/SPARK-42449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42449: Description: The content of `native-image.propertie` file is not correct. This file is used to create a

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

  1   2   >