[jira] [Updated] (SPARK-51431) Support full table scanning of partitioned table is prohibited

[ https://issues.apache.org/jira/browse/SPARK-51431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] melin updated SPARK-51431: -- Description: Many cloud customers expect spark sql to disable full table scanning by default, prompting users

[jira] [Created] (SPARK-51433) Change release script to release pyspark-client

Hyukjin Kwon created SPARK-51433: Summary: Change release script to release pyspark-client Key: SPARK-51433 URL: https://issues.apache.org/jira/browse/SPARK-51433 Project: Spark Issue Type: B

[jira] [Resolved] (SPARK-51432) Throw a proper exception when Arrow schemas are mismatched

[ https://issues.apache.org/jira/browse/SPARK-51432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51432. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50201 [https://gi

[jira] [Assigned] (SPARK-51432) Throw a proper exception when Arrow schemas are mismatched

[ https://issues.apache.org/jira/browse/SPARK-51432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51432: Assignee: Hyukjin Kwon > Throw a proper exception when Arrow schemas are mismatched > ---

[jira] [Resolved] (SPARK-51433) Change release script to release pyspark-client

[ https://issues.apache.org/jira/browse/SPARK-51433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51433. -- Fix Version/s: 4.0.0 Assignee: Hyukjin Kwon Resolution: Fixed Fixed in https:/

[jira] [Updated] (SPARK-51432) Throw a proper exception when Arrow schemas are mismatched

[ https://issues.apache.org/jira/browse/SPARK-51432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51432: --- Labels: pull-request-available (was: ) > Throw a proper exception when Arrow schemas are mi

[jira] [Created] (SPARK-51431) Support full table scanning of partitioned table is prohibited

melin created SPARK-51431: - Summary: Support full table scanning of partitioned table is prohibited Key: SPARK-51431 URL: https://issues.apache.org/jira/browse/SPARK-51431 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51430) Stop PySpark context logger from propagating to stdout

[ https://issues.apache.org/jira/browse/SPARK-51430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51430: --- Labels: pull-request-available (was: ) > Stop PySpark context logger from propagating to st

[jira] [Resolved] (SPARK-51417) Give a second to wait for Spark Connect server to fully start

[ https://issues.apache.org/jira/browse/SPARK-51417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51417. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50181 [https://gi

[jira] [Created] (SPARK-51430) Stop PySpark context logger from propagating to stdout

Allison Wang created SPARK-51430: Summary: Stop PySpark context logger from propagating to stdout Key: SPARK-51430 URL: https://issues.apache.org/jira/browse/SPARK-51430 Project: Spark Issue

[jira] [Comment Edited] (SPARK-51404) Support parser data type json "time(n)" as TimeType

[ https://issues.apache.org/jira/browse/SPARK-51404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933068#comment-17933068 ] Mike Artz edited comment on SPARK-51404 at 3/7/25 12:56 AM:

[jira] [Comment Edited] (SPARK-51404) Support parser data type json "time(n)" as TimeType

[ https://issues.apache.org/jira/browse/SPARK-51404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933068#comment-17933068 ] Mike Artz edited comment on SPARK-51404 at 3/7/25 12:56 AM:

[jira] [Assigned] (SPARK-51417) Give a second to wait for Spark Connect server to fully start

[ https://issues.apache.org/jira/browse/SPARK-51417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51417: Assignee: Hyukjin Kwon > Give a second to wait for Spark Connect server to fully start >

[jira] [Updated] (SPARK-49394) hive.exec.compress.output not working as expected

[ https://issues.apache.org/jira/browse/SPARK-49394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng updated SPARK-49394: -- Fix Version/s: 3.4.3 > hive.exec.compress.output not working as expected > ---

[jira] [Assigned] (SPARK-51416) Remove SPARK_CONNECT_MODE when starting Spark Connect server

[ https://issues.apache.org/jira/browse/SPARK-51416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-51416: Assignee: Hyukjin Kwon > Remove SPARK_CONNECT_MODE when starting Spark Connect server > -

[jira] [Resolved] (SPARK-51416) Remove SPARK_CONNECT_MODE when starting Spark Connect server

[ https://issues.apache.org/jira/browse/SPARK-51416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51416. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50180 [https://gi

[jira] [Resolved] (SPARK-49394) hive.exec.compress.output not working as expected

[ https://issues.apache.org/jira/browse/SPARK-49394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zheng resolved SPARK-49394. --- Resolution: Fixed > hive.exec.compress.output not working as expected >

[jira] [Commented] (SPARK-49394) hive.exec.compress.output not working as expected

[ https://issues.apache.org/jira/browse/SPARK-49394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933153#comment-17933153 ] Wei Zheng commented on SPARK-49394: --- The issue was fixed by https://issues.apache.org/

[jira] [Updated] (SPARK-51395) Refine handling of default values in procedures

[ https://issues.apache.org/jira/browse/SPARK-51395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51395: --- Labels: pull-request-available (was: ) > Refine handling of default values in procedures >

[jira] [Updated] (SPARK-51402) Test time in UDF

[ https://issues.apache.org/jira/browse/SPARK-51402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51402: --- Labels: pull-request-available starter (was: starter) > Test time in UDF >

[jira] [Resolved] (SPARK-51396) Avoid exceptions for control flow in RuntimeConfig.getOption

[ https://issues.apache.org/jira/browse/SPARK-51396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-51396. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50167 [https://gi

[jira] [Commented] (SPARK-51402) Test time in UDF

[ https://issues.apache.org/jira/browse/SPARK-51402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933116#comment-17933116 ] Calili dos Santos Silva commented on SPARK-51402: - Thanks [~maxgekk], I

[jira] [Created] (SPARK-51426) Setting metadata to empty dict does not work

Sebastian Bengtsson created SPARK-51426: --- Summary: Setting metadata to empty dict does not work Key: SPARK-51426 URL: https://issues.apache.org/jira/browse/SPARK-51426 Project: Spark Is

[jira] [Updated] (SPARK-51429) Add "Acknowledgement" message in ExecutePlanResponse

[ https://issues.apache.org/jira/browse/SPARK-51429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51429: --- Labels: pull-request-available (was: ) > Add "Acknowledgement" message in ExecutePlanRespon

[jira] [Resolved] (SPARK-51391) Fix `SparkConnectClient` to respect `SPARK_USER` and `user.name`

[ https://issues.apache.org/jira/browse/SPARK-51391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51391. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50159 [https://

[jira] [Created] (SPARK-51428) Implicit aliases of collated trees are assigned non-deterministically

Vladimir Golubev created SPARK-51428: Summary: Implicit aliases of collated trees are assigned non-deterministically Key: SPARK-51428 URL: https://issues.apache.org/jira/browse/SPARK-51428 Project

[jira] [Commented] (SPARK-51420) Get minutes of time

[ https://issues.apache.org/jira/browse/SPARK-51420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933073#comment-17933073 ] Sakthi commented on SPARK-51420: Would like to pick up this task, Max > Get minutes of

[jira] [Commented] (SPARK-51423) Add the current_time() function

[ https://issues.apache.org/jira/browse/SPARK-51423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933071#comment-17933071 ] Sakthi commented on SPARK-51423: Would like to pick up this task, Max! > Add the curren

[jira] [Commented] (SPARK-51404) Support parser data type json "time(n)" as TimeType

[ https://issues.apache.org/jira/browse/SPARK-51404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933068#comment-17933068 ] Mike Artz commented on SPARK-51404: --- I can take this task  > Support parser data type

[jira] [Updated] (SPARK-51428) Implicit aliases of collated trees are assigned non-deterministically

[ https://issues.apache.org/jira/browse/SPARK-51428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51428: --- Labels: pull-request-available (was: ) > Implicit aliases of collated trees are assigned no

[jira] [Created] (SPARK-51425) [Connect] Add client API to set custom operation ID

Venkata Sai Akhil Gudesa created SPARK-51425: Summary: [Connect] Add client API to set custom operation ID Key: SPARK-51425 URL: https://issues.apache.org/jira/browse/SPARK-51425 Project: S

[jira] [Updated] (SPARK-51424) Upgrade ORC to 2.1.1

[ https://issues.apache.org/jira/browse/SPARK-51424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51424: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade ORC to 2.1.1 > >

[jira] [Updated] (SPARK-51424) Upgrade ORC to 2.1.1

[ https://issues.apache.org/jira/browse/SPARK-51424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51424: --- Labels: pull-request-available (was: ) > Upgrade ORC to 2.1.1 > > >

[jira] [Created] (SPARK-51424) Upgrade ORC to 2.1.1

Dongjoon Hyun created SPARK-51424: - Summary: Upgrade ORC to 2.1.1 Key: SPARK-51424 URL: https://issues.apache.org/jira/browse/SPARK-51424 Project: Spark Issue Type: Sub-task Compone

[jira] [Commented] (SPARK-51419) Get hour of time

[ https://issues.apache.org/jira/browse/SPARK-51419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933029#comment-17933029 ] Max Gekk commented on SPARK-51419: -- > Max Gekk I will work on this task [~senthh] Sure

[jira] [Updated] (SPARK-51338) Add automated CI build for `server-library-example` in the `connect-examples`

[ https://issues.apache.org/jira/browse/SPARK-51338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51338: --- Labels: pull-request-available (was: ) > Add automated CI build for `server-library-example

[jira] [Resolved] (SPARK-51379) Move treeAggregate's final aggregation from driver to executor

[ https://issues.apache.org/jira/browse/SPARK-51379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-51379. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50142 [https://

[jira] [Updated] (SPARK-51419) Get hour of time

[ https://issues.apache.org/jira/browse/SPARK-51419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51419: - Labels: starter (was: ) > Get hour of time > > > Key: SPARK-51419 >

[jira] [Updated] (SPARK-51402) Test time in UDF

[ https://issues.apache.org/jira/browse/SPARK-51402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51402: - Shepherd: Max Gekk > Test time in UDF > > > Key: SPARK-51402 >

[jira] [Created] (SPARK-51423) Add the current_time() function

Max Gekk created SPARK-51423: Summary: Add the current_time() function Key: SPARK-51423 URL: https://issues.apache.org/jira/browse/SPARK-51423 Project: Spark Issue Type: Sub-task Compon

[jira] [Updated] (SPARK-51423) Add the current_time() function

[ https://issues.apache.org/jira/browse/SPARK-51423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51423: - Description: Add new function current_time() which returns the current time at the start of query evalu

[jira] [Created] (SPARK-51422) Optimize CrossValidator eliminating the JVM-Python data exchange

Ruifeng Zheng created SPARK-51422: - Summary: Optimize CrossValidator eliminating the JVM-Python data exchange Key: SPARK-51422 URL: https://issues.apache.org/jira/browse/SPARK-51422 Project: Spark

[jira] [Updated] (SPARK-51422) Optimize CrossValidator eliminating the JVM-Python data exchange

[ https://issues.apache.org/jira/browse/SPARK-51422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51422: --- Labels: pull-request-available (was: ) > Optimize CrossValidator eliminating the JVM-Python

[jira] [Assigned] (SPARK-51379) Move treeAggregate's final aggregation from driver to executor

[ https://issues.apache.org/jira/browse/SPARK-51379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-51379: - Assignee: Ruifeng Zheng > Move treeAggregate's final aggregation from driver to executo

[jira] [Updated] (SPARK-51403) Test TimeType as ordered and atomic type

[ https://issues.apache.org/jira/browse/SPARK-51403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51403: - Labels: starter (was: ) > Test TimeType as ordered and atomic type > --

[jira] [Created] (SPARK-51419) Get hour of time

Max Gekk created SPARK-51419: Summary: Get hour of time Key: SPARK-51419 URL: https://issues.apache.org/jira/browse/SPARK-51419 Project: Spark Issue Type: Sub-task Components: SQL A

[jira] [Commented] (SPARK-48311) Nested pythonUDF in groupBy and aggregate result in Binding Exception

[ https://issues.apache.org/jira/browse/SPARK-48311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17932926#comment-17932926 ] Sumit Singh commented on SPARK-48311: - Fix and UT added: [https://github.com/apache/

[jira] [Updated] (SPARK-51307) locationUri in CatalogStorageFormat shall be decoded

[ https://issues.apache.org/jira/browse/SPARK-51307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-51307: - Fix Version/s: 4.0.0 3.5.6 > locationUri in CatalogStorageFormat shall be decoded >

[jira] [Updated] (SPARK-51417) Give a second to wait for Spark Connect server to fully start

[ https://issues.apache.org/jira/browse/SPARK-51417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51417: --- Labels: pull-request-available (was: ) > Give a second to wait for Spark Connect server to

[jira] [Created] (SPARK-51417) Give few seconds to wait for Spark Connect server to fully start

Hyukjin Kwon created SPARK-51417: Summary: Give few seconds to wait for Spark Connect server to fully start Key: SPARK-51417 URL: https://issues.apache.org/jira/browse/SPARK-51417 Project: Spark

[jira] [Updated] (SPARK-51416) Remove SPARK_CONNECT_MODE when starting Spark Connect server

[ https://issues.apache.org/jira/browse/SPARK-51416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51416: --- Labels: pull-request-available (was: ) > Remove SPARK_CONNECT_MODE when starting Spark Conn

[jira] [Created] (SPARK-51416) Remove SPARK_CONNECT_MODE when starting Spark Connect server

Hyukjin Kwon created SPARK-51416: Summary: Remove SPARK_CONNECT_MODE when starting Spark Connect server Key: SPARK-51416 URL: https://issues.apache.org/jira/browse/SPARK-51416 Project: Spark