[jira] [Updated] (SPARK-51479) Nullable in Row Level Operation Column is not correct

[ https://issues.apache.org/jira/browse/SPARK-51479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51479: --- Labels: pull-request-available (was: ) > Nullable in Row Level Operation Column is not corr

[jira] [Commented] (SPARK-28619) List all cases where the golden result file is different from spark-sql

[ https://issues.apache.org/jira/browse/SPARK-28619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934433#comment-17934433 ] Surbhi Vijayvargeeya commented on SPARK-28619: -- [~yumwang] was there any in

[jira] [Resolved] (SPARK-51483) Add `SparkSession` and `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51483. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 10 [https://git

[jira] [Updated] (SPARK-51483) Add `SparkSession` and `DataFrame`

[ https://issues.apache.org/jira/browse/SPARK-51483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51483: --- Labels: pull-request-available (was: ) > Add `SparkSession` and `DataFrame` > -

[jira] [Created] (SPARK-51483) Add `SparkSession` and `DataFrame`

Dongjoon Hyun created SPARK-51483: - Summary: Add `SparkSession` and `DataFrame` Key: SPARK-51483 URL: https://issues.apache.org/jira/browse/SPARK-51483 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-51481) Add `RuntimeConf` actor

[ https://issues.apache.org/jira/browse/SPARK-51481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51481. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 9 [https://gith

[jira] [Assigned] (SPARK-51467) Make tables of environment page filterable

[ https://issues.apache.org/jira/browse/SPARK-51467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-51467: Assignee: Kent Yao > Make tables of environment page filterable > ---

[jira] [Resolved] (SPARK-51467) Make tables of environment page filterable

[ https://issues.apache.org/jira/browse/SPARK-51467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-51467. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50233 [https://github.com

[jira] [Created] (SPARK-51482) Support cast from string to time

Max Gekk created SPARK-51482: Summary: Support cast from string to time Key: SPARK-51482 URL: https://issues.apache.org/jira/browse/SPARK-51482 Project: Spark Issue Type: Sub-task Compo

[jira] [Updated] (SPARK-51482) Support cast from string to time

[ https://issues.apache.org/jira/browse/SPARK-51482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-51482: - Description: Support casting of string values to TIME values using the stringToTime() function. The inpu

[jira] [Assigned] (SPARK-51472) Add gRPC `SparkConnectClient` actor

[ https://issues.apache.org/jira/browse/SPARK-51472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51472: - Assignee: Dongjoon Hyun > Add gRPC `SparkConnectClient` actor > ---

[jira] [Resolved] (SPARK-51472) Add gRPC `SparkConnectClient` actor

[ https://issues.apache.org/jira/browse/SPARK-51472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51472. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 7 [https://gith

[jira] [Updated] (SPARK-51470) Add `spark-connect-swift` repo to Apache Spark website `GitHub` page

[ https://issues.apache.org/jira/browse/SPARK-51470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51470: -- Remaining Estimate: (was: 0h) > Add `spark-connect-swift` repo to Apache Spark website `Gi

[jira] [Updated] (SPARK-51480) saprk jvm xmx and container momory need to be set separately

[ https://issues.apache.org/jira/browse/SPARK-51480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated SPARK-51480: - Description: h2. [[Elastic Memory Feature|https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yar

[jira] [Updated] (SPARK-51480) saprk jvm xmx and container momory need to be set separately

[ https://issues.apache.org/jira/browse/SPARK-51480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang updated SPARK-51480: - Description: h2. [Elastic Memory Feature|[https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yar

[jira] [Resolved] (SPARK-51435) spark submit executor jvm Xmx and yarn container container_memory  Whether it can be set separately

[ https://issues.apache.org/jira/browse/SPARK-51435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ruiliang resolved SPARK-51435. -- Resolution: Invalid > spark submit executor jvm Xmx and yarn container container_memory  Whether it >

[jira] [Created] (SPARK-51480) saprk jvm xmx and container momory need to be set separately

ruiliang created SPARK-51480: Summary: saprk jvm xmx and container momory need to be set separately Key: SPARK-51480 URL: https://issues.apache.org/jira/browse/SPARK-51480 Project: Spark Issue T

[jira] [Assigned] (SPARK-51477) Enable autolink to SPARK jira issue

[ https://issues.apache.org/jira/browse/SPARK-51477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51477: - Assignee: Dongjoon Hyun > Enable autolink to SPARK jira issue > ---

[jira] [Resolved] (SPARK-51477) Enable autolink to SPARK jira issue

[ https://issues.apache.org/jira/browse/SPARK-51477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51477. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 8 [https://gith

[jira] [Commented] (SPARK-51479) Nullable in Row Level Operation Column is not correct

[ https://issues.apache.org/jira/browse/SPARK-51479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934397#comment-17934397 ] Huaxin Gao commented on SPARK-51479: I will submit a fix soon. > Nullable in Row L

[jira] [Created] (SPARK-51479) Nullable in Row Level Operation Column is not correct

Huaxin Gao created SPARK-51479: -- Summary: Nullable in Row Level Operation Column is not correct Key: SPARK-51479 URL: https://issues.apache.org/jira/browse/SPARK-51479 Project: Spark Issue Type:

[jira] [Updated] (SPARK-51473) ML transformed dataframe keep a reference to the model

[ https://issues.apache.org/jira/browse/SPARK-51473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51473: --- Labels: pull-request-available (was: ) > ML transformed dataframe keep a reference to the m

[jira] [Updated] (SPARK-51478) Validate SQLTransformer statement by parsed plan

[ https://issues.apache.org/jira/browse/SPARK-51478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51478: --- Labels: pull-request-available (was: ) > Validate SQLTransformer statement by parsed plan >

[jira] [Created] (SPARK-51432) Throw a proper exception when Arrow schemas are mismatched

Hyukjin Kwon created SPARK-51432: Summary: Throw a proper exception when Arrow schemas are mismatched Key: SPARK-51432 URL: https://issues.apache.org/jira/browse/SPARK-51432 Project: Spark Is

[jira] [Created] (SPARK-51478) Validate SQLTransformer statement by parsed plan

Ruifeng Zheng created SPARK-51478: - Summary: Validate SQLTransformer statement by parsed plan Key: SPARK-51478 URL: https://issues.apache.org/jira/browse/SPARK-51478 Project: Spark Issue Type

[jira] [Created] (SPARK-51477) Enable autolink to SPARK jira issue

Dongjoon Hyun created SPARK-51477: - Summary: Enable autolink to SPARK jira issue Key: SPARK-51477 URL: https://issues.apache.org/jira/browse/SPARK-51477 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51477) Enable autolink to SPARK jira issue

[ https://issues.apache.org/jira/browse/SPARK-51477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51477: --- Labels: pull-request-available (was: ) > Enable autolink to SPARK jira issue >

[jira] [Updated] (SPARK-51476) Update document type conversion for Pandas UDFs (pyarrow 17.0.0, pandas 2.2.3, Python 3.11)

[ https://issues.apache.org/jira/browse/SPARK-51476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51476: --- Labels: pull-request-available (was: ) > Update document type conversion for Pandas UDFs (p

[jira] [Commented] (SPARK-51250) Add Support for K8s PriorityClass Configuration for spark-submit via spark config

[ https://issues.apache.org/jira/browse/SPARK-51250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934361#comment-17934361 ] Zemin Piao commented on SPARK-51250: Bump :P > Add Support for K8s PriorityClass Co

[jira] [Updated] (SPARK-51476) Update document type conversion for Pandas UDFs (pyarrow 17.0.0, pandas 2.2.3, Python 3.11)

[ https://issues.apache.org/jira/browse/SPARK-51476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51476: - Description: Same as SPARK-32722 but with diff version > Update document type conversion for Pan

[jira] [Created] (SPARK-51476) Update document type conversion for Pandas UDFs (pyarrow 17.0.0, pandas 2.2.3, Python 3.11)

Hyukjin Kwon created SPARK-51476: Summary: Update document type conversion for Pandas UDFs (pyarrow 17.0.0, pandas 2.2.3, Python 3.11) Key: SPARK-51476 URL: https://issues.apache.org/jira/browse/SPARK-51476

[jira] [Updated] (SPARK-51476) Update document type conversion for Pandas UDFs (pyarrow 17.0.0, pandas 2.2.3, Python 3.11)

[ https://issues.apache.org/jira/browse/SPARK-51476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51476: - Description: Same as SPARK-38031 but with diff version (was: Same as SPARK-32722 but with diff

[jira] [Created] (SPARK-51455) Time literal generator in tests

Max Gekk created SPARK-51455: Summary: Time literal generator in tests Key: SPARK-51455 URL: https://issues.apache.org/jira/browse/SPARK-51455 Project: Spark Issue Type: Sub-task Compon

[jira] [Created] (SPARK-51475) ArrayDistinct Producing Inconsistent Behavior For -0.0 and +0.0

Warrick He created SPARK-51475: -- Summary: ArrayDistinct Producing Inconsistent Behavior For -0.0 and +0.0 Key: SPARK-51475 URL: https://issues.apache.org/jira/browse/SPARK-51475 Project: Spark

[jira] [Updated] (SPARK-51472) Add gRPC `SparkConnectClient` actor

[ https://issues.apache.org/jira/browse/SPARK-51472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51472: -- Summary: Add gRPC `SparkConnectClient` actor (was: Add gRPC `SPARK-51472` actor) > Add gRPC

[jira] [Updated] (SPARK-51417) Give a second to wait for Spark Connect server to fully start

[ https://issues.apache.org/jira/browse/SPARK-51417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-51417: - Summary: Give a second to wait for Spark Connect server to fully start (was: Give few seconds t

[jira] [Commented] (SPARK-51402) Test time in UDF

[ https://issues.apache.org/jira/browse/SPARK-51402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17933019#comment-17933019 ] Calili dos Santos Silva commented on SPARK-51402: - Hi [~maxgekk], Can i

[jira] [Updated] (SPARK-51453) Fix AssertTrue constructor so it uses toPrettySQL instead of simpleString

[ https://issues.apache.org/jira/browse/SPARK-51453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51453: --- Labels: pull-request-available (was: ) > Fix AssertTrue constructor so it uses toPrettySQL

[jira] [Created] (SPARK-51474) Don't insert redundant ColumnarToRowExec for node supporting both columnar and row output

L. C. Hsieh created SPARK-51474: --- Summary: Don't insert redundant ColumnarToRowExec for node supporting both columnar and row output Key: SPARK-51474 URL: https://issues.apache.org/jira/browse/SPARK-51474

[jira] [Assigned] (SPARK-51474) Don't insert redundant ColumnarToRowExec for node supporting both columnar and row output

[ https://issues.apache.org/jira/browse/SPARK-51474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-51474: --- Assignee: L. C. Hsieh > Don't insert redundant ColumnarToRowExec for node supporting both c

[jira] [Resolved] (SPARK-50966) Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3)

[ https://issues.apache.org/jira/browse/SPARK-50966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niall Pemberton resolved SPARK-50966. - Resolution: Fixed > Remove Google Analytics from old Spark versions (0.6.1 to 0.7.3) > -

[jira] [Resolved] (SPARK-51453) Fix AssertTrue constructor so it uses toPrettySQL instead of simpleString

[ https://issues.apache.org/jira/browse/SPARK-51453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51453. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50226 [https://gith

[jira] [Assigned] (SPARK-51461) Setup `SparkConnect` package structure and CI to test `build`

[ https://issues.apache.org/jira/browse/SPARK-51461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51461: - Assignee: Dongjoon Hyun > Setup `SparkConnect` package structure and CI to test `build`

[jira] [Created] (SPARK-51457) Use R 4.4.2 in `windows` R GitHub Action Windows job

Dongjoon Hyun created SPARK-51457: - Summary: Use R 4.4.2 in `windows` R GitHub Action Windows job Key: SPARK-51457 URL: https://issues.apache.org/jira/browse/SPARK-51457 Project: Spark Issue

[jira] [Created] (SPARK-51453) Fix AssertTrue constructor so it uses toPrettySQL instead of simpleString

Mihailo Aleksic created SPARK-51453: --- Summary: Fix AssertTrue constructor so it uses toPrettySQL instead of simpleString Key: SPARK-51453 URL: https://issues.apache.org/jira/browse/SPARK-51453 Proje

[jira] [Created] (SPARK-51473) ML transformed dataframe keep a reference to the model

Ruifeng Zheng created SPARK-51473: - Summary: ML transformed dataframe keep a reference to the model Key: SPARK-51473 URL: https://issues.apache.org/jira/browse/SPARK-51473 Project: Spark Issu

[jira] [Updated] (SPARK-51472) Add gRPC `Client` actor

[ https://issues.apache.org/jira/browse/SPARK-51472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51472: -- Summary: Add gRPC `Client` actor (was: Add GRPC `Client` actor) > Add gRPC `Client` actor > -

[jira] [Created] (SPARK-51472) Add GRPC Swift Client

Dongjoon Hyun created SPARK-51472: - Summary: Add GRPC Swift Client Key: SPARK-51472 URL: https://issues.apache.org/jira/browse/SPARK-51472 Project: Spark Issue Type: Sub-task Compon

[jira] [Updated] (SPARK-51472) Add GRPC `Client` actor

[ https://issues.apache.org/jira/browse/SPARK-51472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51472: -- Summary: Add GRPC `Client` actor (was: Add GRPC Swift Client) > Add GRPC `Client` actor > ---

[jira] [Resolved] (SPARK-51454) Support cast from time to string

[ https://issues.apache.org/jira/browse/SPARK-51454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51454. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50224 [https://

[jira] [Resolved] (SPARK-51446) Improve the codecNameMap for the compression codec

[ https://issues.apache.org/jira/browse/SPARK-51446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng resolved SPARK-51446. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50221 [https://github

[jira] [Updated] (SPARK-51471) classify the ASSERT error when offset/timestamp in startOffset is larger than the endOffset.

[ https://issues.apache.org/jira/browse/SPARK-51471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51471: --- Labels: pull-request-available (was: ) > classify the ASSERT error when offset/timestamp in

[jira] [Created] (SPARK-51471) classify the ASSERT error when offset/timestamp in startOffset is larger than the endOffset.

Huanli Wang created SPARK-51471: --- Summary: classify the ASSERT error when offset/timestamp in startOffset is larger than the endOffset. Key: SPARK-51471 URL: https://issues.apache.org/jira/browse/SPARK-51471

[jira] [Resolved] (SPARK-51470) Add `spark-connect-swift` repo to Apache Spark website `GitHub` page

[ https://issues.apache.org/jira/browse/SPARK-51470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51470. --- Fix Version/s: 4.1.0 Assignee: Dongjoon Hyun Resolution: Fixed This is resol

[jira] [Created] (SPARK-51456) Add the to_time() function

Max Gekk created SPARK-51456: Summary: Add the to_time() function Key: SPARK-51456 URL: https://issues.apache.org/jira/browse/SPARK-51456 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-51442) Add time formatters

[ https://issues.apache.org/jira/browse/SPARK-51442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51442: --- Labels: pull-request-available (was: ) > Add time formatters > --- > >

[jira] [Resolved] (SPARK-51321) Add support for LPAD and RPAD pushdown in MsSQL Server JDBC connector

[ https://issues.apache.org/jira/browse/SPARK-51321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-51321. - Fix Version/s: 4.1.0 Resolution: Fixed > Add support for LPAD and RPAD pushdown in MsSQL

[jira] [Updated] (SPARK-51452) Improve Thread dump table search

[ https://issues.apache.org/jira/browse/SPARK-51452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51452: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Improve Thread dump tab

[jira] [Updated] (SPARK-51458) Add GitHub Action job to check ASF license

[ https://issues.apache.org/jira/browse/SPARK-51458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51458: -- Summary: Add GitHub Action job to check ASF license (was: Add GitHub Actions Job to check ASF

[jira] [Created] (SPARK-51458) Add GitHub Actions Job to check ASF license

Dongjoon Hyun created SPARK-51458: - Summary: Add GitHub Actions Job to check ASF license Key: SPARK-51458 URL: https://issues.apache.org/jira/browse/SPARK-51458 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-51461) Setup `SparkConnect` package structure and CI to test `build`

Dongjoon Hyun created SPARK-51461: - Summary: Setup `SparkConnect` package structure and CI to test `build` Key: SPARK-51461 URL: https://issues.apache.org/jira/browse/SPARK-51461 Project: Spark

[jira] [Updated] (SPARK-51460) Shuffle read and write are inconsistent when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-51460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] imarch1 zhang updated SPARK-51460: -- Attachment: image-2025-03-11-09-11-16-656.png > Shuffle read and write are inconsistent when p

[jira] [Assigned] (SPARK-51408) AmIpFilterSuite#testProxyUpdate fails in some networks

[ https://issues.apache.org/jira/browse/SPARK-51408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-51408: Assignee: Chris Nauroth > AmIpFilterSuite#testProxyUpdate fails in some networks > --

[jira] [Created] (SPARK-51454) Support cast from time to string

Max Gekk created SPARK-51454: Summary: Support cast from time to string Key: SPARK-51454 URL: https://issues.apache.org/jira/browse/SPARK-51454 Project: Spark Issue Type: Sub-task Compo

[jira] [Resolved] (SPARK-51384) Support java.time.LocalTime as the external type of TimeType

[ https://issues.apache.org/jira/browse/SPARK-51384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51384. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50153 [https://github.com

[jira] [Updated] (SPARK-51450) BarrierCoordinator thread not exiting in Spark standalone mode

[ https://issues.apache.org/jira/browse/SPARK-51450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51450: --- Labels: pull-request-available (was: ) > BarrierCoordinator thread not exiting in Spark sta

[jira] [Created] (SPARK-51452) Improve Thread dump table search

Kent Yao created SPARK-51452: Summary: Improve Thread dump table search Key: SPARK-51452 URL: https://issues.apache.org/jira/browse/SPARK-51452 Project: Spark Issue Type: Improvement Co

[jira] [Assigned] (SPARK-51463) Add `Spark Connect`-generated `Swift` code

[ https://issues.apache.org/jira/browse/SPARK-51463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51463: - Assignee: Dongjoon Hyun > Add `Spark Connect`-generated `Swift` code > ---

[jira] [Resolved] (SPARK-51465) Use `Apache Arrow Swift` 19.0.1

[ https://issues.apache.org/jira/browse/SPARK-51465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51465. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 6 [https://gith

[jira] [Assigned] (SPARK-51465) Use `Apache Arrow Swift` 19.0.1

[ https://issues.apache.org/jira/browse/SPARK-51465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-51465: - Assignee: Dongjoon Hyun > Use `Apache Arrow Swift` 19.0.1 > ---

[jira] [Created] (SPARK-51470) Add `spark-connect-swift` repo to Apache Spark website `GitHub` page

Dongjoon Hyun created SPARK-51470: - Summary: Add `spark-connect-swift` repo to Apache Spark website `GitHub` page Key: SPARK-51470 URL: https://issues.apache.org/jira/browse/SPARK-51470 Project: Spark

[jira] [Updated] (SPARK-51467) Make tables of environment page filterable

[ https://issues.apache.org/jira/browse/SPARK-51467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51467: --- Labels: pull-request-available (was: ) > Make tables of environment page filterable > -

[jira] [Commented] (SPARK-51419) Get hour of time

[ https://issues.apache.org/jira/browse/SPARK-51419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934234#comment-17934234 ] Max Gekk commented on SPARK-51419: -- > we will have syntax as exactly as " TIME'12:13:14

[jira] [Resolved] (SPARK-51468) Revert "From json/xml should not change collations in the given schema"

[ https://issues.apache.org/jira/browse/SPARK-51468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-51468. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 50234 [https://github.com

[jira] [Assigned] (SPARK-51468) Revert "From json/xml should not change collations in the given schema"

[ https://issues.apache.org/jira/browse/SPARK-51468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-51468: Assignee: Stefan Kandic > Revert "From json/xml should not change collations in the given schema"

[jira] [Updated] (SPARK-51448) Support Swift language in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-51448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-51448: -- Description: Repository: [https://github.com/apache/spark-connect-swift] > Support Swift langu

[jira] [Commented] (SPARK-51419) Get hour of time

[ https://issues.apache.org/jira/browse/SPARK-51419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934202#comment-17934202 ] Senthil Kumar commented on SPARK-51419: --- Hi [~maxgekk]  I have few questions, #

[jira] [Updated] (SPARK-51469) Improve MapKeyDedupPolicy so that avoid calling toString

[ https://issues.apache.org/jira/browse/SPARK-51469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51469: --- Labels: pull-request-available (was: ) > Improve MapKeyDedupPolicy so that avoid calling to

[jira] [Created] (SPARK-51469) Improve MapKeyDedupPolicy so that avoid calling toString

Jiaan Geng created SPARK-51469: -- Summary: Improve MapKeyDedupPolicy so that avoid calling toString Key: SPARK-51469 URL: https://issues.apache.org/jira/browse/SPARK-51469 Project: Spark Issue Ty

[jira] [Created] (SPARK-51465) Use `Apache Arrow Swift` 19.0.1

Dongjoon Hyun created SPARK-51465: - Summary: Use `Apache Arrow Swift` 19.0.1 Key: SPARK-51465 URL: https://issues.apache.org/jira/browse/SPARK-51465 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-51468) Revert "From json/xml should not change collations in the given schema"

[ https://issues.apache.org/jira/browse/SPARK-51468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51468: --- Labels: pull-request-available (was: ) > Revert "From json/xml should not change collations

[jira] [Created] (SPARK-51468) Revert "From json/xml should not change collations in the given schema"

Stefan Kandic created SPARK-51468: - Summary: Revert "From json/xml should not change collations in the given schema" Key: SPARK-51468 URL: https://issues.apache.org/jira/browse/SPARK-51468 Project: Sp

[jira] [Updated] (SPARK-51466) Eliminate Hive built-in UDFs initialization on Hive UDF evaluation

[ https://issues.apache.org/jira/browse/SPARK-51466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51466: --- Labels: pull-request-available (was: ) > Eliminate Hive built-in UDFs initialization on Hiv

[jira] [Created] (SPARK-51467) Make tables of environment page filterable

Kent Yao created SPARK-51467: Summary: Make tables of environment page filterable Key: SPARK-51467 URL: https://issues.apache.org/jira/browse/SPARK-51467 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-51466) Eliminate Hive built-in UDFs initialization on Hive UDF evaluation

Cheng Pan created SPARK-51466: - Summary: Eliminate Hive built-in UDFs initialization on Hive UDF evaluation Key: SPARK-51466 URL: https://issues.apache.org/jira/browse/SPARK-51466 Project: Spark

[jira] [Commented] (SPARK-51460) Shuffle read and write are inconsistent when push-based shuffle is enabled

[ https://issues.apache.org/jira/browse/SPARK-51460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17934133#comment-17934133 ] imarch1 zhang commented on SPARK-51460: --- [~gaoyajun02] Have you encountered simila

[jira] [Resolved] (SPARK-51440) Classify the NPE when the topic field in kafka message is null and there is no topic option

[ https://issues.apache.org/jira/browse/SPARK-51440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-51440. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50214 [https://gi

[jira] [Assigned] (SPARK-51440) Classify the NPE when the topic field in kafka message is null and there is no topic option

[ https://issues.apache.org/jira/browse/SPARK-51440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51440: Assignee: Huanli Wang > Classify the NPE when the topic field in kafka message is null an

[jira] [Assigned] (SPARK-51409) Add error classification for changelog writer related errors

[ https://issues.apache.org/jira/browse/SPARK-51409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-51409: Assignee: Anish Shrigondekar > Add error classification for changelog writer related erro

[jira] [Updated] (SPARK-51462) Support typed literals of the TIME data type

[ https://issues.apache.org/jira/browse/SPARK-51462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-51462: --- Labels: pull-request-available (was: ) > Support typed literals of the TIME data type > ---

[jira] [Resolved] (SPARK-51462) Support typed literals of the TIME data type

[ https://issues.apache.org/jira/browse/SPARK-51462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-51462. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 50228 [https://