[jira] [Resolved] (SPARK-46618) Improve error messages for DATA_SOURCE_NOT_FOUND error

[ https://issues.apache.org/jira/browse/SPARK-46618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46618. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44620

[jira] [Assigned] (SPARK-46618) Improve error messages for DATA_SOURCE_NOT_FOUND error

[ https://issues.apache.org/jira/browse/SPARK-46618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46618: Assignee: Allison Wang > Improve error messages for DATA_SOURCE_NOT_FOUND error >

[jira] [Resolved] (SPARK-46757) Reduce the number of layers of testing dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46757. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44781

[jira] [Assigned] (SPARK-46757) Reduce the number of layers of testing dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46757: Assignee: Ruifeng Zheng > Reduce the number of layers of testing dockerfile >

[jira] [Updated] (SPARK-46753) Fix `pypy3` python test

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46753: Summary: Fix `pypy3` python test (was: Skip `test_session` `test_udf` if PyArrow is not

[jira] [Updated] (SPARK-46744) Display clear exit command for all spark terminal

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Summary: Display clear exit command for all spark terminal (was: Display clear `exit command`

[jira] [Updated] (SPARK-46744) Display clear exit command for all spark terminal

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Component/s: Connect PySpark R Spark Shell

[jira] [Updated] (SPARK-46757) Reduce the number of layers of testing dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46757: --- Labels: pull-request-available (was: ) > Reduce the number of layers of testing dockerfile

[jira] [Created] (SPARK-46757) Reduce the number of layers of testing dockerfile

Ruifeng Zheng created SPARK-46757: - Summary: Reduce the number of layers of testing dockerfile Key: SPARK-46757 URL: https://issues.apache.org/jira/browse/SPARK-46757 Project: Spark Issue

[jira] [Updated] (SPARK-46662) Upgrade kubernetes-client to 6.10.0 for K8s v1.29.0

[ https://issues.apache.org/jira/browse/SPARK-46662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46662: -- Summary: Upgrade kubernetes-client to 6.10.0 for K8s v1.29.0 (was: Upgrade kubernetes-client

[jira] [Updated] (SPARK-46662) Upgrade kubernetes-client to 6.10.0

[ https://issues.apache.org/jira/browse/SPARK-46662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46662: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Upgrade

[jira] [Created] (SPARK-46756) Add rule to rewrite null safe equality join keys

XiDuo You created SPARK-46756: - Summary: Add rule to rewrite null safe equality join keys Key: SPARK-46756 URL: https://issues.apache.org/jira/browse/SPARK-46756 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46755) Upgrade `Volcano` to 1.8.2

[ https://issues.apache.org/jira/browse/SPARK-46755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46755: --- Labels: pull-request-available (was: ) > Upgrade `Volcano` to 1.8.2 >

[jira] [Created] (SPARK-46755) Upgrade `Volcano` to 1.8.2

Dongjoon Hyun created SPARK-46755: - Summary: Upgrade `Volcano` to 1.8.2 Key: SPARK-46755 URL: https://issues.apache.org/jira/browse/SPARK-46755 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46754) Fix compression code resolution in avro table definition

Kent Yao created SPARK-46754: Summary: Fix compression code resolution in avro table definition Key: SPARK-46754 URL: https://issues.apache.org/jira/browse/SPARK-46754 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46745) Purge pip cache in dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46745. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44768

[jira] [Resolved] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Inter

[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45593. -- Resolution: Fixed Issue resolved by pull request 43436 [https://github.com/apache/spark/pull/43436]

[jira] [Assigned] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.Inter

[ https://issues.apache.org/jira/browse/SPARK-45593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45593: Assignee: yikaifei > Building a runnable distribution from master code running spark-sql raise

[jira] [Updated] (SPARK-46753) Skip `test_session` `test_udf` if PyArrow is not installed

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46753: --- Labels: pull-request-available (was: ) > Skip `test_session` `test_udf` if PyArrow is not

[jira] [Resolved] (SPARK-46644) Fix add in SQLMetric

[ https://issues.apache.org/jira/browse/SPARK-46644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46644. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44649

[jira] [Updated] (SPARK-46753) Skip `test_session` `test_udf` if PyArrow is not installed

[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46753: Summary: Skip `test_session` `test_udf` if PyArrow is not installed (was: Skip test_session if

[jira] [Updated] (SPARK-46752) Use default ORC compression in data source benchmarks

[ https://issues.apache.org/jira/browse/SPARK-46752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46752: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Use default ORC compression

[jira] [Updated] (SPARK-46737) Use the default ORC compression in OrcReadBenchmark

[ https://issues.apache.org/jira/browse/SPARK-46737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46737: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Use the default ORC

[jira] [Resolved] (SPARK-46752) Use default ORC compression in data source benchmarks

[ https://issues.apache.org/jira/browse/SPARK-46752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46752. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44777

[jira] [Assigned] (SPARK-46752) Use default ORC compression in data source benchmarks

[ https://issues.apache.org/jira/browse/SPARK-46752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46752: - Assignee: Dongjoon Hyun > Use default ORC compression in data source benchmarks >

[jira] [Updated] (SPARK-46752) Use default ORC compression in data source benchmarks

[ https://issues.apache.org/jira/browse/SPARK-46752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46752: --- Labels: pull-request-available (was: ) > Use default ORC compression in data source

[jira] [Created] (SPARK-46752) Use default ORC compression in data source benchmarks

Dongjoon Hyun created SPARK-46752: - Summary: Use default ORC compression in data source benchmarks Key: SPARK-46752 URL: https://issues.apache.org/jira/browse/SPARK-46752 Project: Spark

[jira] [Resolved] (SPARK-46751) Skip test_datasource if PyArrow is not installed

[ https://issues.apache.org/jira/browse/SPARK-46751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46751. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44776

[jira] [Assigned] (SPARK-46751) Skip test_datasource if PyArrow is not installed

[ https://issues.apache.org/jira/browse/SPARK-46751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46751: - Assignee: Hyukjin Kwon > Skip test_datasource if PyArrow is not installed >

[jira] [Resolved] (SPARK-46748) Remove `*slave*.sh` scripts

[ https://issues.apache.org/jira/browse/SPARK-46748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46748. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44773

[jira] [Updated] (SPARK-42862) Review and fix issues in Core API docs

[ https://issues.apache.org/jira/browse/SPARK-42862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42862: - Parent: SPARK-42523 (was: SPARK-42693) > Review and fix issues in Core API docs >

[jira] [Updated] (SPARK-42863) Review and fix issues in PySpark API docs

[ https://issues.apache.org/jira/browse/SPARK-42863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42863: - Parent: SPARK-42523 (was: SPARK-42693) > Review and fix issues in PySpark API docs >

[jira] [Updated] (SPARK-42864) Review and fix issues in MLlib API docs

[ https://issues.apache.org/jira/browse/SPARK-42864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42864: - Parent: SPARK-42523 (was: SPARK-42693) > Review and fix issues in MLlib API docs >

[jira] [Updated] (SPARK-42861) Review and fix issues in SQL API docs

[ https://issues.apache.org/jira/browse/SPARK-42861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42861: - Parent: SPARK-42523 (was: SPARK-42693) > Review and fix issues in SQL API docs >

[jira] [Updated] (SPARK-42866) Review and fix issues in Spark Connect - Scala API docs

[ https://issues.apache.org/jira/browse/SPARK-42866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42866: - Parent: SPARK-42523 (was: SPARK-42693) > Review and fix issues in Spark Connect - Scala API

[jira] [Updated] (SPARK-42693) API Auditing

[ https://issues.apache.org/jira/browse/SPARK-42693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42693: - Parent: SPARK-42523 Issue Type: Sub-task (was: Story) > API Auditing > >

[jira] [Resolved] (SPARK-42523) Apache Spark 3.4 release

[ https://issues.apache.org/jira/browse/SPARK-42523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42523. -- Resolution: Done > Apache Spark 3.4 release > > >

[jira] [Updated] (SPARK-46751) Skip test_datasource if PyArrow is not installed

[ https://issues.apache.org/jira/browse/SPARK-46751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46751: - Parent: SPARK-44076 Issue Type: Sub-task (was: Test) > Skip test_datasource if PyArrow

[jira] [Updated] (SPARK-46751) Skip test_datasource if PyArrow is not installed

[ https://issues.apache.org/jira/browse/SPARK-46751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46751: --- Labels: pull-request-available (was: ) > Skip test_datasource if PyArrow is not installed

[jira] [Created] (SPARK-46751) Skip test_datasource if PyArrow is not installed

Hyukjin Kwon created SPARK-46751: Summary: Skip test_datasource if PyArrow is not installed Key: SPARK-46751 URL: https://issues.apache.org/jira/browse/SPARK-46751 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46749) Document `SPARK_LOG_*` and `SPARK_PID_DIR`

[ https://issues.apache.org/jira/browse/SPARK-46749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46749. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44774

[jira] [Updated] (SPARK-46750) DataFrame APIs code clean up

[ https://issues.apache.org/jira/browse/SPARK-46750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46750: --- Labels: pull-request-available (was: ) > DataFrame APIs code clean up >

[jira] [Assigned] (SPARK-46750) DataFrame APIs code clean up

[ https://issues.apache.org/jira/browse/SPARK-46750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46750: - Assignee: Ruifeng Zheng > DataFrame APIs code clean up >

[jira] [Resolved] (SPARK-46750) DataFrame APIs code clean up

[ https://issues.apache.org/jira/browse/SPARK-46750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46750. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44771

[jira] [Created] (SPARK-46750) DataFrame APIs code clean up

Ruifeng Zheng created SPARK-46750: - Summary: DataFrame APIs code clean up Key: SPARK-46750 URL: https://issues.apache.org/jira/browse/SPARK-46750 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46663) Disable memory profiler for pandas UDFs with iterators

[ https://issues.apache.org/jira/browse/SPARK-46663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46663. -- Fix Version/s: 3.5.1 Resolution: Fixed Issue resolved by pull request 44760

[jira] [Resolved] (SPARK-46686) Basic support of SparkSession based Python UDF profiler

[ https://issues.apache.org/jira/browse/SPARK-46686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46686. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44697

[jira] [Updated] (SPARK-46736) Retain empty protobuf message in schema for rpotobuf connector

[ https://issues.apache.org/jira/browse/SPARK-46736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46736: --- Labels: pull-request-available (was: ) > Retain empty protobuf message in schema for

[jira] [Updated] (SPARK-46748) Remove `*slave*.sh` scripts

[ https://issues.apache.org/jira/browse/SPARK-46748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46748: -- Summary: Remove `*slave*.sh` scripts (was: Remove `*slave*` scripts) > Remove `*slave*.sh`

[jira] [Assigned] (SPARK-46749) Document `SPARK_LOG_*` and `SPARK_PID_DIR`

[ https://issues.apache.org/jira/browse/SPARK-46749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46749: - Assignee: Dongjoon Hyun > Document `SPARK_LOG_*` and `SPARK_PID_DIR` >

[jira] [Updated] (SPARK-46749) Document `SPARK_LOG_*` and `SPARK_PID_DIR`

[ https://issues.apache.org/jira/browse/SPARK-46749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46749: --- Labels: pull-request-available (was: ) > Document `SPARK_LOG_*` and `SPARK_PID_DIR` >

[jira] [Created] (SPARK-46749) Document `SPARK_LOG_*` and `SPARK_PID_DIR`

Dongjoon Hyun created SPARK-46749: - Summary: Document `SPARK_LOG_*` and `SPARK_PID_DIR` Key: SPARK-46749 URL: https://issues.apache.org/jira/browse/SPARK-46749 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46748) Remove `*slave*` scripts

[ https://issues.apache.org/jira/browse/SPARK-46748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46748: --- Labels: pull-request-available (was: ) > Remove `*slave*` scripts >

[jira] [Created] (SPARK-46748) Remove `*slave*` scripts

Dongjoon Hyun created SPARK-46748: - Summary: Remove `*slave*` scripts Key: SPARK-46748 URL: https://issues.apache.org/jira/browse/SPARK-46748 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-46746) Attach codec extension to avro datasource files

[ https://issues.apache.org/jira/browse/SPARK-46746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46746: - Assignee: Kent Yao > Attach codec extension to avro datasource files >

[jira] [Resolved] (SPARK-46746) Attach codec extension to avro datasource files

[ https://issues.apache.org/jira/browse/SPARK-46746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46746. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44770

[jira] [Comment Edited] (SPARK-46072) Missing .jars when applying code to spark-connect

[ https://issues.apache.org/jira/browse/SPARK-46072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807726#comment-17807726 ] Dmitry Kravchuk edited comment on SPARK-46072 at 1/17/24 1:45 PM: --

[jira] [Commented] (SPARK-46072) Missing .jars when applying code to spark-connect

[ https://issues.apache.org/jira/browse/SPARK-46072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807726#comment-17807726 ] Dmitry Kravchuk commented on SPARK-46072: - Looks like I've missed this

[jira] [Created] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

Bala Bellam created SPARK-46747: --- Summary: Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1 Key: SPARK-46747 URL: https://issues.apache.org/jira/browse/SPARK-46747 Project:

[jira] [Updated] (SPARK-46746) Attach codec extension to avro datasource files

[ https://issues.apache.org/jira/browse/SPARK-46746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46746: --- Labels: pull-request-available (was: ) > Attach codec extension to avro datasource files >

[jira] [Resolved] (SPARK-46739) Add an error class for unsupported method calls

[ https://issues.apache.org/jira/browse/SPARK-46739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46739. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44757

[jira] [Created] (SPARK-46746) Attach codec extension to avro datasource files

Kent Yao created SPARK-46746: Summary: Attach codec extension to avro datasource files Key: SPARK-46746 URL: https://issues.apache.org/jira/browse/SPARK-46746 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46744) Display clear `exit command` for the terminal: `spark-shell`, `spark-sql` and `spark-connect-repl`

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Summary: Display clear `exit command` for the terminal: `spark-shell`, `spark-sql` and

[jira] [Assigned] (SPARK-46744) Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46744: -- Assignee: (was: Apache Spark) > Prompt for exit command after `spark-shell`

[jira] [Assigned] (SPARK-46744) Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46744: -- Assignee: Apache Spark > Prompt for exit command after `spark-shell` `spark-sql`

[jira] [Updated] (SPARK-46744) Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46744: --- Labels: pull-request-available (was: ) > Prompt for exit command after `spark-shell`

[jira] [Updated] (SPARK-46744) Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

[ https://issues.apache.org/jira/browse/SPARK-46744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46744: Summary: Prompt for exit command after `spark-shell` `spark-sql` `spark-connect-repl` startup

[jira] [Updated] (SPARK-46745) Purge pip cache in dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46745: --- Labels: pull-request-available (was: ) > Purge pip cache in dockerfile >

[jira] [Created] (SPARK-46745) Remove pip cache after installation in Dockerfile

Ruifeng Zheng created SPARK-46745: - Summary: Remove pip cache after installation in Dockerfile Key: SPARK-46745 URL: https://issues.apache.org/jira/browse/SPARK-46745 Project: Spark Issue

[jira] [Updated] (SPARK-46741) CacheTable AsSelect should inherit from CTEInChildren to make sure it can be matched

[ https://issues.apache.org/jira/browse/SPARK-46741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46741: --- Labels: pull-request-available (was: ) > CacheTable AsSelect should inherit from

[jira] [Created] (SPARK-46744) Prompt for exit command after `spark-shell` startup

BingKun Pan created SPARK-46744: --- Summary: Prompt for exit command after `spark-shell` startup Key: SPARK-46744 URL: https://issues.apache.org/jira/browse/SPARK-46744 Project: Spark Issue

[jira] [Updated] (SPARK-46739) Add an error class for unsupported method calls

[ https://issues.apache.org/jira/browse/SPARK-46739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46739: --- Labels: pull-request-available (was: ) > Add an error class for unsupported method calls >

[jira] [Updated] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Description: The following doctest will throw an error in the tests of the pyspark-connect

[jira] [Updated] (SPARK-46738) `Cast` of pyspark displayed different results between Regular Spark and Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-46738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46738: Attachment: screenshot-1.png > `Cast` of pyspark displayed different results between Regular