[jira] [Updated] (SPARK-43656) Enable NumPy compat tests

2023-10-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43656: Summary: Enable NumPy compat tests (was: Fix pyspark.sql.column._to_java_column to accept Connect

[jira] [Updated] (SPARK-45421) Catch AnalysisException over InlineCTE

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45421: --- Labels: pull-request-available (was: ) > Catch AnalysisException over InlineCTE > -

[jira] [Created] (SPARK-45421) Catch AnalysisException over InlineCTE

2023-10-04 Thread Rui Wang (Jira)
Rui Wang created SPARK-45421: Summary: Catch AnalysisException over InlineCTE Key: SPARK-45421 URL: https://issues.apache.org/jira/browse/SPARK-45421 Project: Spark Issue Type: Task Com

[jira] [Created] (SPARK-45420) Add DataType.fromDDL into PySpark

2023-10-04 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45420: Summary: Add DataType.fromDDL into PySpark Key: SPARK-45420 URL: https://issues.apache.org/jira/browse/SPARK-45420 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45417) Make InheritableThread inherit the active session

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45417: --- Labels: pull-request-available (was: ) > Make InheritableThread inherit the active session

[jira] [Updated] (SPARK-45417) Make InheritableThread inherit the active session

2023-10-04 Thread Chungmin Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chungmin Lee updated SPARK-45417: - Description: Repro: {code:java} # repro.py from multiprocessing.pool import ThreadPool from pys

[jira] [Updated] (SPARK-45417) Make InheritableThread inherit the active session

2023-10-04 Thread Chungmin Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chungmin Lee updated SPARK-45417: - Summary: Make InheritableThread inherit the active session (was: Make InheritableThread inherit

[jira] [Updated] (SPARK-45417) Make InheritableThread inherit active session

2023-10-04 Thread Chungmin Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chungmin Lee updated SPARK-45417: - Summary: Make InheritableThread inherit active session (was: InheritableThread doesn't inherit

[jira] [Resolved] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45386. -- Fix Version/s: 3.5.1 Resolution: Fixed Issue resolved by pull request 43213 [https://gi

[jira] [Assigned] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45386: Assignee: Emil Ejbyfeldt > Correctness issue when persisting using StorageLevel.NONE > --

[jira] [Resolved] (SPARK-45412) Validate the plan and session in DataFrame.__init__

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45412. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43215 [https://gi

[jira] [Assigned] (SPARK-45412) Validate the plan and session in DataFrame.__init__

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45412: Assignee: Ruifeng Zheng > Validate the plan and session in DataFrame.__init__ > -

[jira] [Updated] (SPARK-43657) reuse SPARK_CONF_DIR config maps between driver and executor

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43657: --- Labels: pull-request-available (was: ) > reuse SPARK_CONF_DIR config maps between driver an

[jira] [Updated] (SPARK-42629) Update the description of default data source in the document

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42629: --- Labels: pull-request-available (was: ) > Update the description of default data source in t

[jira] [Updated] (SPARK-42727) Support executing spark commands in the root directory when local mode is specified

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42727: --- Labels: pull-request-available (was: ) > Support executing spark commands in the root direc

[jira] [Updated] (SPARK-44025) CSV Table Read Error with CharType(length) column

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44025: --- Labels: pull-request-available (was: ) > CSV Table Read Error with CharType(length) column

[jira] [Updated] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43255: --- Labels: pull-request-available starter (was: starter) > Assign a name to the error class _L

[jira] [Updated] (SPARK-44082) Generate operator does not update reference set properly

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44082: --- Labels: pull-request-available (was: ) > Generate operator does not update reference set pr

[jira] [Updated] (SPARK-44137) Change handling of iterable objects for on field in joins

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44137: --- Labels: pull-request-available (was: ) > Change handling of iterable objects for on field i

[jira] [Resolved] (SPARK-45345) Refactor release-build.sh

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45345. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43212 [https://gi

[jira] [Assigned] (SPARK-45345) Refactor release-build.sh

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45345: Assignee: Hyukjin Kwon > Refactor release-build.sh > - > >

[jira] [Updated] (SPARK-45009) Correlated EXISTS subqueries in join ON condition unsupported and fail with internal error

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45009: --- Labels: pull-request-available (was: ) > Correlated EXISTS subqueries in join ON condition

[jira] [Resolved] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45396. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43210 [https://gi

[jira] [Assigned] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45396: Assignee: Weichen Xu > Add doc entry for `pyspark.ml.connect` module > --

[jira] [Resolved] (SPARK-45410) Add Python GitHub Action Daily Job

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45410. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43209 [https://

[jira] [Updated] (SPARK-28973) Add TimeType to Catalyst

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-28973: --- Labels: pull-request-available (was: ) > Add TimeType to Catalyst > ---

[jira] [Commented] (SPARK-45418) Change CURRENT_SCHEMA() column alias to match function name

2023-10-04 Thread Michael Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771992#comment-17771992 ] Michael Zhang commented on SPARK-45418: --- I am currently working on this > Change

[jira] [Created] (SPARK-45418) Change CURRENT_SCHEMA() column alias to match function name

2023-10-04 Thread Michael Zhang (Jira)
Michael Zhang created SPARK-45418: - Summary: Change CURRENT_SCHEMA() column alias to match function name Key: SPARK-45418 URL: https://issues.apache.org/jira/browse/SPARK-45418 Project: Spark

[jira] [Updated] (SPARK-45408) [CORE] Add RPC SSL settings to TransportConf

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45408: --- Labels: pull-request-available (was: ) > [CORE] Add RPC SSL settings to TransportConf > ---

[jira] [Updated] (SPARK-45416) Sanity check that Spark Connect returns arrow batches in order

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45416: --- Labels: pull-request-available (was: ) > Sanity check that Spark Connect returns arrow batc

[jira] [Created] (SPARK-45417) InheritableThread doesn't inherit active session

2023-10-04 Thread Chungmin Lee (Jira)
Chungmin Lee created SPARK-45417: Summary: InheritableThread doesn't inherit active session Key: SPARK-45417 URL: https://issues.apache.org/jira/browse/SPARK-45417 Project: Spark Issue Type:

[jira] [Created] (SPARK-45416) Sanity check that Spark Connect returns arrow batches in order

2023-10-04 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-45416: - Summary: Sanity check that Spark Connect returns arrow batches in order Key: SPARK-45416 URL: https://issues.apache.org/jira/browse/SPARK-45416 Project: Spa

[jira] [Commented] (SPARK-45391) spark-connect-repl is not working on macOS

2023-10-04 Thread Michael Baker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771928#comment-17771928 ] Michael Baker commented on SPARK-45391: --- I'm getting this same error after install

[jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert

2023-10-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771921#comment-17771921 ] Hudson commented on SPARK-38200: User 'EnricoMi' has created a pull request for this iss

[jira] [Commented] (SPARK-43991) Use the value of spark.eventLog.compression.codec set by user when write compact file

2023-10-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771920#comment-17771920 ] Hudson commented on SPARK-43991: User 'shuyouZZ' has created a pull request for this iss

[jira] [Resolved] (SPARK-45404) Support AWS_ENDPOINT_URL env variable

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45404. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43205 [https://

[jira] [Assigned] (SPARK-45404) Support AWS_ENDPOINT_URL env variable

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45404: - Assignee: Dongjoon Hyun > Support AWS_ENDPOINT_URL env variable > -

[jira] [Updated] (SPARK-44735) Log a warning when inserting columns with the same name by row that don't match up

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44735: --- Labels: pull-request-available (was: ) > Log a warning when inserting columns with the same

[jira] [Updated] (SPARK-45413) Add warning for prepare drop LevelDB support

2023-10-04 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan updated SPARK-45413: Summary: Add warning for prepare drop LevelDB support (was: Drop leveldb support for `spark.history.store

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Reopened] (SPARK-45088) Make `getitem` work with duplicated columns

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-45088: --- Assignee: (was: Ruifeng Zheng) > Make `getitem` work with duplicated columns > ---

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Description: h1. Intro Hi all! Please expect some degree of incompleteness in this is

[jira] [Updated] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giuseppe Ceravolo updated SPARK-45414: -- Attachment: IllegalArgumentException.txt > spark-xml misplaces string tag content > --

[jira] [Created] (SPARK-45414) spark-xml misplaces string tag content

2023-10-04 Thread Giuseppe Ceravolo (Jira)
Giuseppe Ceravolo created SPARK-45414: - Summary: spark-xml misplaces string tag content Key: SPARK-45414 URL: https://issues.apache.org/jira/browse/SPARK-45414 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45093) AddArtifacts should give proper error messages if it fails

2023-10-04 Thread Nikita Awasthi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771836#comment-17771836 ] Nikita Awasthi commented on SPARK-45093: User 'cdkrot' has created a pull reques

[jira] [Updated] (SPARK-45413) Drop leveldb support for `spark.history.store.hybridStore.diskBackend`

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45413: --- Labels: pull-request-available (was: ) > Drop leveldb support for `spark.history.store.hybr

[jira] [Updated] (SPARK-45394) Retry handling for add_artifact

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45394: --- Labels: pull-request-available (was: ) > Retry handling for add_artifact >

[jira] [Commented] (SPARK-44223) Drop leveldb support

2023-10-04 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771824#comment-17771824 ] Jia Fan commented on SPARK-44223: - Drop leveldb support for `spark.shuffle.service.db.ba

[jira] [Created] (SPARK-45413) Drop leveldb support for `spark.history.store.hybridStore.diskBackend`

2023-10-04 Thread Jia Fan (Jira)
Jia Fan created SPARK-45413: --- Summary: Drop leveldb support for `spark.history.store.hybridStore.diskBackend` Key: SPARK-45413 URL: https://issues.apache.org/jira/browse/SPARK-45413 Project: Spark

[jira] [Updated] (SPARK-45412) Validate the plan and session in DataFrame.__init__

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45412: --- Labels: pull-request-available (was: ) > Validate the plan and session in DataFrame.__init_

[jira] [Created] (SPARK-45412) Validate the plan and session in DataFrame.__init__

2023-10-04 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45412: - Summary: Validate the plan and session in DataFrame.__init__ Key: SPARK-45412 URL: https://issues.apache.org/jira/browse/SPARK-45412 Project: Spark Issue T

[jira] [Assigned] (SPARK-45355) Fix function groups in Scala Doc

2023-10-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45355: - Assignee: Ruifeng Zheng > Fix function groups in Scala Doc > --

[jira] [Resolved] (SPARK-45355) Fix function groups in Scala Doc

2023-10-04 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45355. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43148 [https://

[jira] [Updated] (SPARK-43656) Fix pyspark.sql.column._to_java_column to accept Connect Column

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43656: --- Labels: pull-request-available (was: ) > Fix pyspark.sql.column._to_java_column to accept C

[jira] [Assigned] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45386: -- Assignee: (was: Apache Spark) > Correctness issue when persisting using StorageLe

[jira] [Assigned] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45386: -- Assignee: Apache Spark > Correctness issue when persisting using StorageLevel.NONE >

[jira] [Assigned] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45386: -- Assignee: Apache Spark > Correctness issue when persisting using StorageLevel.NONE >

[jira] [Assigned] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45386: -- Assignee: (was: Apache Spark) > Correctness issue when persisting using StorageLe

[jira] [Assigned] (SPARK-45355) Fix function groups in Scala Doc

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45355: -- Assignee: (was: Apache Spark) > Fix function groups in Scala Doc > --

[jira] [Assigned] (SPARK-45355) Fix function groups in Scala Doc

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45355: -- Assignee: Apache Spark > Fix function groups in Scala Doc > -

[jira] [Assigned] (SPARK-45345) Refactor release-build.sh

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45345: -- Assignee: Apache Spark > Refactor release-build.sh > - > >

[jira] [Assigned] (SPARK-45345) Refactor release-build.sh

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45345: -- Assignee: (was: Apache Spark) > Refactor release-build.sh > -

[jira] [Deleted] (SPARK-45411) Fix snapshot build in publish_snapshot.yml

2023-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-45411: - > Fix snapshot build in publish_snapshot.yml > -- > >

[jira] [Created] (SPARK-45411) Fix snapshot build in publish_snapshot.yml

2023-10-04 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45411: Summary: Fix snapshot build in publish_snapshot.yml Key: SPARK-45411 URL: https://issues.apache.org/jira/browse/SPARK-45411 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-45345) Refactor release-build.sh

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45345: --- Labels: pull-request-available (was: ) > Refactor release-build.sh > --

[jira] [Resolved] (SPARK-45398) Include `ESCAPE` to `sql()` of `Like`

2023-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-45398. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43196 [https://github.com

[jira] [Updated] (SPARK-45398) Include `ESCAPE` to `sql()` of `Like`

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45398: --- Labels: pull-request-available (was: ) > Include `ESCAPE` to `sql()` of `Like` > --

[jira] [Updated] (SPARK-45400) Refer to the unescaping rules from expression descriptions

2023-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45400: --- Labels: pull-request-available (was: ) > Refer to the unescaping rules from expression desc

[jira] [Commented] (SPARK-44223) Drop leveldb support

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17771736#comment-17771736 ] Dongjoon Hyun commented on SPARK-44223: --- This will happen at Apache Spark 4.1.0 be

[jira] [Updated] (SPARK-44223) Drop leveldb support

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44223: -- Parent: (was: SPARK-44111) Issue Type: Task (was: Sub-task) > Drop leveldb suppor

[jira] [Resolved] (SPARK-45409) Pin `torch<=2.0.1`

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45409. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43207 [https://

[jira] [Assigned] (SPARK-45409) Pin `torch<=2.0.1`

2023-10-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45409: - Assignee: Dongjoon Hyun > Pin `torch<=2.0.1` > -- > > K