[jira] [Resolved] (SPARK-46144) Fail INSERT INTO ... REPLACE statement if the condition contains subquery

2023-11-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-46144. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44060 [https:

[jira] [Assigned] (SPARK-46144) Fail INSERT INTO ... REPLACE statement if the condition contains subquery

2023-11-29 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-46144: -- Assignee: Gengliang Wang > Fail INSERT INTO ... REPLACE statement if the condition co

[jira] [Resolved] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46181. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44088 [https://gi

[jira] [Assigned] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46181: Assignee: Hyukjin Kwon > Split scheduled Python build > > >

[jira] [Resolved] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46178. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44087 [https://gi

[jira] [Assigned] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46178: Assignee: Hyukjin Kwon > Move MockDF under PlanOnlyTestFixture >

[jira] [Resolved] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46177. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44086 [https://gi

[jira] [Assigned] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46177: Assignee: Hyukjin Kwon > Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' wi

[jira] [Updated] (SPARK-46182) Shuffle data lost on decommissioned executor caused by race condition between lastTaskRunningTime and lastShuffleMigrationTime

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46182: --- Labels: pull-request-available (was: ) > Shuffle data lost on decommissioned executor cause

[jira] [Commented] (SPARK-46032) connect: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f

2023-11-29 Thread Erik Ordentlich (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791423#comment-17791423 ] Erik Ordentlich commented on SPARK-46032: - I'm seeing the same error when going

[jira] [Created] (SPARK-46182) Shuffle data lost on decommissioned executor caused by race condition between lastTaskRunningTime and lastShuffleMigrationTime

2023-11-29 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-46182: Summary: Shuffle data lost on decommissioned executor caused by race condition between lastTaskRunningTime and lastShuffleMigrationTime Key: SPARK-46182 URL: https://issues.apache

[jira] [Assigned] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46151: Assignee: BingKun Pan > Hide the "More" drop-down button in the PySpark docs navigation b

[jira] [Resolved] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46151. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44068 [https://gi

[jira] [Resolved] (SPARK-46152) XML: Add DecimalType support in schema inference

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46152. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44069 [https://gi

[jira] [Assigned] (SPARK-46152) XML: Add DecimalType support in schema inference

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46152: Assignee: Sandip Agarwala > XML: Add DecimalType support in schema inference > --

[jira] [Assigned] (SPARK-46056) Vectorized parquet reader throws NPE when reading files with DecimalType default values

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46056: Assignee: Cosmin Dumitru > Vectorized parquet reader throws NPE when reading files with D

[jira] [Assigned] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45943: Assignee: Zhen Wang > DataSourceV2Relation.computeStats throws IllegalStateException in t

[jira] [Resolved] (SPARK-46056) Vectorized parquet reader throws NPE when reading files with DecimalType default values

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46056. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43960 [https://gi

[jira] [Updated] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45943: - Fix Version/s: 3.5.2 (was: 3.5.1) > DataSourceV2Relation.computeStats thr

[jira] [Resolved] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45943. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46181: --- Labels: pull-request-available (was: ) > Split scheduled Python build > ---

[jira] [Created] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46181: Summary: Split scheduled Python build Key: SPARK-46181 URL: https://issues.apache.org/jira/browse/SPARK-46181 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-46176) Union of two kryo-encoded Dataset[Object] produces rows of bytes

2023-11-29 Thread Vitalii Tymchyshyn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Tymchyshyn updated SPARK-46176: --- Description: [https://github.com/apache/spark/blob/9987cab84bb05a61a5c0b43f94a733561

[jira] [Resolved] (SPARK-46180) Reduce the number of shuffle partitions in pandas-on-Spark test cases

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46180. -- Resolution: Invalid > Reduce the number of shuffle partitions in pandas-on-Spark test cases >

[jira] [Created] (SPARK-46180) Reduce the number of shuffle partitions in pandas-on-Spark test cases

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46180: Summary: Reduce the number of shuffle partitions in pandas-on-Spark test cases Key: SPARK-46180 URL: https://issues.apache.org/jira/browse/SPARK-46180 Project: Spark

[jira] [Created] (SPARK-46179) Generate golden files for SQLQueryTestSuites with Postgres

2023-11-29 Thread Andy Lam (Jira)
Andy Lam created SPARK-46179: Summary: Generate golden files for SQLQueryTestSuites with Postgres Key: SPARK-46179 URL: https://issues.apache.org/jira/browse/SPARK-46179 Project: Spark Issue Type

[jira] [Updated] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46178: --- Labels: pull-request-available (was: ) > Move MockDF under PlanOnlyTestFixture > --

[jira] [Updated] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46178: - Issue Type: Test (was: Improvement) > Move MockDF under PlanOnlyTestFixture > -

[jira] [Created] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46178: Summary: Move MockDF under PlanOnlyTestFixture Key: SPARK-46178 URL: https://issues.apache.org/jira/browse/SPARK-46178 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46177: --- Labels: pull-request-available (was: ) > Skip 'CrossValidatorTests.test_crossvalidator_wit

[jira] [Created] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46177: Summary: Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12 Key: SPARK-46177 URL: https://issues.apache.org/jira/browse/SPARK-46177 Projec

[jira] [Updated] (SPARK-45940) Add InputPartition to DataSourceReader interface

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45940: --- Labels: pull-request-available (was: ) > Add InputPartition to DataSourceReader interface >

[jira] [Updated] (SPARK-44864) Align streaming statistics link format with other page links

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44864: --- Labels: pull-request-available (was: ) > Align streaming statistics link format with other

[jira] [Updated] (SPARK-44793) WholeStageCodeGen pipelineTime metric incorrect result.

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44793: --- Labels: pull-request-available (was: ) > WholeStageCodeGen pipelineTime metric incorrect re

[jira] [Created] (SPARK-46176) Union of two kryo-encoded Dataset[Object] produces rows of bytes

2023-11-29 Thread Vitalii Tymchyshyn (Jira)
Vitalii Tymchyshyn created SPARK-46176: -- Summary: Union of two kryo-encoded Dataset[Object] produces rows of bytes Key: SPARK-46176 URL: https://issues.apache.org/jira/browse/SPARK-46176 Project:

[jira] [Assigned] (SPARK-46060) Upgrade jdbc related test dependencies

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46060: - Assignee: BingKun Pan > Upgrade jdbc related test dependencies > --

[jira] [Resolved] (SPARK-46060) Upgrade jdbc related test dependencies

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46060. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43963 [https://

[jira] [Updated] (SPARK-46060) Upgrade `MySQL/MariaDB/PostgreSQL/DB2` test dependencies

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46060: -- Summary: Upgrade `MySQL/MariaDB/PostgreSQL/DB2` test dependencies (was: Upgrade jdbc related

[jira] [Assigned] (SPARK-46133) Refine ShuffleWriteProcessor write methods comment

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46133: - Assignee: Binjie Yang > Refine ShuffleWriteProcessor write methods comment > --

[jira] [Resolved] (SPARK-46133) Refine ShuffleWriteProcessor write methods comment

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46133. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44054 [https://

[jira] [Resolved] (SPARK-46169) Assign appropriate JIRA numbers to unlabeled TODO items for DataFrame API.

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46169. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44073 [https://

[jira] [Assigned] (SPARK-46169) Assign appropriate JIRA numbers to unlabeled TODO items for DataFrame API.

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46169: - Assignee: Haejoon Lee > Assign appropriate JIRA numbers to unlabeled TODO items for Dat

[jira] [Resolved] (SPARK-46172) Describe arguments of encode()

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46172. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44078 [https://

[jira] [Resolved] (SPARK-46174) Upgrade `gcs-connector` to 2.2.18

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46174. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44081 [https://

[jira] [Updated] (SPARK-46175) can't return prediction that has different length than ml input

2023-11-29 Thread Ryan Avery (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Avery updated SPARK-46175: --- Description: I'm using   from pyspark.ml.functions import predict_batch_udf to construct a pandas u

[jira] [Created] (SPARK-46175) can't return prediction that has different length than ml input

2023-11-29 Thread Ryan Avery (Jira)
Ryan Avery created SPARK-46175: -- Summary: can't return prediction that has different length than ml input Key: SPARK-46175 URL: https://issues.apache.org/jira/browse/SPARK-46175 Project: Spark

[jira] [Resolved] (SPARK-46124) Replace explicit `ArrayOps#toSeq` with `s.c.immutable.ArraySeq.unsafeWrapArray`

2023-11-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-46124. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44041 [https://gi

[jira] [Resolved] (SPARK-45746) Return specific error messages if UDTF 'analyze' method accepts or returns wrong values

2023-11-29 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-45746. --- Fix Version/s: 4.0.0 Assignee: Daniel Resolution: Fixed Issue resolved by pu

[jira] [Commented] (SPARK-38473) Use error classes in org.apache.spark.scheduler

2023-11-29 Thread Hannah Amundson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791247#comment-17791247 ] Hannah Amundson commented on SPARK-38473: - Hi [~maxgekk]  [~bozhang]! This one i

[jira] [Updated] (SPARK-46174) Upgrade `gcs-connector` to 2.2.18

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46174: --- Labels: pull-request-available (was: ) > Upgrade `gcs-connector` to 2.2.18 > --

[jira] [Resolved] (SPARK-46155) Upgrade github-script action to v7

2023-11-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46155. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44071 [https://

[jira] [Resolved] (SPARK-46141) Change default of spark.sql.legacy.ctePrecedencePolicy from EXCEPTION to CORRECTED

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46141. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44058 [https://gith

[jira] [Created] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

2023-11-29 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46173: Summary: Skipping trimAll call in stringToDate functions to avoid needless string copy Key: SPARK-46173 URL: https://issues.apache.org/jira/browse/SPARK-46173

[jira] [Comment Edited] (SPARK-46143) pyspark.pandas read_excel implementation at version 3.4.1

2023-11-29 Thread Matheus Pavanetti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791153#comment-17791153 ] Matheus Pavanetti edited comment on SPARK-46143 at 11/29/23 3:59 PM: -

[jira] [Commented] (SPARK-46143) pyspark.pandas read_excel implementation at version 3.4.1

2023-11-29 Thread Matheus Pavanetti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791153#comment-17791153 ] Matheus Pavanetti commented on SPARK-46143: --- Tested the same scenario on a spa

[jira] [Updated] (SPARK-46143) pyspark.pandas read_excel implementation at version 3.4.1

2023-11-29 Thread Matheus Pavanetti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matheus Pavanetti updated SPARK-46143: -- Environment: pyspark 3.4.1.5.3 build 20230713. Running on Microsoft Fabric workspace

[jira] [Assigned] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46036: --- Assignee: Aleksandar Tomic > raise_error should only take the error class parameter for int

[jira] [Commented] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Aleksandar Tomic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791143#comment-17791143 ] Aleksandar Tomic commented on SPARK-46036: -- This is done now. > raise_error sh

[jira] [Updated] (SPARK-46172) Describe arguments of encode()

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46172: --- Labels: pull-request-available (was: ) > Describe arguments of encode() > -

[jira] [Resolved] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46036. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44004 [https://gith

[jira] [Created] (SPARK-46172) Describe arguments of encode()

2023-11-29 Thread Max Gekk (Jira)
Max Gekk created SPARK-46172: Summary: Describe arguments of encode() Key: SPARK-46172 URL: https://issues.apache.org/jira/browse/SPARK-46172 Project: Spark Issue Type: Documentation Co

[jira] [Updated] (SPARK-46171) Remove `HiveContext` from Apache Spark 4.0

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46171: --- Labels: pull-request-available (was: ) > Remove `HiveContext` from Apache Spark 4.0 > -

[jira] [Updated] (SPARK-46171) Remove `HiveContext` from Apache Spark 4.0

2023-11-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46171: - Component/s: PySpark R > Remove `HiveContext` from Apache Spark 4.0 > -

[jira] [Created] (SPARK-46171) Remove `HiveContext` from Apache Spark 4.0

2023-11-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-46171: Summary: Remove `HiveContext` from Apache Spark 4.0 Key: SPARK-46171 URL: https://issues.apache.org/jira/browse/SPARK-46171 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46036: -- Assignee: Apache Spark > raise_error should only take the error class parameter for i

[jira] [Assigned] (SPARK-46036) raise_error should only take the error class parameter for internal usage

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46036: -- Assignee: (was: Apache Spark) > raise_error should only take the error class para

[jira] [Assigned] (SPARK-46052) Remove unnecessary TaskScheduler.killAllTaskAttempts

2023-11-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46052: -- Assignee: Apache Spark > Remove unnecessary TaskScheduler.killAllTaskAttempts > -