[jira] [Resolved] (SPARK-46236) Using brighter color for docs h3 title for better visibility

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46236. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44152

[jira] [Assigned] (SPARK-46236) Using brighter color for docs h3 title for better visibility

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46236: Assignee: BingKun Pan > Using brighter color for docs h3 title for better visibility >

[jira] [Resolved] (SPARK-46229) Add applyInArrow to groupBy and cogroup in Spark Connect

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46229. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44146

[jira] [Assigned] (SPARK-46229) Add applyInArrow to groupBy and cogroup in Spark Connect

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46229: Assignee: Hyukjin Kwon > Add applyInArrow to groupBy and cogroup in Spark Connect >

[jira] [Created] (SPARK-46229) Add applyInArrow to groupBy and cogroup in Spark Connect

2023-12-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46229: Summary: Add applyInArrow to groupBy and cogroup in Spark Connect Key: SPARK-46229 URL: https://issues.apache.org/jira/browse/SPARK-46229 Project: Spark

[jira] [Assigned] (SPARK-46224) Test string representation of TestResult (pyspark.mllib.stat.test)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46224: Assignee: Hyukjin Kwon > Test string representation of TestResult

[jira] [Resolved] (SPARK-46224) Test string representation of TestResult (pyspark.mllib.stat.test)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44138

[jira] [Resolved] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46223. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44137

[jira] [Assigned] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46223: Assignee: Hyukjin Kwon > Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[jira] [Resolved] (SPARK-46220) Restrict charsets in decode()

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46220. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44131

[jira] [Assigned] (SPARK-46222) Test invalid error class (pyspark.errors.utils)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46222: Assignee: Hyukjin Kwon > Test invalid error class (pyspark.errors.utils) >

[jira] [Resolved] (SPARK-46222) Test invalid error class (pyspark.errors.utils)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46222. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44136

[jira] [Resolved] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40559. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 38624

[jira] [Assigned] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40559: Assignee: Enrico Minack > Add applyInArrow to pyspark.sql.GroupedData >

[jira] [Updated] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46223: - Priority: Minor (was: Major) > Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[jira] [Created] (SPARK-46224) Test string representation of TestResult (pyspark.mllib.stat.test)

2023-12-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46224: Summary: Test string representation of TestResult (pyspark.mllib.stat.test) Key: SPARK-46224 URL: https://issues.apache.org/jira/browse/SPARK-46224 Project: Spark

[jira] [Created] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

2023-12-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46223: Summary: Test SparkPandasNotImplementedError (pyspark.pandas.exceptions) Key: SPARK-46223 URL: https://issues.apache.org/jira/browse/SPARK-46223 Project: Spark

[jira] [Updated] (SPARK-46222) Test invalid error class (pyspark.errors.utils)

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46222: - Summary: Test invalid error class (pyspark.errors.utils) (was: Test invalid error class) >

[jira] [Created] (SPARK-46222) Test invalid error class

2023-12-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46222: Summary: Test invalid error class Key: SPARK-46222 URL: https://issues.apache.org/jira/browse/SPARK-46222 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-46221) Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46221: Assignee: Bjørn Jørgensen > Change to_spark_io to spark.to_spark_io in

[jira] [Resolved] (SPARK-46221) Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb

2023-12-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46221. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44135

[jira] [Resolved] (SPARK-46208) Adding a link for latest Pandas API specifications.

2023-12-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46208. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44115

[jira] [Assigned] (SPARK-46208) Adding a link for latest Pandas API specifications.

2023-12-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46208: Assignee: Haejoon Lee > Adding a link for latest Pandas API specifications. >

[jira] [Assigned] (SPARK-46135) Fix table format error in ipynb docs

2023-11-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46135: Assignee: BingKun Pan > Fix table format error in ipynb docs >

[jira] [Resolved] (SPARK-46135) Fix table format error in ipynb docs

2023-11-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46135. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44049

[jira] [Assigned] (SPARK-45940) Add InputPartition to DataSourceReader interface

2023-11-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45940: Assignee: Allison Wang > Add InputPartition to DataSourceReader interface >

[jira] [Resolved] (SPARK-45940) Add InputPartition to DataSourceReader interface

2023-11-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45940. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44085

[jira] [Resolved] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46181. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44088

[jira] [Assigned] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46181: Assignee: Hyukjin Kwon > Split scheduled Python build > > >

[jira] [Resolved] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46178. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44087

[jira] [Assigned] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46178: Assignee: Hyukjin Kwon > Move MockDF under PlanOnlyTestFixture >

[jira] [Resolved] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46177. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44086

[jira] [Assigned] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46177: Assignee: Hyukjin Kwon > Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col'

[jira] [Assigned] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46151: Assignee: BingKun Pan > Hide the "More" drop-down button in the PySpark docs navigation

[jira] [Resolved] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46151. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44068

[jira] [Resolved] (SPARK-46152) XML: Add DecimalType support in schema inference

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46152. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44069

[jira] [Assigned] (SPARK-46152) XML: Add DecimalType support in schema inference

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46152: Assignee: Sandip Agarwala > XML: Add DecimalType support in schema inference >

[jira] [Assigned] (SPARK-46056) Vectorized parquet reader throws NPE when reading files with DecimalType default values

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46056: Assignee: Cosmin Dumitru > Vectorized parquet reader throws NPE when reading files with

[jira] [Assigned] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45943: Assignee: Zhen Wang > DataSourceV2Relation.computeStats throws IllegalStateException in

[jira] [Resolved] (SPARK-46056) Vectorized parquet reader throws NPE when reading files with DecimalType default values

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46056. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43960

[jira] [Updated] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45943: - Fix Version/s: 3.5.2 (was: 3.5.1) > DataSourceV2Relation.computeStats

[jira] [Resolved] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45943. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-46181) Split scheduled Python build

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46181: Summary: Split scheduled Python build Key: SPARK-46181 URL: https://issues.apache.org/jira/browse/SPARK-46181 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-46180) Reduce the number of shuffle partitions in pandas-on-Spark test cases

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46180. -- Resolution: Invalid > Reduce the number of shuffle partitions in pandas-on-Spark test cases >

[jira] [Created] (SPARK-46180) Reduce the number of shuffle partitions in pandas-on-Spark test cases

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46180: Summary: Reduce the number of shuffle partitions in pandas-on-Spark test cases Key: SPARK-46180 URL: https://issues.apache.org/jira/browse/SPARK-46180 Project: Spark

[jira] [Updated] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46178: - Issue Type: Test (was: Improvement) > Move MockDF under PlanOnlyTestFixture >

[jira] [Created] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46178: Summary: Move MockDF under PlanOnlyTestFixture Key: SPARK-46178 URL: https://issues.apache.org/jira/browse/SPARK-46178 Project: Spark Issue Type:

[jira] [Created] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

2023-11-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46177: Summary: Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12 Key: SPARK-46177 URL: https://issues.apache.org/jira/browse/SPARK-46177

[jira] [Assigned] (SPARK-46149) Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally` with Python 3.12

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46149: Assignee: Hyukjin Kwon > Skip

[jira] [Resolved] (SPARK-46149) Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally` with Python 3.12

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46149. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44065

[jira] [Resolved] (SPARK-46148) Fix pyspark.pandas.mlflow.load_model test (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46148. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44064

[jira] [Assigned] (SPARK-46148) Fix pyspark.pandas.mlflow.load_model test (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46148: Assignee: Hyukjin Kwon > Fix pyspark.pandas.mlflow.load_model test (Python 3.12) >

[jira] [Updated] (SPARK-46149) Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally` with Python 3.12

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46149: - Description: {code} ==

[jira] [Updated] (SPARK-46149) Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally` with Python 3.12

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46149: - Summary: Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally` with Python 3.12

[jira] [Updated] (SPARK-46149) Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally`

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46149: - Priority: Minor (was: Major) > Skip

[jira] [Created] (SPARK-46149) Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally`

2023-11-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46149: Summary: Skip `TorchDistributorLocalUnitTests.test_end_to_end_run_locally` Key: SPARK-46149 URL: https://issues.apache.org/jira/browse/SPARK-46149 Project: Spark

[jira] [Updated] (SPARK-46148) Fix pyspark.pandas.mlflow.load_model test (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46148: - Description: {code} ** File

[jira] [Created] (SPARK-46148) Fix pyspark.pandas.mlflow.load_model test (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46148: Summary: Fix pyspark.pandas.mlflow.load_model test (Python 3.12) Key: SPARK-46148 URL: https://issues.apache.org/jira/browse/SPARK-46148 Project: Spark

[jira] [Updated] (SPARK-46147) Fix the doctest in pyspark.pandas.series.Series.to_dict (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46147: - Fix Version/s: (was: 4.0.0) > Fix the doctest in pyspark.pandas.series.Series.to_dict

[jira] [Updated] (SPARK-46147) Fix the doctest in pyspark.pandas.series.Series.to_dict (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46147: - Labels: (was: pull-request-available) > Fix the doctest in

[jira] [Updated] (SPARK-46147) Fix the doctest in pyspark.pandas.series.Series.to_dict (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46147: - Description: {code} File "/__w/spark/spark/python/pyspark/pandas/series.py", line 1633, in

[jira] [Created] (SPARK-46147) Fix the doctest in pyspark.pandas.series.Series.to_dict (Python 3.12)

2023-11-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46147: Summary: Fix the doctest in pyspark.pandas.series.Series.to_dict (Python 3.12) Key: SPARK-46147 URL: https://issues.apache.org/jira/browse/SPARK-46147 Project: Spark

[jira] [Deleted] (SPARK-46136) Do not combine adjacent Python UDFs if pythonExec is different

2023-11-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46136: - > Do not combine adjacent Python UDFs if pythonExec is different >

[jira] [Created] (SPARK-46136) Do not combine adjacent Python UDFs if pythonExec is different

2023-11-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46136: Summary: Do not combine adjacent Python UDFs if pythonExec is different Key: SPARK-46136 URL: https://issues.apache.org/jira/browse/SPARK-46136 Project: Spark

[jira] [Resolved] (SPARK-32407) Remove upperbound of Sphinx version

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32407. -- Fix Version/s: 4.0.0 Assignee: Ruifeng Zheng Resolution: Fixed

[jira] [Assigned] (SPARK-46127) Flaky `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46127: Assignee: Hyukjin Kwon > Flaky >

[jira] [Resolved] (SPARK-46131) Install torchvision for Python 3.12 build

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46131. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44045

[jira] [Resolved] (SPARK-46127) Flaky `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46127. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44044

[jira] [Assigned] (SPARK-46131) Install torchvision for Python 3.12 build

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46131: Assignee: Hyukjin Kwon > Install torchvision for Python 3.12 build >

[jira] [Updated] (SPARK-46131) Install torchvision for Python 3.12 build

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46131: - Description: {code} ==

[jira] [Created] (SPARK-46131) Install torchvision for Python 3.12 build

2023-11-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46131: Summary: Install torchvision for Python 3.12 build Key: SPARK-46131 URL: https://issues.apache.org/jira/browse/SPARK-46131 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46130) Reeanble `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46130: - Parent: SPARK-45981 Issue Type: Sub-task (was: Test) > Reeanble >

[jira] [Created] (SPARK-46130) Reeanble `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12

2023-11-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46130: Summary: Reeanble `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12 Key: SPARK-46130 URL:

[jira] [Assigned] (SPARK-46126) Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict (Python 3.12)

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46126: Assignee: Hyukjin Kwon > Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict

[jira] [Resolved] (SPARK-46126) Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict (Python 3.12)

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46126. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44042

[jira] [Resolved] (SPARK-46111) Add copyright to the PySpark official documentation.

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46111. -- Fix Version/s: 4.0.0 Assignee: Haejoon Lee Resolution: Fixed Fixed in

[jira] [Created] (SPARK-46127) Flaky `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12

2023-11-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46127: Summary: Flaky `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12 Key: SPARK-46127 URL:

[jira] [Created] (SPARK-46126) Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict (Python 3.12)

2023-11-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46126: Summary: Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict (Python 3.12) Key: SPARK-46126 URL: https://issues.apache.org/jira/browse/SPARK-46126 Project:

[jira] [Resolved] (SPARK-46121) Refine docstring of `concat/array_position/element_at/try_element_at`

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46121. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44039

[jira] [Assigned] (SPARK-46121) Refine docstring of `concat/array_position/element_at/try_element_at`

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46121: Assignee: Yang Jie > Refine docstring of

[jira] [Resolved] (SPARK-46115) Restrict charsets in encode()

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46115. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44020

[jira] [Assigned] (SPARK-45957) SQL on streaming Temp view fails

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45957: Assignee: Jean-Francois Desjeans Gauthier > SQL on streaming Temp view fails >

[jira] [Resolved] (SPARK-45957) SQL on streaming Temp view fails

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45957. -- Resolution: Fixed Issue resolved by pull request 43851

[jira] [Assigned] (SPARK-46110) Use error classes in catalog, conf, connect, observation, pandas modules

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46110: Assignee: Hyukjin Kwon > Use error classes in catalog, conf, connect, observation,

[jira] [Resolved] (SPARK-46110) Use error classes in catalog, conf, connect, observation, pandas modules

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46110. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44024

[jira] [Assigned] (SPARK-46120) Remove helper function DataFrame.withPlan

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46120: Assignee: Ruifeng Zheng > Remove helper function DataFrame.withPlan >

[jira] [Resolved] (SPARK-46120) Remove helper function DataFrame.withPlan

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46120. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44037

[jira] [Assigned] (SPARK-46123) Using brighter color for document title for better visibility

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46123: Assignee: Haejoon Lee > Using brighter color for document title for better visibility >

[jira] [Resolved] (SPARK-46123) Using brighter color for document title for better visibility

2023-11-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46123. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44040

[jira] [Assigned] (SPARK-46114) Define IndexError for PySpark error framework

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46114: Assignee: Hyukjin Kwon > Define IndexError for PySpark error framework >

[jira] [Resolved] (SPARK-46114) Define IndexError for PySpark error framework

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46114. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44028

[jira] [Created] (SPARK-46114) Define IndexError for PySpark error framework

2023-11-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46114: Summary: Define IndexError for PySpark error framework Key: SPARK-46114 URL: https://issues.apache.org/jira/browse/SPARK-46114 Project: Spark Issue Type:

[jira] [Created] (SPARK-46110) Use error classes in catalog, conf, connect, observation, pandas modules

2023-11-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46110: Summary: Use error classes in catalog, conf, connect, observation, pandas modules Key: SPARK-46110 URL: https://issues.apache.org/jira/browse/SPARK-46110 Project:

[jira] [Deleted] (SPARK-46109) Migrate to error classes in PySpark

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46109: - > Migrate to error classes in PySpark > --- > >

[jira] [Updated] (SPARK-46109) Migrate to error classes in PySpark

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46109: - > Migrate to error classes in PySpark > --- > >

[jira] [Created] (SPARK-46109) Migrate to error classes in PySpark

2023-11-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46109: Summary: Migrate to error classes in PySpark Key: SPARK-46109 URL: https://issues.apache.org/jira/browse/SPARK-46109 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32933) Use keyword-only syntax for keyword_only methods

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789874#comment-17789874 ] Hyukjin Kwon commented on SPARK-32933: -- Here the PR and JIRA:

[jira] [Created] (SPARK-46107) Deprecate pyspark.keyword_only API

2023-11-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46107: Summary: Deprecate pyspark.keyword_only API Key: SPARK-46107 URL: https://issues.apache.org/jira/browse/SPARK-46107 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46074) [CONNECT][SCALA] Insufficient details in error when a UDF fails

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46074. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43983

[jira] [Assigned] (SPARK-46074) [CONNECT][SCALA] Insufficient details in error when a UDF fails

2023-11-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46074: Assignee: Niranjan Jayakar > [CONNECT][SCALA] Insufficient details in error when a UDF

<    3   4   5   6   7   8   9   10   11   12   >