[jira] [Assigned] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46323: Assignee: Hyukjin Kwon > Fix the output name of pyspark.sql.functions.now >

[jira] [Resolved] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44252

[jira] [Resolved] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46275. -- Assignee: Raghu Angadi Resolution: Fixed Fixed in

[jira] [Created] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

Hyukjin Kwon created SPARK-46326: Summary: Test missing cases for functions (pyspark.sql.functions) Key: SPARK-46326 URL: https://issues.apache.org/jira/browse/SPARK-46326 Project: Spark

[jira] [Created] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

Hyukjin Kwon created SPARK-46324: Summary: Fix the output name of pyspark.sql.functions.user and session_user Key: SPARK-46324 URL: https://issues.apache.org/jira/browse/SPARK-46324 Project: Spark

[jira] [Created] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

Hyukjin Kwon created SPARK-46323: Summary: Fix the output name of pyspark.sql.functions.now Key: SPARK-46323 URL: https://issues.apache.org/jira/browse/SPARK-46323 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46317. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44247

[jira] [Assigned] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46317: Assignee: Hyukjin Kwon > Test missing cases for SparkSession (pyspark.sql.session) >

[jira] [Assigned] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46315: Assignee: Hyukjin Kwon > Test invalid key for spark.conf.get (pyspark.sql.conf) >

[jira] [Resolved] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46315. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44245

[jira] [Assigned] (SPARK-46318) Exclude ported loose_version from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46318: Assignee: Hyukjin Kwon > Exclude ported loose_version from the code coverage report >

[jira] [Resolved] (SPARK-46318) Exclude ported loose_version from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46318. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44248

[jira] [Created] (SPARK-46318) Exclude ported loose_version from the code coverage report

Hyukjin Kwon created SPARK-46318: Summary: Exclude ported loose_version from the code coverage report Key: SPARK-46318 URL: https://issues.apache.org/jira/browse/SPARK-46318 Project: Spark

[jira] [Created] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

Hyukjin Kwon created SPARK-46317: Summary: Test missing cases for SparkSession (pyspark.sql.session) Key: SPARK-46317 URL: https://issues.apache.org/jira/browse/SPARK-46317 Project: Spark

[jira] [Updated] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46315: - Summary: Test invalid key for spark.conf.get (pyspark.sql.conf) (was: Test invalid value for

[jira] [Created] (SPARK-46315) Test invalid value for spark.conf (pyspark.sql.conf)

Hyukjin Kwon created SPARK-46315: Summary: Test invalid value for spark.conf (pyspark.sql.conf) Key: SPARK-46315 URL: https://issues.apache.org/jira/browse/SPARK-46315 Project: Spark Issue

[jira] [Resolved] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46300. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44228

[jira] [Assigned] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46300: Assignee: Hyukjin Kwon > Test missing test coverage for Column (pyspark.sql.column) >

[jira] [Assigned] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46298: Assignee: Hyukjin Kwon > Test catalog error classes (pyspark.sql.catalog) >

[jira] [Resolved] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46298. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44226

[jira] [Resolved] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46296. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44224

[jira] [Assigned] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46296: Assignee: Hyukjin Kwon > Test captured errors (pyspark.errors.exceptions.captured) >

[jira] [Created] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

Hyukjin Kwon created SPARK-46300: Summary: Test missing test coverage for Column (pyspark.sql.column) Key: SPARK-46300 URL: https://issues.apache.org/jira/browse/SPARK-46300 Project: Spark

[jira] [Assigned] (SPARK-46297) Exclude generated files from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46297: Assignee: Hyukjin Kwon > Exclude generated files from the code coverage report >

[jira] [Resolved] (SPARK-46297) Exclude generated files from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46297. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44225

[jira] [Created] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

Hyukjin Kwon created SPARK-46298: Summary: Test catalog error classes (pyspark.sql.catalog) Key: SPARK-46298 URL: https://issues.apache.org/jira/browse/SPARK-46298 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46296: - Summary: Test captured errors (pyspark.errors.exceptions.captured) (was: Test captured errors

[jira] [Created] (SPARK-46297) Exclude generated files from the code coverage report

Hyukjin Kwon created SPARK-46297: Summary: Exclude generated files from the code coverage report Key: SPARK-46297 URL: https://issues.apache.org/jira/browse/SPARK-46297 Project: Spark Issue

[jira] [Created] (SPARK-46296) Test captured errors of TestResult (pyspark.errors.exceptions.captured)

Hyukjin Kwon created SPARK-46296: Summary: Test captured errors of TestResult (pyspark.errors.exceptions.captured) Key: SPARK-46296 URL: https://issues.apache.org/jira/browse/SPARK-46296 Project:

[jira] [Assigned] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46290: Assignee: Allison Wang > Change saveMode to overwrite for DataSourceWriter constructor >

[jira] [Resolved] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46290. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44216

[jira] [Resolved] (SPARK-46280) Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample

[ https://issues.apache.org/jira/browse/SPARK-46280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46280. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44199

[jira] [Assigned] (SPARK-46280) Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample

[ https://issues.apache.org/jira/browse/SPARK-46280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46280: Assignee: Ruifeng Zheng > Move test_parity_frame_resample and

[jira] [Resolved] (SPARK-46276) Improve test coverage of pyspark utils

[ https://issues.apache.org/jira/browse/SPARK-46276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46276. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44192

[jira] [Assigned] (SPARK-46276) Improve test coverage of pyspark utils

[ https://issues.apache.org/jira/browse/SPARK-46276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46276: Assignee: Xinrong Meng > Improve test coverage of pyspark utils >

[jira] [Resolved] (SPARK-46260) DataFrame.withColumnsRenamed should respect the dict ordering

[ https://issues.apache.org/jira/browse/SPARK-46260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46260. -- Assignee: Ruifeng Zheng Resolution: Fixed Fixed in

[jira] [Assigned] (SPARK-46213) Add PySparkImportError for error framework

[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46213: Assignee: Haejoon Lee > Add PySparkImportError for error framework >

[jira] [Resolved] (SPARK-46252) Improve test coverage of memory_profiler.py

[ https://issues.apache.org/jira/browse/SPARK-46252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46252. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44167

[jira] [Resolved] (SPARK-46213) Add PySparkImportError for error framework

[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46213. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44176

[jira] [Resolved] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46226. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44143

[jira] [Assigned] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46226: Assignee: Haejoon Lee > Migrate all remaining RuntimeError into PySpark error framework

[jira] [Resolved] (SPARK-46044) Improve test coverage of udf.py

[ https://issues.apache.org/jira/browse/SPARK-46044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46044. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43947

[jira] [Resolved] (SPARK-46241) Fix error handling routine so it wouldn't fall into infinite recursion

[ https://issues.apache.org/jira/browse/SPARK-46241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46241. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44144

[jira] [Assigned] (SPARK-46241) Fix error handling routine so it wouldn't fall into infinite recursion

[ https://issues.apache.org/jira/browse/SPARK-46241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46241: Assignee: Alice Sayutina > Fix error handling routine so it wouldn't fall into infinite

[jira] [Resolved] (SPARK-46254) Remove stale Python 3.8/3.7 version checkings

[ https://issues.apache.org/jira/browse/SPARK-46254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46254. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44169

[jira] [Reopened] (SPARK-46213) Add PySparkImportError for error framework

[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-46213: -- Assignee: (was: Haejoon Lee) Reverted at

[jira] [Updated] (SPARK-46213) Add PySparkImportError for error framework

[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46213: - Fix Version/s: (was: 4.0.0) > Add PySparkImportError for error framework >

[jira] [Updated] (SPARK-46254) Remove stale Python 3.8/3.7 version checkings

[ https://issues.apache.org/jira/browse/SPARK-46254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46254: - Issue Type: Improvement (was: New Feature) > Remove stale Python 3.8/3.7 version checkings >

[jira] [Updated] (SPARK-46254) Remove stale Python 3.8/3.7 version checkings

[ https://issues.apache.org/jira/browse/SPARK-46254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46254: - Description: See PR linked. We dropped Python 3.7 and lowest is Python 3.8 so we can remove all

[jira] [Created] (SPARK-46254) Remove stale Python 3.8/3.7 version checkings

Hyukjin Kwon created SPARK-46254: Summary: Remove stale Python 3.8/3.7 version checkings Key: SPARK-46254 URL: https://issues.apache.org/jira/browse/SPARK-46254 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-46250) Deflake test_parity_listener

[ https://issues.apache.org/jira/browse/SPARK-46250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46250: Assignee: Wei Liu > Deflake test_parity_listener > > >

[jira] [Resolved] (SPARK-46250) Deflake test_parity_listener

[ https://issues.apache.org/jira/browse/SPARK-46250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46250. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44166

[jira] [Resolved] (SPARK-46243) Describe arguments of decode()

[ https://issues.apache.org/jira/browse/SPARK-46243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46243. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44157

[jira] [Resolved] (SPARK-46186) Invalid Spark Connect execution state transition if interrupted before thread started

[ https://issues.apache.org/jira/browse/SPARK-46186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46186. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44095

[jira] [Resolved] (SPARK-46236) Using brighter color for docs h3 title for better visibility

[ https://issues.apache.org/jira/browse/SPARK-46236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46236. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44152

[jira] [Assigned] (SPARK-46236) Using brighter color for docs h3 title for better visibility

[ https://issues.apache.org/jira/browse/SPARK-46236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46236: Assignee: BingKun Pan > Using brighter color for docs h3 title for better visibility >

[jira] [Resolved] (SPARK-46229) Add applyInArrow to groupBy and cogroup in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-46229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46229. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44146

[jira] [Assigned] (SPARK-46229) Add applyInArrow to groupBy and cogroup in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-46229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46229: Assignee: Hyukjin Kwon > Add applyInArrow to groupBy and cogroup in Spark Connect >

[jira] [Created] (SPARK-46229) Add applyInArrow to groupBy and cogroup in Spark Connect

Hyukjin Kwon created SPARK-46229: Summary: Add applyInArrow to groupBy and cogroup in Spark Connect Key: SPARK-46229 URL: https://issues.apache.org/jira/browse/SPARK-46229 Project: Spark

[jira] [Assigned] (SPARK-46224) Test string representation of TestResult (pyspark.mllib.stat.test)

[ https://issues.apache.org/jira/browse/SPARK-46224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46224: Assignee: Hyukjin Kwon > Test string representation of TestResult

[jira] [Resolved] (SPARK-46224) Test string representation of TestResult (pyspark.mllib.stat.test)

[ https://issues.apache.org/jira/browse/SPARK-46224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44138

[jira] [Resolved] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[ https://issues.apache.org/jira/browse/SPARK-46223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46223. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44137

[jira] [Assigned] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[ https://issues.apache.org/jira/browse/SPARK-46223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46223: Assignee: Hyukjin Kwon > Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[jira] [Resolved] (SPARK-46220) Restrict charsets in decode()

[ https://issues.apache.org/jira/browse/SPARK-46220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46220. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44131

[jira] [Assigned] (SPARK-46222) Test invalid error class (pyspark.errors.utils)

[ https://issues.apache.org/jira/browse/SPARK-46222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46222: Assignee: Hyukjin Kwon > Test invalid error class (pyspark.errors.utils) >

[jira] [Resolved] (SPARK-46222) Test invalid error class (pyspark.errors.utils)

[ https://issues.apache.org/jira/browse/SPARK-46222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46222. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44136

[jira] [Resolved] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40559. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 38624

[jira] [Assigned] (SPARK-40559) Add applyInArrow to pyspark.sql.GroupedData

[ https://issues.apache.org/jira/browse/SPARK-40559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40559: Assignee: Enrico Minack > Add applyInArrow to pyspark.sql.GroupedData >

[jira] [Updated] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[ https://issues.apache.org/jira/browse/SPARK-46223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46223: - Priority: Minor (was: Major) > Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

[jira] [Created] (SPARK-46224) Test string representation of TestResult (pyspark.mllib.stat.test)

Hyukjin Kwon created SPARK-46224: Summary: Test string representation of TestResult (pyspark.mllib.stat.test) Key: SPARK-46224 URL: https://issues.apache.org/jira/browse/SPARK-46224 Project: Spark

[jira] [Created] (SPARK-46223) Test SparkPandasNotImplementedError (pyspark.pandas.exceptions)

Hyukjin Kwon created SPARK-46223: Summary: Test SparkPandasNotImplementedError (pyspark.pandas.exceptions) Key: SPARK-46223 URL: https://issues.apache.org/jira/browse/SPARK-46223 Project: Spark

[jira] [Updated] (SPARK-46222) Test invalid error class (pyspark.errors.utils)

[ https://issues.apache.org/jira/browse/SPARK-46222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46222: - Summary: Test invalid error class (pyspark.errors.utils) (was: Test invalid error class) >

[jira] [Created] (SPARK-46222) Test invalid error class

Hyukjin Kwon created SPARK-46222: Summary: Test invalid error class Key: SPARK-46222 URL: https://issues.apache.org/jira/browse/SPARK-46222 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-46221) Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb

[ https://issues.apache.org/jira/browse/SPARK-46221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46221: Assignee: Bjørn Jørgensen > Change to_spark_io to spark.to_spark_io in

[jira] [Resolved] (SPARK-46221) Change to_spark_io to spark.to_spark_io in quickstart_ps.ipynb

[ https://issues.apache.org/jira/browse/SPARK-46221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46221. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44135

[jira] [Resolved] (SPARK-46208) Adding a link for latest Pandas API specifications.

[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46208. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44115

[jira] [Assigned] (SPARK-46208) Adding a link for latest Pandas API specifications.

[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46208: Assignee: Haejoon Lee > Adding a link for latest Pandas API specifications. >

[jira] [Assigned] (SPARK-46135) Fix table format error in ipynb docs

[ https://issues.apache.org/jira/browse/SPARK-46135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46135: Assignee: BingKun Pan > Fix table format error in ipynb docs >

[jira] [Resolved] (SPARK-46135) Fix table format error in ipynb docs

[ https://issues.apache.org/jira/browse/SPARK-46135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46135. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44049

[jira] [Assigned] (SPARK-45940) Add InputPartition to DataSourceReader interface

[ https://issues.apache.org/jira/browse/SPARK-45940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45940: Assignee: Allison Wang > Add InputPartition to DataSourceReader interface >

[jira] [Resolved] (SPARK-45940) Add InputPartition to DataSourceReader interface

[ https://issues.apache.org/jira/browse/SPARK-45940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45940. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44085

[jira] [Resolved] (SPARK-46181) Split scheduled Python build

[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46181. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44088

[jira] [Assigned] (SPARK-46181) Split scheduled Python build

[ https://issues.apache.org/jira/browse/SPARK-46181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46181: Assignee: Hyukjin Kwon > Split scheduled Python build > > >

[jira] [Resolved] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46178. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44087

[jira] [Assigned] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46178: Assignee: Hyukjin Kwon > Move MockDF under PlanOnlyTestFixture >

[jira] [Resolved] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46177. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44086

[jira] [Assigned] (SPARK-46177) Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col' with Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-46177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46177: Assignee: Hyukjin Kwon > Skip 'CrossValidatorTests.test_crossvalidator_with_fold_col'

[jira] [Assigned] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

[ https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46151: Assignee: BingKun Pan > Hide the "More" drop-down button in the PySpark docs navigation

[jira] [Resolved] (SPARK-46151) Hide the "More" drop-down button in the PySpark docs navigation bar

[ https://issues.apache.org/jira/browse/SPARK-46151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46151. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44068

[jira] [Resolved] (SPARK-46152) XML: Add DecimalType support in schema inference

[ https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46152. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44069

[jira] [Assigned] (SPARK-46152) XML: Add DecimalType support in schema inference

[ https://issues.apache.org/jira/browse/SPARK-46152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46152: Assignee: Sandip Agarwala > XML: Add DecimalType support in schema inference >

[jira] [Assigned] (SPARK-46056) Vectorized parquet reader throws NPE when reading files with DecimalType default values

[ https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46056: Assignee: Cosmin Dumitru > Vectorized parquet reader throws NPE when reading files with

[jira] [Assigned] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45943: Assignee: Zhen Wang > DataSourceV2Relation.computeStats throws IllegalStateException in

[jira] [Resolved] (SPARK-46056) Vectorized parquet reader throws NPE when reading files with DecimalType default values

[ https://issues.apache.org/jira/browse/SPARK-46056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46056. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43960

[jira] [Updated] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45943: - Fix Version/s: 3.5.2 (was: 3.5.1) > DataSourceV2Relation.computeStats

[jira] [Resolved] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45943. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-46181) Split scheduled Python build

Hyukjin Kwon created SPARK-46181: Summary: Split scheduled Python build Key: SPARK-46181 URL: https://issues.apache.org/jira/browse/SPARK-46181 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-46180) Reduce the number of shuffle partitions in pandas-on-Spark test cases

[ https://issues.apache.org/jira/browse/SPARK-46180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46180. -- Resolution: Invalid > Reduce the number of shuffle partitions in pandas-on-Spark test cases >

[jira] [Created] (SPARK-46180) Reduce the number of shuffle partitions in pandas-on-Spark test cases

Hyukjin Kwon created SPARK-46180: Summary: Reduce the number of shuffle partitions in pandas-on-Spark test cases Key: SPARK-46180 URL: https://issues.apache.org/jira/browse/SPARK-46180 Project: Spark

[jira] [Updated] (SPARK-46178) Move MockDF under PlanOnlyTestFixture

[ https://issues.apache.org/jira/browse/SPARK-46178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46178: - Issue Type: Test (was: Improvement) > Move MockDF under PlanOnlyTestFixture >

<    3   4   5   6   7   8   9   10   11   12   >