[jira] [Resolved] (SPARK-47211) Fix ignored PySpark Connect string collation

[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47211. -- Resolution: Fixed Issue resolved by pull request 45316

[jira] [Resolved] (SPARK-47224) Split `test_split_apply_basic`

[ https://issues.apache.org/jira/browse/SPARK-47224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45332

[jira] [Resolved] (SPARK-47147) Fix Pyspark collated string conversion error

[ https://issues.apache.org/jira/browse/SPARK-47147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47147. -- Resolution: Fixed Issue resolved by pull request 45257

[jira] [Assigned] (SPARK-47202) AttributeError: module 'pandas' has no attribute 'Timstamp'

[ https://issues.apache.org/jira/browse/SPARK-47202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47202: Assignee: Arzav Jain > AttributeError: module 'pandas' has no attribute 'Timstamp' >

[jira] [Resolved] (SPARK-47202) AttributeError: module 'pandas' has no attribute 'Timstamp'

[ https://issues.apache.org/jira/browse/SPARK-47202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47202. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-47199) Add prefix into TemporaryDirectory to avoid flakiness

Hyukjin Kwon created SPARK-47199: Summary: Add prefix into TemporaryDirectory to avoid flakiness Key: SPARK-47199 URL: https://issues.apache.org/jira/browse/SPARK-47199 Project: Spark Issue

[jira] [Created] (SPARK-47185) Increase timeout between actions in KafkaContinuousTest

Hyukjin Kwon created SPARK-47185: Summary: Increase timeout between actions in KafkaContinuousTest Key: SPARK-47185 URL: https://issues.apache.org/jira/browse/SPARK-47185 Project: Spark

[jira] [Updated] (SPARK-47185) Increase timeout between actions in KafkaContinuousTest

[ https://issues.apache.org/jira/browse/SPARK-47185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47185: - Priority: Minor (was: Major) > Increase timeout between actions in KafkaContinuousTest >

[jira] [Assigned] (SPARK-47178) Add a test case for createDataFrame with dataclasses

[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47178: Assignee: Hyukjin Kwon > Add a test case for createDataFrame with dataclasses >

[jira] [Resolved] (SPARK-47178) Add a test case for createDataFrame with dataclasses

[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47178. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45271

[jira] [Created] (SPARK-47178) Add a test case for createDataFrame with dataclasses

Hyukjin Kwon created SPARK-47178: Summary: Add a test case for createDataFrame with dataclasses Key: SPARK-47178 URL: https://issues.apache.org/jira/browse/SPARK-47178 Project: Spark Issue

[jira] [Resolved] (SPARK-47164) Make Default Value From Wider Type Narrow Literal of v2 behave the same as v1

[ https://issues.apache.org/jira/browse/SPARK-47164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47164. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45254

[jira] [Resolved] (SPARK-44400) Improve Scala StreamingQueryListener to provide users a way to access the Spark session for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-44400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44400. -- Resolution: Duplicate > Improve Scala StreamingQueryListener to provide users a way to access

[jira] [Resolved] (SPARK-44462) Fix the session passed to foreachBatch.

[ https://issues.apache.org/jira/browse/SPARK-44462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44462. -- Resolution: Duplicate > Fix the session passed to foreachBatch. >

[jira] [Created] (SPARK-47161) Uses hash key properly for SparkR build on Windows

Hyukjin Kwon created SPARK-47161: Summary: Uses hash key properly for SparkR build on Windows Key: SPARK-47161 URL: https://issues.apache.org/jira/browse/SPARK-47161 Project: Spark Issue

[jira] [Resolved] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47159. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45249

[jira] [Assigned] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47159: Assignee: Dongjoon Hyun > Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS`

[jira] [Resolved] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47120. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45202

[jira] [Resolved] (SPARK-47157) Introduce abstraction that facilitates more flexible management of file listings within the system.

[ https://issues.apache.org/jira/browse/SPARK-47157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47157. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45224

[jira] [Resolved] (SPARK-47140) Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions

[ https://issues.apache.org/jira/browse/SPARK-47140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47140. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45227

[jira] [Created] (SPARK-47140) Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions

Hyukjin Kwon created SPARK-47140: Summary: Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions Key: SPARK-47140 URL: https://issues.apache.org/jira/browse/SPARK-47140 Project: Spark

[jira] [Created] (SPARK-47139) Upgrade Python version used in coverage report

Hyukjin Kwon created SPARK-47139: Summary: Upgrade Python version used in coverage report Key: SPARK-47139 URL: https://issues.apache.org/jira/browse/SPARK-47139 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47123. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45209

[jira] [Assigned] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47123: Assignee: Pablo Langa Blanco > JDBCRDD does not correctly handle errors in

[jira] [Reopened] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-47115: -- Assignee: (was: Hyukjin Kwon) > Use larger memory for Maven builds >

[jira] [Updated] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47115: - Fix Version/s: (was: 4.0.0) > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Resolution: Invalid it doesn't help. reverted > Use larger memory for Maven builds >

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47125: - Fix Version/s: 3.5.2 (was: 3.5.3) > Return null if Univocity never

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47125: - Fix Version/s: 3.5.3 3.4.3 > Return null if Univocity never triggers parsing

[jira] [Assigned] (SPARK-47125) Return null if Univocity never triggers parsing

[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47125: Assignee: Hyukjin Kwon > Return null if Univocity never triggers parsing >

[jira] [Resolved] (SPARK-47125) Return null if Univocity never triggers parsing

[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47125. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45210

[jira] [Created] (SPARK-47125) Return null if Univocity never triggers parsing

Hyukjin Kwon created SPARK-47125: Summary: Return null if Univocity never triggers parsing Key: SPARK-47125 URL: https://issues.apache.org/jira/browse/SPARK-47125 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47124: - Priority: Minor (was: Major) > Skip scheduled SparkR on Windows in fork repositories by

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47124: - Summary: Skip scheduled SparkR on Windows in fork repositories by default (was: Skip SparkR on

[jira] [Created] (SPARK-47124) Skip SparkR on Windows in fork repositories

Hyukjin Kwon created SPARK-47124: Summary: Skip SparkR on Windows in fork repositories Key: SPARK-47124 URL: https://issues.apache.org/jira/browse/SPARK-47124 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-31745) Enable Hive related test cases of SparkR on Windows

[ https://issues.apache.org/jira/browse/SPARK-31745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31745: - Summary: Enable Hive related test cases of SparkR on Windows (was: Enable Hive related test

[jira] [Assigned] (SPARK-47112) Write logs into a file in SparkR Windows build

[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47112: Assignee: Hyukjin Kwon > Write logs into a file in SparkR Windows build >

[jira] [Resolved] (SPARK-47112) Write logs into a file in SparkR Windows build

[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45192

[jira] [Created] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

Hyukjin Kwon created SPARK-47116: Summary: Install proper Python version in SparkR Windows build to avoid warnings Key: SPARK-47116 URL: https://issues.apache.org/jira/browse/SPARK-47116 Project:

[jira] [Assigned] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47115: Assignee: Hyukjin Kwon > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45195

[jira] [Created] (SPARK-47115) Use larger memory for Maven builds

Hyukjin Kwon created SPARK-47115: Summary: Use larger memory for Maven builds Key: SPARK-47115 URL: https://issues.apache.org/jira/browse/SPARK-47115 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-47112) Write logs into a file in SparkR Windows build

Hyukjin Kwon created SPARK-47112: Summary: Write logs into a file in SparkR Windows build Key: SPARK-47112 URL: https://issues.apache.org/jira/browse/SPARK-47112 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Description: Disabled in https://github.com/apache/spark/pull/45186 because of TTY issues. See

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Summary: Reenble AmmoniteTest tests in Maven builds (was: Eanble AmmoniteTest tests in Maven

[jira] [Created] (SPARK-47110) Eanble AmmoniteTest tests in Maven builds

Hyukjin Kwon created SPARK-47110: Summary: Eanble AmmoniteTest tests in Maven builds Key: SPARK-47110 URL: https://issues.apache.org/jira/browse/SPARK-47110 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47097: Assignee: Hyukjin Kwon > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Resolved] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47097. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45173

[jira] [Resolved] (SPARK-46820) Fix error message regression by restoring new_msg

[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46820. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44859

[jira] [Assigned] (SPARK-46820) Fix error message regression by restoring new_msg

[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46820: Assignee: Haejoon Lee > Fix error message regression by restoring new_msg >

[jira] [Updated] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47097: - Issue Type: Test (was: Improvement) > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Created] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

Hyukjin Kwon created SPARK-47097: Summary: Deflake "interrupt tag" at SparkSessionE2ESuite Key: SPARK-47097 URL: https://issues.apache.org/jira/browse/SPARK-47097 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47062) Make Spark Connect Plugins Java Compatible

[ https://issues.apache.org/jira/browse/SPARK-47062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47062. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45114

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47096: - Description: {code} Error: dyld[4738]: Library not loaded:

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47096: - Summary: Upgrade Python version in Maven build in macos-14 build (was: Upgrade Python version

[jira] [Created] (SPARK-47096) Upgrade Python version in Maven build for macos compatibility

Hyukjin Kwon created SPARK-47096: Summary: Upgrade Python version in Maven build for macos compatibility Key: SPARK-47096 URL: https://issues.apache.org/jira/browse/SPARK-47096 Project: Spark

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Description: https://github.com/apache/spark/actions/runs/7964626045/job/21742573399 It fails

[jira] [Updated] (SPARK-47095) Uses proper options for command script for macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses proper options for command script for macos-14 build (was: Uses Mac dedicated

[jira] [Assigned] (SPARK-47095) Uses proper options for command script for macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47095: Assignee: Hyukjin Kwon > Uses proper options for command script for macos-14 build >

[jira] [Updated] (SPARK-47095) Uses Mac dedicated options for command script for macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses Mac dedicated options for command script for macos-14 build (was: Uses Mac

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses proper options for command script in macos-14 build (was: Uses proper options

[jira] [Created] (SPARK-47095) Uses Mac dedicated options for command script

Hyukjin Kwon created SPARK-47095: Summary: Uses Mac dedicated options for command script Key: SPARK-47095 URL: https://issues.apache.org/jira/browse/SPARK-47095 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47090) Skip JDK 17/21 Maven build in branch-3.4 scheduled job

[ https://issues.apache.org/jira/browse/SPARK-47090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47090. -- Resolution: Invalid > Skip JDK 17/21 Maven build in branch-3.4 scheduled job >

[jira] [Updated] (SPARK-47090) Skip JDK 17/21 Maven build in branch-3.4 scheduled job

[ https://issues.apache.org/jira/browse/SPARK-47090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47090: - Summary: Skip JDK 17/21 Maven build in branch-3.4 scheduled job (was: Skip JDK 21 build in

[jira] [Created] (SPARK-47090) Skip JDK 21 build in branch-3.4 scheduled job

Hyukjin Kwon created SPARK-47090: Summary: Skip JDK 21 build in branch-3.4 scheduled job Key: SPARK-47090 URL: https://issues.apache.org/jira/browse/SPARK-47090 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47082) Out of bounds error message is incorrect

[ https://issues.apache.org/jira/browse/SPARK-47082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47082. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45151

[jira] [Assigned] (SPARK-47082) Out of bounds error message is incorrect

[ https://issues.apache.org/jira/browse/SPARK-47082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47082: Assignee: Nicholas Chammas > Out of bounds error message is incorrect >

[jira] [Updated] (SPARK-47067) Add Daily Apple Silicon Github Action Job (Java/Scala)

[ https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47067: - Fix Version/s: (was: 4.0.0) > Add Daily Apple Silicon Github Action Job (Java/Scala) >

[jira] [Resolved] (SPARK-47057) Reenable MyPy data test

[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47057. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45135

[jira] [Assigned] (SPARK-47057) Reenable MyPy data test

[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47057: Assignee: Hyukjin Kwon > Reenable MyPy data test > --- > >

[jira] [Updated] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47068: - Fix Version/s: 4.0.0 3.5.2 3.4.3 > Recover -1 and 0 case

[jira] [Assigned] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47068: Assignee: Hyukjin Kwon > Recover -1 and 0 case for

[jira] [Resolved] (SPARK-46078) Upgrade `pytorch` for Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-46078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46078. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45119

[jira] [Resolved] (SPARK-47055) Upgrade MyPy 1.8.0

[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47055. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45115

[jira] [Created] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

Hyukjin Kwon created SPARK-47068: Summary: Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch Key: SPARK-47068 URL: https://issues.apache.org/jira/browse/SPARK-47068 Project:

[jira] [Updated] (SPARK-47057) Reenable MyPy data test

[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47057: - Summary: Reenable MyPy data test (was: Reenable MyPy Data test) > Reenable MyPy data test >

[jira] [Created] (SPARK-47057) Reenable MyPy Data test

Hyukjin Kwon created SPARK-47057: Summary: Reenable MyPy Data test Key: SPARK-47057 URL: https://issues.apache.org/jira/browse/SPARK-47057 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47055) Upgrade MyPy 1.8.0

[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47055: - Summary: Upgrade MyPy 1.8.0 (was: Upgrade MyPy from 0.920 to 1.8.0) > Upgrade MyPy 1.8.0 >

[jira] [Created] (SPARK-47055) Upgrade MyPy from 0.920 to 1.8.0

Hyukjin Kwon created SPARK-47055: Summary: Upgrade MyPy from 0.920 to 1.8.0 Key: SPARK-47055 URL: https://issues.apache.org/jira/browse/SPARK-47055 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

Hyukjin Kwon created SPARK-47054: Summary: Remove pinned version of torch for Python 3.12 support Key: SPARK-47054 URL: https://issues.apache.org/jira/browse/SPARK-47054 Project: Spark Issue

[jira] [Commented] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817564#comment-17817564 ] Hyukjin Kwon commented on SPARK-45396: -- Reverted in branch-3.5:

[jira] [Updated] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45396: - Fix Version/s: (was: 3.5.1) > Add doc entry for `pyspark.ml.connect` module >

[jira] [Assigned] (SPARK-47004) Increase Scala client test coverage

[ https://issues.apache.org/jira/browse/SPARK-47004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47004: Assignee: Bo Gao > Increase Scala client test coverage >

[jira] [Resolved] (SPARK-47004) Increase Scala client test coverage

[ https://issues.apache.org/jira/browse/SPARK-47004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47004. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45063

[jira] [Resolved] (SPARK-47026) Include coverage of JSON data sources in array/struct/map default value tests

[ https://issues.apache.org/jira/browse/SPARK-47026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47026. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45086

[jira] [Assigned] (SPARK-47026) Include coverage of JSON data sources in array/struct/map default value tests

[ https://issues.apache.org/jira/browse/SPARK-47026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47026: Assignee: Mark Jarvin > Include coverage of JSON data sources in array/struct/map

[jira] [Resolved] (SPARK-46944) Follow up to SPARK-46792: Fix minor typing oversight

[ https://issues.apache.org/jira/browse/SPARK-46944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46944. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44983

[jira] [Resolved] (SPARK-46984) Remove pyspark.copy_func

[ https://issues.apache.org/jira/browse/SPARK-46984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46984. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45042

[jira] [Assigned] (SPARK-46984) Remove pyspark.copy_func

[ https://issues.apache.org/jira/browse/SPARK-46984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46984: Assignee: Hyukjin Kwon > Remove pyspark.copy_func > > >

[jira] [Deleted] (SPARK-46986) Move pyspark.loose_version to pyspark.sql.loose_version

[ https://issues.apache.org/jira/browse/SPARK-46986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46986: - > Move pyspark.loose_version to pyspark.sql.loose_version >

[jira] [Deleted] (SPARK-46985) Move _NoValue from pyspark.* to pyspark.sql.*

[ https://issues.apache.org/jira/browse/SPARK-46985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46985: - > Move _NoValue from pyspark.* to pyspark.sql.* > - >

[jira] [Created] (SPARK-46986) Move pyspark.loose_version to pyspark.sql.loose_version

Hyukjin Kwon created SPARK-46986: Summary: Move pyspark.loose_version to pyspark.sql.loose_version Key: SPARK-46986 URL: https://issues.apache.org/jira/browse/SPARK-46986 Project: Spark

[jira] [Updated] (SPARK-46984) Remove pyspark.copy_func

[ https://issues.apache.org/jira/browse/SPARK-46984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46984: - Priority: Minor (was: Major) > Remove pyspark.copy_func > > >

[jira] [Created] (SPARK-46985) Move _NoValue from pyspark.* to pyspark.sql.*

Hyukjin Kwon created SPARK-46985: Summary: Move _NoValue from pyspark.* to pyspark.sql.* Key: SPARK-46985 URL: https://issues.apache.org/jira/browse/SPARK-46985 Project: Spark Issue Type:

[jira] [Created] (SPARK-46984) Remove pyspark.copy_func

Hyukjin Kwon created SPARK-46984: Summary: Remove pyspark.copy_func Key: SPARK-46984 URL: https://issues.apache.org/jira/browse/SPARK-46984 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46983) Decouple module dependencies between PySpark modules

Hyukjin Kwon created SPARK-46983: Summary: Decouple module dependencies between PySpark modules Key: SPARK-46983 URL: https://issues.apache.org/jira/browse/SPARK-46983 Project: Spark Issue

[jira] [Assigned] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

[ https://issues.apache.org/jira/browse/SPARK-46974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46974: Assignee: Kent Yao > Recover a test case for day-of-year 2-letter 'DD' pattern parsing

[jira] [Resolved] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

[ https://issues.apache.org/jira/browse/SPARK-46974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46974. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45024

[jira] [Resolved] (SPARK-46954) XML: Perf optimizations

[ https://issues.apache.org/jira/browse/SPARK-46954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46954. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44997

[jira] [Assigned] (SPARK-46954) XML: Perf optimizations

[ https://issues.apache.org/jira/browse/SPARK-46954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46954: Assignee: Sandip Agarwala > XML: Perf optimizations > --- > >

<    1   2   3   4   5   6   7   8   9   10   >