[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Summary: Reenble AmmoniteTest tests in Maven builds (was: Eanble AmmoniteTest tests in Maven

[jira] [Created] (SPARK-47110) Eanble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47110: Summary: Eanble AmmoniteTest tests in Maven builds Key: SPARK-47110 URL: https://issues.apache.org/jira/browse/SPARK-47110 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47097: Assignee: Hyukjin Kwon > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Resolved] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47097. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45173

[jira] [Resolved] (SPARK-46820) Fix error message regression by restoring new_msg

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46820. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44859

[jira] [Assigned] (SPARK-46820) Fix error message regression by restoring new_msg

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46820: Assignee: Haejoon Lee > Fix error message regression by restoring new_msg >

[jira] [Updated] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47097: - Issue Type: Test (was: Improvement) > Deflake "interrupt tag" at SparkSessionE2ESuite >

[jira] [Created] (SPARK-47097) Deflake "interrupt tag" at SparkSessionE2ESuite

2024-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47097: Summary: Deflake "interrupt tag" at SparkSessionE2ESuite Key: SPARK-47097 URL: https://issues.apache.org/jira/browse/SPARK-47097 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47062) Make Spark Connect Plugins Java Compatible

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47062. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45114

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47096: - Description: {code} Error: dyld[4738]: Library not loaded:

[jira] [Updated] (SPARK-47096) Upgrade Python version in Maven build in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47096: - Summary: Upgrade Python version in Maven build in macos-14 build (was: Upgrade Python version

[jira] [Created] (SPARK-47096) Upgrade Python version in Maven build for macos compatibility

2024-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47096: Summary: Upgrade Python version in Maven build for macos compatibility Key: SPARK-47096 URL: https://issues.apache.org/jira/browse/SPARK-47096 Project: Spark

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Description: https://github.com/apache/spark/actions/runs/7964626045/job/21742573399 It fails

[jira] [Updated] (SPARK-47095) Uses proper options for command script for macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses proper options for command script for macos-14 build (was: Uses Mac dedicated

[jira] [Assigned] (SPARK-47095) Uses proper options for command script for macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47095: Assignee: Hyukjin Kwon > Uses proper options for command script for macos-14 build >

[jira] [Updated] (SPARK-47095) Uses Mac dedicated options for command script for macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses Mac dedicated options for command script for macos-14 build (was: Uses Mac

[jira] [Updated] (SPARK-47095) Uses proper options for command script in macos-14 build

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47095: - Summary: Uses proper options for command script in macos-14 build (was: Uses proper options

[jira] [Created] (SPARK-47095) Uses Mac dedicated options for command script

2024-02-19 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47095: Summary: Uses Mac dedicated options for command script Key: SPARK-47095 URL: https://issues.apache.org/jira/browse/SPARK-47095 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47090) Skip JDK 17/21 Maven build in branch-3.4 scheduled job

2024-02-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47090. -- Resolution: Invalid > Skip JDK 17/21 Maven build in branch-3.4 scheduled job >

[jira] [Updated] (SPARK-47090) Skip JDK 17/21 Maven build in branch-3.4 scheduled job

2024-02-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47090: - Summary: Skip JDK 17/21 Maven build in branch-3.4 scheduled job (was: Skip JDK 21 build in

[jira] [Created] (SPARK-47090) Skip JDK 21 build in branch-3.4 scheduled job

2024-02-18 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47090: Summary: Skip JDK 21 build in branch-3.4 scheduled job Key: SPARK-47090 URL: https://issues.apache.org/jira/browse/SPARK-47090 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47082) Out of bounds error message is incorrect

2024-02-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47082. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45151

[jira] [Assigned] (SPARK-47082) Out of bounds error message is incorrect

2024-02-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47082: Assignee: Nicholas Chammas > Out of bounds error message is incorrect >

[jira] [Updated] (SPARK-47067) Add Daily Apple Silicon Github Action Job (Java/Scala)

2024-02-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47067: - Fix Version/s: (was: 4.0.0) > Add Daily Apple Silicon Github Action Job (Java/Scala) >

[jira] [Resolved] (SPARK-47057) Reenable MyPy data test

2024-02-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47057. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45135

[jira] [Assigned] (SPARK-47057) Reenable MyPy data test

2024-02-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47057: Assignee: Hyukjin Kwon > Reenable MyPy data test > --- > >

[jira] [Updated] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47068: - Fix Version/s: 4.0.0 3.5.2 3.4.3 > Recover -1 and 0 case

[jira] [Assigned] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47068: Assignee: Hyukjin Kwon > Recover -1 and 0 case for

[jira] [Resolved] (SPARK-46078) Upgrade `pytorch` for Python 3.12

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46078. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45119

[jira] [Resolved] (SPARK-47055) Upgrade MyPy 1.8.0

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47055. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45115

[jira] [Created] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch

2024-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47068: Summary: Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch Key: SPARK-47068 URL: https://issues.apache.org/jira/browse/SPARK-47068 Project:

[jira] [Updated] (SPARK-47057) Reenable MyPy data test

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47057: - Summary: Reenable MyPy data test (was: Reenable MyPy Data test) > Reenable MyPy data test >

[jira] [Created] (SPARK-47057) Reenable MyPy Data test

2024-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47057: Summary: Reenable MyPy Data test Key: SPARK-47057 URL: https://issues.apache.org/jira/browse/SPARK-47057 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-47055) Upgrade MyPy 1.8.0

2024-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47055: - Summary: Upgrade MyPy 1.8.0 (was: Upgrade MyPy from 0.920 to 1.8.0) > Upgrade MyPy 1.8.0 >

[jira] [Created] (SPARK-47055) Upgrade MyPy from 0.920 to 1.8.0

2024-02-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47055: Summary: Upgrade MyPy from 0.920 to 1.8.0 Key: SPARK-47055 URL: https://issues.apache.org/jira/browse/SPARK-47055 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-47054) Remove pinned version of torch for Python 3.12 support

2024-02-14 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47054: Summary: Remove pinned version of torch for Python 3.12 support Key: SPARK-47054 URL: https://issues.apache.org/jira/browse/SPARK-47054 Project: Spark Issue

[jira] [Commented] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

2024-02-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17817564#comment-17817564 ] Hyukjin Kwon commented on SPARK-45396: -- Reverted in branch-3.5:

[jira] [Updated] (SPARK-45396) Add doc entry for `pyspark.ml.connect` module

2024-02-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-45396: - Fix Version/s: (was: 3.5.1) > Add doc entry for `pyspark.ml.connect` module >

[jira] [Assigned] (SPARK-47004) Increase Scala client test coverage

2024-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47004: Assignee: Bo Gao > Increase Scala client test coverage >

[jira] [Resolved] (SPARK-47004) Increase Scala client test coverage

2024-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47004. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45063

[jira] [Resolved] (SPARK-47026) Include coverage of JSON data sources in array/struct/map default value tests

2024-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47026. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45086

[jira] [Assigned] (SPARK-47026) Include coverage of JSON data sources in array/struct/map default value tests

2024-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47026: Assignee: Mark Jarvin > Include coverage of JSON data sources in array/struct/map

[jira] [Resolved] (SPARK-46944) Follow up to SPARK-46792: Fix minor typing oversight

2024-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46944. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44983

[jira] [Resolved] (SPARK-46984) Remove pyspark.copy_func

2024-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46984. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45042

[jira] [Assigned] (SPARK-46984) Remove pyspark.copy_func

2024-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46984: Assignee: Hyukjin Kwon > Remove pyspark.copy_func > > >

[jira] [Deleted] (SPARK-46986) Move pyspark.loose_version to pyspark.sql.loose_version

2024-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46986: - > Move pyspark.loose_version to pyspark.sql.loose_version >

[jira] [Deleted] (SPARK-46985) Move _NoValue from pyspark.* to pyspark.sql.*

2024-02-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46985: - > Move _NoValue from pyspark.* to pyspark.sql.* > - >

[jira] [Created] (SPARK-46986) Move pyspark.loose_version to pyspark.sql.loose_version

2024-02-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46986: Summary: Move pyspark.loose_version to pyspark.sql.loose_version Key: SPARK-46986 URL: https://issues.apache.org/jira/browse/SPARK-46986 Project: Spark

[jira] [Updated] (SPARK-46984) Remove pyspark.copy_func

2024-02-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46984: - Priority: Minor (was: Major) > Remove pyspark.copy_func > > >

[jira] [Created] (SPARK-46985) Move _NoValue from pyspark.* to pyspark.sql.*

2024-02-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46985: Summary: Move _NoValue from pyspark.* to pyspark.sql.* Key: SPARK-46985 URL: https://issues.apache.org/jira/browse/SPARK-46985 Project: Spark Issue Type:

[jira] [Created] (SPARK-46984) Remove pyspark.copy_func

2024-02-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46984: Summary: Remove pyspark.copy_func Key: SPARK-46984 URL: https://issues.apache.org/jira/browse/SPARK-46984 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-46983) Decouple module dependencies between PySpark modules

2024-02-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46983: Summary: Decouple module dependencies between PySpark modules Key: SPARK-46983 URL: https://issues.apache.org/jira/browse/SPARK-46983 Project: Spark Issue

[jira] [Assigned] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

2024-02-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46974: Assignee: Kent Yao > Recover a test case for day-of-year 2-letter 'DD' pattern parsing

[jira] [Resolved] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

2024-02-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46974. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45024

[jira] [Resolved] (SPARK-46954) XML: Perf optimizations

2024-02-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46954. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44997

[jira] [Assigned] (SPARK-46954) XML: Perf optimizations

2024-02-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46954: Assignee: Sandip Agarwala > XML: Perf optimizations > --- > >

[jira] [Resolved] (SPARK-46952) XML: Limit size of corrupt record

2024-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46952. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44994

[jira] [Assigned] (SPARK-46952) XML: Limit size of corrupt record

2024-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46952: Assignee: Sandip Agarwala > XML: Limit size of corrupt record >

[jira] [Resolved] (SPARK-46941) Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction

2024-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46941. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44980

[jira] [Assigned] (SPARK-46941) Can't insert window group limit node for top-k computation if contains SizeBasedWindowFunction

2024-02-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46941: Assignee: Mingliang Zhu > Can't insert window group limit node for top-k computation if

[jira] [Resolved] (SPARK-46753) Fix `pypy3` python test

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44778

[jira] [Assigned] (SPARK-46753) Fix `pypy3` python test

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46753: Assignee: BingKun Pan > Fix `pypy3` python test > --- > >

[jira] [Resolved] (SPARK-46927) Make `assertDataFrameEqual` work properly without PyArrow

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46927. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44960

[jira] [Assigned] (SPARK-46927) Make `assertDataFrameEqual` work properly without PyArrow

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46927: Assignee: Haejoon Lee > Make `assertDataFrameEqual` work properly without PyArrow >

[jira] [Assigned] (SPARK-46925) Add a warning that instructs to install memory_profiler for memory profiling

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46925: Assignee: Xinrong Meng > Add a warning that instructs to install memory_profiler for

[jira] [Resolved] (SPARK-46925) Add a warning that instructs to install memory_profiler for memory profiling

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46925. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44958

[jira] [Resolved] (SPARK-46923) Limit width of config tables in documentation and style them consistently

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46923. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44955

[jira] [Assigned] (SPARK-46923) Limit width of config tables in documentation and style them consistently

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46923: Assignee: Nicholas Chammas > Limit width of config tables in documentation and style

[jira] [Resolved] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46910. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44940

[jira] [Assigned] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46910: Assignee: Amanda Liu > Eliminate JDK Requirement in PySpark Installation >

[jira] [Resolved] (SPARK-46889) Validate `spark.master.ui.decommission.allow.mode` setting

2024-01-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46889. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44916

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

2024-01-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46873: Assignee: Wei Liu > PySpark spark.streams should not recreate new StreamingQueryManager

[jira] [Resolved] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

2024-01-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46873. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44898

[jira] [Resolved] (SPARK-46792) Refactor ChannelBuilder system

2024-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46792. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44832

[jira] [Assigned] (SPARK-46792) Refactor ChannelBuilder system

2024-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46792: Assignee: Alice Sayutina > Refactor ChannelBuilder system >

[jira] [Assigned] (SPARK-46825) Build Spark only once when building docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46825: Assignee: Nicholas Chammas > Build Spark only once when building docs >

[jira] [Resolved] (SPARK-46825) Build Spark only once when building docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46825. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44865

[jira] [Assigned] (SPARK-46811) Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46811: Assignee: Kent Yao > Github Action: TypeError: Cannot read properties of undefined

[jira] [Resolved] (SPARK-46811) Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44850

[jira] [Assigned] (SPARK-46728) Check pandas installation properly

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46728: Assignee: Haejoon Lee > Check pandas installation properly >

[jira] [Resolved] (SPARK-46728) Check pandas installation properly

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46728. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44745

[jira] [Resolved] (SPARK-46764) Reorganize Ruby script to build API docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46764. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44791

[jira] [Assigned] (SPARK-46764) Reorganize Ruby script to build API docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46764: Assignee: Nicholas Chammas > Reorganize Ruby script to build API docs >

[jira] [Resolved] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46808. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44848

[jira] [Assigned] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46808: Assignee: Hyukjin Kwon > Refine error classes in Python with automatic sorting function

[jira] [Assigned] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46807: Assignee: Nicholas Chammas > Include automation notice in SQL error class documents >

[jira] [Resolved] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46807. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44847

[jira] [Updated] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46808: - Parent: SPARK-45673 Issue Type: Sub-task (was: Test) > Refine error classes in Python

[jira] [Resolved] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46806. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44846

[jira] [Assigned] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46806: Assignee: Hyukjin Kwon > Improve error message for spark.table when argument type is

[jira] [Created] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46808: Summary: Refine error classes in Python with automatic sorting function Key: SPARK-46808 URL: https://issues.apache.org/jira/browse/SPARK-46808 Project: Spark

[jira] [Updated] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46806: - Description: {code} >>> spark.table(None) Traceback (most recent call last): File "", line 1,

[jira] [Created] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46806: Summary: Improve error message for spark.table when argument type is wrong Key: SPARK-46806 URL: https://issues.apache.org/jira/browse/SPARK-46806 Project: Spark

[jira] [Resolved] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46802. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44842

[jira] [Assigned] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46802: Assignee: Hyukjin Kwon > Cleanup codecov script > -- > >

[jira] [Created] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46802: Summary: Cleanup codecov script Key: SPARK-46802 URL: https://issues.apache.org/jira/browse/SPARK-46802 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46801: Summary: Do not treat exit 5 as a test failure in Python testing script Key: SPARK-46801 URL: https://issues.apache.org/jira/browse/SPARK-46801 Project: Spark

[jira] [Resolved] (SPARK-46781) Test custom data source and input partition (pyspark.sql.datasource)

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46781. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44808

[jira] [Assigned] (SPARK-46775) Fix formatting of Kinesis docs

2024-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46775: Assignee: Nicholas Chammas > Fix formatting of Kinesis docs >

[jira] [Resolved] (SPARK-46775) Fix formatting of Kinesis docs

2024-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46775. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44802

<    1   2   3   4   5   6   7   8   9   10   >