[jira] [Resolved] (SPARK-46753) Fix `pypy3` python test

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44778

[jira] [Assigned] (SPARK-46753) Fix `pypy3` python test

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46753: Assignee: BingKun Pan > Fix `pypy3` python test > --- > >

[jira] [Resolved] (SPARK-46927) Make `assertDataFrameEqual` work properly without PyArrow

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46927. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44960

[jira] [Assigned] (SPARK-46927) Make `assertDataFrameEqual` work properly without PyArrow

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46927: Assignee: Haejoon Lee > Make `assertDataFrameEqual` work properly without PyArrow >

[jira] [Assigned] (SPARK-46925) Add a warning that instructs to install memory_profiler for memory profiling

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46925: Assignee: Xinrong Meng > Add a warning that instructs to install memory_profiler for

[jira] [Resolved] (SPARK-46925) Add a warning that instructs to install memory_profiler for memory profiling

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46925. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44958

[jira] [Resolved] (SPARK-46923) Limit width of config tables in documentation and style them consistently

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46923. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44955

[jira] [Assigned] (SPARK-46923) Limit width of config tables in documentation and style them consistently

2024-01-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46923: Assignee: Nicholas Chammas > Limit width of config tables in documentation and style

[jira] [Resolved] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46910. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44940

[jira] [Assigned] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46910: Assignee: Amanda Liu > Eliminate JDK Requirement in PySpark Installation >

[jira] [Resolved] (SPARK-46889) Validate `spark.master.ui.decommission.allow.mode` setting

2024-01-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46889. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44916

[jira] [Assigned] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

2024-01-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46873: Assignee: Wei Liu > PySpark spark.streams should not recreate new StreamingQueryManager

[jira] [Resolved] (SPARK-46873) PySpark spark.streams should not recreate new StreamingQueryManager

2024-01-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46873. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44898

[jira] [Resolved] (SPARK-46792) Refactor ChannelBuilder system

2024-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46792. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44832

[jira] [Assigned] (SPARK-46792) Refactor ChannelBuilder system

2024-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46792: Assignee: Alice Sayutina > Refactor ChannelBuilder system >

[jira] [Assigned] (SPARK-46825) Build Spark only once when building docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46825: Assignee: Nicholas Chammas > Build Spark only once when building docs >

[jira] [Resolved] (SPARK-46825) Build Spark only once when building docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46825. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44865

[jira] [Assigned] (SPARK-46811) Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46811: Assignee: Kent Yao > Github Action: TypeError: Cannot read properties of undefined

[jira] [Resolved] (SPARK-46811) Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46811. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44850

[jira] [Assigned] (SPARK-46728) Check pandas installation properly

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46728: Assignee: Haejoon Lee > Check pandas installation properly >

[jira] [Resolved] (SPARK-46728) Check pandas installation properly

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46728. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44745

[jira] [Resolved] (SPARK-46764) Reorganize Ruby script to build API docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46764. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44791

[jira] [Assigned] (SPARK-46764) Reorganize Ruby script to build API docs

2024-01-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46764: Assignee: Nicholas Chammas > Reorganize Ruby script to build API docs >

[jira] [Resolved] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46808. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44848

[jira] [Assigned] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46808: Assignee: Hyukjin Kwon > Refine error classes in Python with automatic sorting function

[jira] [Assigned] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46807: Assignee: Nicholas Chammas > Include automation notice in SQL error class documents >

[jira] [Resolved] (SPARK-46807) Include automation notice in SQL error class documents

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46807. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44847

[jira] [Updated] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46808: - Parent: SPARK-45673 Issue Type: Sub-task (was: Test) > Refine error classes in Python

[jira] [Resolved] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46806. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44846

[jira] [Assigned] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46806: Assignee: Hyukjin Kwon > Improve error message for spark.table when argument type is

[jira] [Created] (SPARK-46808) Refine error classes in Python with automatic sorting function

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46808: Summary: Refine error classes in Python with automatic sorting function Key: SPARK-46808 URL: https://issues.apache.org/jira/browse/SPARK-46808 Project: Spark

[jira] [Updated] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46806: - Description: {code} >>> spark.table(None) Traceback (most recent call last): File "", line 1,

[jira] [Created] (SPARK-46806) Improve error message for spark.table when argument type is wrong

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46806: Summary: Improve error message for spark.table when argument type is wrong Key: SPARK-46806 URL: https://issues.apache.org/jira/browse/SPARK-46806 Project: Spark

[jira] [Resolved] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46802. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44842

[jira] [Assigned] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46802: Assignee: Hyukjin Kwon > Cleanup codecov script > -- > >

[jira] [Created] (SPARK-46802) Cleanup codecov script

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46802: Summary: Cleanup codecov script Key: SPARK-46802 URL: https://issues.apache.org/jira/browse/SPARK-46802 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script

2024-01-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46801: Summary: Do not treat exit 5 as a test failure in Python testing script Key: SPARK-46801 URL: https://issues.apache.org/jira/browse/SPARK-46801 Project: Spark

[jira] [Resolved] (SPARK-46781) Test custom data source and input partition (pyspark.sql.datasource)

2024-01-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46781. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44808

[jira] [Assigned] (SPARK-46775) Fix formatting of Kinesis docs

2024-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46775: Assignee: Nicholas Chammas > Fix formatting of Kinesis docs >

[jira] [Resolved] (SPARK-46775) Fix formatting of Kinesis docs

2024-01-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46775. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44802

[jira] [Updated] (SPARK-46751) Skip test_datasource if PyArrow is not installed

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46751: - Parent: SPARK-44076 Issue Type: Sub-task (was: Test) > Skip test_datasource if PyArrow

[jira] [Created] (SPARK-46751) Skip test_datasource if PyArrow is not installed

2024-01-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46751: Summary: Skip test_datasource if PyArrow is not installed Key: SPARK-46751 URL: https://issues.apache.org/jira/browse/SPARK-46751 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46749) Document `SPARK_LOG_*` and `SPARK_PID_DIR`

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46749. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44774

[jira] [Resolved] (SPARK-46663) Disable memory profiler for pandas UDFs with iterators

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46663. -- Fix Version/s: 3.5.1 Resolution: Fixed Issue resolved by pull request 44760

[jira] [Resolved] (SPARK-46686) Basic support of SparkSession based Python UDF profiler

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46686. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44697

[jira] [Updated] (SPARK-46732) Propagate JobArtifactSet to broadcast execution thread

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46732: - Fix Version/s: 4.0.0 3.5.1 > Propagate JobArtifactSet to broadcast execution

[jira] [Assigned] (SPARK-46732) Propagate JobArtifactSet to broadcast execution thread

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46732: Assignee: xie shuiahu > Propagate JobArtifactSet to broadcast execution thread >

[jira] [Resolved] (SPARK-46732) Propagate JobArtifactSet to broadcast execution thread

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46732. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/44753 > Propagate

[jira] [Assigned] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46730: Assignee: Yang Jie > Refine docstring of `str_to_map/map_filter/map_zip_with` >

[jira] [Resolved] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46730. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44747

[jira] [Resolved] (SPARK-46677) Fix `df.col("*")` resolution

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46677. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44689

[jira] [Assigned] (SPARK-46723) Make addArtifact retrying on errors

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46723: Assignee: Alice Sayutina > Make addArtifact retrying on errors >

[jira] [Resolved] (SPARK-46723) Make addArtifact retrying on errors

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44740

[jira] [Resolved] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46720. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44734

[jira] [Assigned] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46720: Assignee: Hyukjin Kwon > Refactor Python Data Source to align with other built-in Data

[jira] [Assigned] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46660: Assignee: Venkata Sai Akhil Gudesa > ReattachExecute requests do not refresh aliveness

[jira] [Resolved] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46660. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44670

[jira] [Updated] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46720: - Summary: Refactor Python Data Source to align with other built-in Data Sources (was: Refactor

[jira] [Created] (SPARK-46720) Refactor Python Data Source to aline with other built-in Data Sources

2024-01-14 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46720: Summary: Refactor Python Data Source to aline with other built-in Data Sources Key: SPARK-46720 URL: https://issues.apache.org/jira/browse/SPARK-46720 Project: Spark

[jira] [Assigned] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46716: Assignee: Jungtaek Lim > Add a test regarding to backward compatibility check for Scala

[jira] [Resolved] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46716. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44730

[jira] [Assigned] (SPARK-46709) Expose partition_id column in state datasource by default

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46709: Assignee: Chaoqin Li > Expose partition_id column in state datasource by default >

[jira] [Resolved] (SPARK-46709) Expose partition_id column in state datasource by default

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46709. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44717

[jira] [Resolved] (SPARK-46699) Split `ArithmeticTests`

2024-01-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46699. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44708

[jira] [Updated] (SPARK-46429) avoid duplicate Classes and Resources in classpath of SPARK_HOME/jars/*.jar

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46429: - Affects Version/s: (was: 3.5.2) > avoid duplicate Classes and Resources in classpath of

[jira] [Updated] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46684: - Fix Version/s: 3.5.1 > CoGroup.applyInPandas/Arrow should pass arguments properly >

[jira] [Assigned] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46684: Assignee: Takuya Ueshin > CoGroup.applyInPandas/Arrow should pass arguments properly >

[jira] [Resolved] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46684. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44695

[jira] [Assigned] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46670: Assignee: Hyukjin Kwon > Make DataSourceManager isolated and self clone-able >

[jira] [Resolved] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46670. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44681

[jira] [Assigned] (SPARK-46667) XML: Throw error on multiple XML data source

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46667: Assignee: Sandip Agarwala > XML: Throw error on multiple XML data source >

[jira] [Resolved] (SPARK-46667) XML: Throw error on multiple XML data source

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46667. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44685

[jira] [Assigned] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46668: Assignee: Nicholas Chammas > Parallelize Sphinx build of Python API docs >

[jira] [Resolved] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46668. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44680

[jira] [Resolved] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46614. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/44679 > Refine docstring >

[jira] [Assigned] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46614: Assignee: BingKun Pan > Refine docstring >

[jira] [Resolved] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-4. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44676

[jira] [Assigned] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: Hyukjin Kwon > Make lxml as an optional testing dependency in test_session >

[jira] [Created] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46670: Summary: Make DataSourceManager isolated and self clone-able Key: SPARK-46670 URL: https://issues.apache.org/jira/browse/SPARK-46670 Project: Spark Issue

[jira] [Resolved] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46658. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44667

[jira] [Assigned] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46658: Assignee: Nicholas Chammas > Loosen Ruby dependency specs for doc build >

[jira] [Created] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-4: Summary: Make lxml as an optional testing dependency in test_session Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark

[jira] [Assigned] (SPARK-46651) Split `FrameTakeTests`

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46651: Assignee: Ruifeng Zheng > Split `FrameTakeTests` > -- > >

[jira] [Resolved] (SPARK-46651) Split `FrameTakeTests`

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46651. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44656

[jira] [Assigned] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46649: Assignee: Hyukjin Kwon > Run PyPy 3 and Python 3.10 tests independently >

[jira] [Assigned] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46645: Assignee: Hyukjin Kwon > Exclude unittest-xml-reporting in Python 3.12 image >

[jira] [Resolved] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46649. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44655

[jira] [Resolved] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46645. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44652

[jira] [Updated] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46649: - Description: https://github.com/apache/spark/actions/runs/7462843546/job/20306241275 Seems

[jira] [Created] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46649: Summary: Run PyPy 3 and Python 3.10 tests independently Key: SPARK-46649 URL: https://issues.apache.org/jira/browse/SPARK-46649 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46536) Support GROUP BY calendar_interval_type

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46536. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44538

[jira] [Created] (SPARK-46647) Add unittest-xml-reporting into Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46647: Summary: Add unittest-xml-reporting into Python 3.12 image Key: SPARK-46647 URL: https://issues.apache.org/jira/browse/SPARK-46647 Project: Spark Issue

[jira] [Created] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46645: Summary: Exclude unittest-xml-reporting in Python 3.12 image Key: SPARK-46645 URL: https://issues.apache.org/jira/browse/SPARK-46645 Project: Spark Issue

[jira] [Updated] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46645: - Issue Type: Test (was: Improvement) > Exclude unittest-xml-reporting in Python 3.12 image >

[jira] [Updated] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46645: - Issue Type: Improvement (was: Bug) > Exclude unittest-xml-reporting in Python 3.12 image >

[jira] [Assigned] (SPARK-37039) np.nan series.astype(bool) should be True

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37039: Assignee: Haejoon Lee > np.nan series.astype(bool) should be True >

[jira] [Resolved] (SPARK-37039) np.nan series.astype(bool) should be True

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37039. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44570

[jira] [Resolved] (SPARK-46633) Reading a non-empty Avro file with empty blocks returns 0 records

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46633. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44635

[jira] [Assigned] (SPARK-46633) Reading a non-empty Avro file with empty blocks returns 0 records

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46633: Assignee: Ivan Sadikov > Reading a non-empty Avro file with empty blocks returns 0

[jira] [Assigned] (SPARK-46437) Enable conditional includes in Jekyll documentation

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46437: Assignee: Nicholas Chammas > Enable conditional includes in Jekyll documentation >

<    1   2   3   4   5   6   7   8   9   10   >