[jira] [Updated] (SPARK-46751) Skip test_datasource if PyArrow is not installed

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46751: - Parent: SPARK-44076 Issue Type: Sub-task (was: Test) > Skip test_datasource if PyArrow

[jira] [Created] (SPARK-46751) Skip test_datasource if PyArrow is not installed

2024-01-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46751: Summary: Skip test_datasource if PyArrow is not installed Key: SPARK-46751 URL: https://issues.apache.org/jira/browse/SPARK-46751 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46749) Document `SPARK_LOG_*` and `SPARK_PID_DIR`

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46749. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44774

[jira] [Resolved] (SPARK-46663) Disable memory profiler for pandas UDFs with iterators

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46663. -- Fix Version/s: 3.5.1 Resolution: Fixed Issue resolved by pull request 44760

[jira] [Resolved] (SPARK-46686) Basic support of SparkSession based Python UDF profiler

2024-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46686. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44697

[jira] [Updated] (SPARK-46732) Propagate JobArtifactSet to broadcast execution thread

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46732: - Fix Version/s: 4.0.0 3.5.1 > Propagate JobArtifactSet to broadcast execution

[jira] [Assigned] (SPARK-46732) Propagate JobArtifactSet to broadcast execution thread

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46732: Assignee: xie shuiahu > Propagate JobArtifactSet to broadcast execution thread >

[jira] [Resolved] (SPARK-46732) Propagate JobArtifactSet to broadcast execution thread

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46732. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/44753 > Propagate

[jira] [Assigned] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46730: Assignee: Yang Jie > Refine docstring of `str_to_map/map_filter/map_zip_with` >

[jira] [Resolved] (SPARK-46730) Refine docstring of `str_to_map/map_filter/map_zip_with`

2024-01-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46730. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44747

[jira] [Resolved] (SPARK-46677) Fix `df.col("*")` resolution

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46677. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44689

[jira] [Assigned] (SPARK-46723) Make addArtifact retrying on errors

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46723: Assignee: Alice Sayutina > Make addArtifact retrying on errors >

[jira] [Resolved] (SPARK-46723) Make addArtifact retrying on errors

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44740

[jira] [Resolved] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46720. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44734

[jira] [Assigned] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46720: Assignee: Hyukjin Kwon > Refactor Python Data Source to align with other built-in Data

[jira] [Assigned] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46660: Assignee: Venkata Sai Akhil Gudesa > ReattachExecute requests do not refresh aliveness

[jira] [Resolved] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46660. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44670

[jira] [Updated] (SPARK-46720) Refactor Python Data Source to align with other built-in Data Sources

2024-01-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46720: - Summary: Refactor Python Data Source to align with other built-in Data Sources (was: Refactor

[jira] [Created] (SPARK-46720) Refactor Python Data Source to aline with other built-in Data Sources

2024-01-14 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46720: Summary: Refactor Python Data Source to aline with other built-in Data Sources Key: SPARK-46720 URL: https://issues.apache.org/jira/browse/SPARK-46720 Project: Spark

[jira] [Assigned] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46716: Assignee: Jungtaek Lim > Add a test regarding to backward compatibility check for Scala

[jira] [Resolved] (SPARK-46716) Add a test regarding to backward compatibility check for Scala StreamingQueryListener

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46716. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44730

[jira] [Assigned] (SPARK-46709) Expose partition_id column in state datasource by default

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46709: Assignee: Chaoqin Li > Expose partition_id column in state datasource by default >

[jira] [Resolved] (SPARK-46709) Expose partition_id column in state datasource by default

2024-01-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46709. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44717

[jira] [Resolved] (SPARK-46699) Split `ArithmeticTests`

2024-01-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46699. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44708

[jira] [Updated] (SPARK-46429) avoid duplicate Classes and Resources in classpath of SPARK_HOME/jars/*.jar

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46429: - Affects Version/s: (was: 3.5.2) > avoid duplicate Classes and Resources in classpath of

[jira] [Updated] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46684: - Fix Version/s: 3.5.1 > CoGroup.applyInPandas/Arrow should pass arguments properly >

[jira] [Assigned] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46684: Assignee: Takuya Ueshin > CoGroup.applyInPandas/Arrow should pass arguments properly >

[jira] [Resolved] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46684. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44695

[jira] [Assigned] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46670: Assignee: Hyukjin Kwon > Make DataSourceManager isolated and self clone-able >

[jira] [Resolved] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46670. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44681

[jira] [Assigned] (SPARK-46667) XML: Throw error on multiple XML data source

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46667: Assignee: Sandip Agarwala > XML: Throw error on multiple XML data source >

[jira] [Resolved] (SPARK-46667) XML: Throw error on multiple XML data source

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46667. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44685

[jira] [Assigned] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46668: Assignee: Nicholas Chammas > Parallelize Sphinx build of Python API docs >

[jira] [Resolved] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46668. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44680

[jira] [Resolved] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46614. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/44679 > Refine docstring >

[jira] [Assigned] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46614: Assignee: BingKun Pan > Refine docstring >

[jira] [Resolved] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-4. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44676

[jira] [Assigned] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: Hyukjin Kwon > Make lxml as an optional testing dependency in test_session >

[jira] [Created] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46670: Summary: Make DataSourceManager isolated and self clone-able Key: SPARK-46670 URL: https://issues.apache.org/jira/browse/SPARK-46670 Project: Spark Issue

[jira] [Resolved] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46658. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44667

[jira] [Assigned] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46658: Assignee: Nicholas Chammas > Loosen Ruby dependency specs for doc build >

[jira] [Created] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-4: Summary: Make lxml as an optional testing dependency in test_session Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark

[jira] [Assigned] (SPARK-46651) Split `FrameTakeTests`

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46651: Assignee: Ruifeng Zheng > Split `FrameTakeTests` > -- > >

[jira] [Resolved] (SPARK-46651) Split `FrameTakeTests`

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46651. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44656

[jira] [Assigned] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46649: Assignee: Hyukjin Kwon > Run PyPy 3 and Python 3.10 tests independently >

[jira] [Assigned] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46645: Assignee: Hyukjin Kwon > Exclude unittest-xml-reporting in Python 3.12 image >

[jira] [Resolved] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46649. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44655

[jira] [Resolved] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46645. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44652

[jira] [Updated] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46649: - Description: https://github.com/apache/spark/actions/runs/7462843546/job/20306241275 Seems

[jira] [Created] (SPARK-46649) Run PyPy 3 and Python 3.10 tests independently

2024-01-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46649: Summary: Run PyPy 3 and Python 3.10 tests independently Key: SPARK-46649 URL: https://issues.apache.org/jira/browse/SPARK-46649 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46536) Support GROUP BY calendar_interval_type

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46536. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44538

[jira] [Created] (SPARK-46647) Add unittest-xml-reporting into Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46647: Summary: Add unittest-xml-reporting into Python 3.12 image Key: SPARK-46647 URL: https://issues.apache.org/jira/browse/SPARK-46647 Project: Spark Issue

[jira] [Created] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46645: Summary: Exclude unittest-xml-reporting in Python 3.12 image Key: SPARK-46645 URL: https://issues.apache.org/jira/browse/SPARK-46645 Project: Spark Issue

[jira] [Updated] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46645: - Issue Type: Test (was: Improvement) > Exclude unittest-xml-reporting in Python 3.12 image >

[jira] [Updated] (SPARK-46645) Exclude unittest-xml-reporting in Python 3.12 image

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46645: - Issue Type: Improvement (was: Bug) > Exclude unittest-xml-reporting in Python 3.12 image >

[jira] [Assigned] (SPARK-37039) np.nan series.astype(bool) should be True

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37039: Assignee: Haejoon Lee > np.nan series.astype(bool) should be True >

[jira] [Resolved] (SPARK-37039) np.nan series.astype(bool) should be True

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37039. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44570

[jira] [Resolved] (SPARK-46633) Reading a non-empty Avro file with empty blocks returns 0 records

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46633. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44635

[jira] [Assigned] (SPARK-46633) Reading a non-empty Avro file with empty blocks returns 0 records

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46633: Assignee: Ivan Sadikov > Reading a non-empty Avro file with empty blocks returns 0

[jira] [Assigned] (SPARK-46437) Enable conditional includes in Jekyll documentation

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46437: Assignee: Nicholas Chammas > Enable conditional includes in Jekyll documentation >

[jira] [Resolved] (SPARK-46437) Enable conditional includes in Jekyll documentation

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44630

[jira] [Resolved] (SPARK-46593) Refactor `data_type_ops` tests

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46593. -- Resolution: Fixed Issue resolved by pull request 44637

[jira] [Resolved] (SPARK-46637) Enhancing the Visual Appeal of Spark doc website

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46637. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44642

[jira] [Resolved] (SPARK-46630) XML: Validate XML element name on write

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46630. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44634

[jira] [Assigned] (SPARK-46630) XML: Validate XML element name on write

2024-01-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46630: Assignee: Sandip Agarwala > XML: Validate XML element name on write >

[jira] [Assigned] (SPARK-46626) Bump jekyll version to support Ruby 3.3

2024-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46626: Assignee: Nicholas Chammas > Bump jekyll version to support Ruby 3.3 >

[jira] [Resolved] (SPARK-46626) Bump jekyll version to support Ruby 3.3

2024-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46626. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44628

[jira] [Updated] (SPARK-46621) Address null from Exception.getMessage in Py4J captured exception

2024-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46621: - Priority: Minor (was: Major) > Address null from Exception.getMessage in Py4J captured

[jira] [Updated] (SPARK-46621) Address null from Exception.getMessage in Py4J captured exception

2024-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46621: - Description: If JVM throws an exception without a message, the message becomes null and

[jira] [Assigned] (SPARK-46601) Fix log error in handleStatusMessage

2024-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46601: Assignee: qingbo jiao > Fix log error in handleStatusMessage >

[jira] [Resolved] (SPARK-46601) Fix log error in handleStatusMessage

2024-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46601. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44606

[jira] [Resolved] (SPARK-46522) Block Python data source registration with name conflicts

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46522. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44507

[jira] [Assigned] (SPARK-46522) Block Python data source registration with name conflicts

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46522: Assignee: Allison Wang > Block Python data source registration with name conflicts >

[jira] [Reopened] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-46437: -- Assignee: (was: Nicholas Chammas) Reverted at

[jira] [Updated] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46437: - Fix Version/s: (was: 4.0.0) > Remove unnecessary cruft from SQL built-in functions docs >

[jira] [Resolved] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46613. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44617

[jira] [Assigned] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46613: Assignee: Hyukjin Kwon > Log full exception when failed to lookup Python Data Sources >

[jira] [Assigned] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46603: Assignee: Yang Jie > Refine docstring of `parse_url/url_encode/url_decode` >

[jira] [Resolved] (SPARK-46603) Refine docstring of `parse_url/url_encode/url_decode`

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46603. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44604

[jira] [Resolved] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46606. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44610

[jira] [Assigned] (SPARK-46606) Refine docstring of `convert_timezone/make_dt_interval/make_interval`

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46606: Assignee: BingKun Pan > Refine docstring of

[jira] [Updated] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46613: - Description: See https://github.com/apache/spark/pull/44617 > Log full exception when failed to

[jira] [Created] (SPARK-46613) Log full exception when failed to lookup Python Data Sources

2024-01-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46613: Summary: Log full exception when failed to lookup Python Data Sources Key: SPARK-46613 URL: https://issues.apache.org/jira/browse/SPARK-46613 Project: Spark

[jira] [Assigned] (SPARK-46248) Support ignoreCorruptFiles and ignoreMissingFiles options in XML

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46248: Assignee: Shujing Yang > Support ignoreCorruptFiles and ignoreMissingFiles options in

[jira] [Assigned] (SPARK-46607) Check the testing mode

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46607: Assignee: Ruifeng Zheng > Check the testing mode > -- > >

[jira] [Resolved] (SPARK-46248) Support ignoreCorruptFiles and ignoreMissingFiles options in XML

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46248. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44163

[jira] [Resolved] (SPARK-46607) Check the testing mode

2024-01-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46607. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44611

[jira] [Resolved] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

2024-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46599. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44601

[jira] [Assigned] (SPARK-46599) XML: Use TypeCoercion.findTightestCommonType for compatibility check

2024-01-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46599: Assignee: Sandip Agarwala > XML: Use TypeCoercion.findTightestCommonType for

[jira] [Resolved] (SPARK-46587) XML: Fix XSD big integer conversion

2024-01-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46587. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44587

[jira] [Created] (SPARK-46582) Upgrade R Tools version from 4.0.2 to 4.3.2 in AppVeyor

2024-01-03 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46582: Summary: Upgrade R Tools version from 4.0.2 to 4.3.2 in AppVeyor Key: SPARK-46582 URL: https://issues.apache.org/jira/browse/SPARK-46582 Project: Spark

[jira] [Assigned] (SPARK-46571) Re-enable TODOs that are resolved from recent Pandas

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46571: Assignee: Haejoon Lee > Re-enable TODOs that are resolved from recent Pandas >

[jira] [Resolved] (SPARK-46571) Re-enable TODOs that are resolved from recent Pandas

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46571. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44568

[jira] [Assigned] (SPARK-46565) Improve Python data source error classes and messages

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46565: Assignee: Allison Wang > Improve Python data source error classes and messages >

[jira] [Resolved] (SPARK-46565) Improve Python data source error classes and messages

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46565. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44560

[jira] [Resolved] (SPARK-44001) Improve parsing of well known wrapper types

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44001. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43767

[jira] [Resolved] (SPARK-46570) Run Python 3.11 and 3.12 test independently

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46570. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44566

[jira] [Assigned] (SPARK-46570) Run Python 3.11 and 3.12 test independently

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46570: Assignee: Dongjoon Hyun > Run Python 3.11 and 3.12 test independently >

[jira] [Resolved] (SPARK-46553) FutureWarning for interpolate with object dtype

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46553. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44550

[jira] [Assigned] (SPARK-46553) FutureWarning for interpolate with object dtype

2024-01-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46553: Assignee: Haejoon Lee > FutureWarning for interpolate with object dtype >

<    1   2   3   4   5   6   7   8   9   10   >