[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace when reading/parsing a time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with an unexpected

[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace when reading/parsing a time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: A Spark app being stuck with an unexpected stack trace when reading/parsing a time string

[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace around parsing a time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with a stack trace

[jira] [Updated] (SPARK-47759) A Spark app being stuck with a stack trace indicating that a legitimate time string cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with a stack trace

[jira] [Updated] (SPARK-47759) A Spark app being stuck with an unexpected stack trace around parsing a time string

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: A Spark app being stuck with an unexpected stack trace around parsing a time string (was: A

[jira] [Updated] (SPARK-47759) A Spark app being stuck with a stack trace indicating that a legitimate time string cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Labels: hang pull-request-available stuck threadsafe (was: hang infinite-loop pull-request-available

[jira] [Updated] (SPARK-47759) A Spark app being stuck with a stack trace indicating that a legitimate time string cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Summary: A Spark app being stuck with a stack trace indicating that a legitimate time string cannot be

[jira] [Updated] (SPARK-47759) A Spark app being stuck with a stacktrace indicating that a legitimate time string cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with a stack trace

[jira] [Updated] (SPARK-47759) A Spark app being stuck with a stacktrace indicating that a legitimate time string cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Description: h2. Symptom It's observed that our Spark apps occasionally got stuck with the stack trace

[jira] [Created] (SPARK-47759) A Spark app being stuck with a stacktrace indicating that a legitimate time string cannot be parsed

Bo Xiong created SPARK-47759: Summary: A Spark app being stuck with a stacktrace indicating that a legitimate time string cannot be parsed Key: SPARK-47759 URL: https://issues.apache.org/jira/browse/SPARK-47759

[jira] [Updated] (SPARK-47759) A Spark app being stuck with a stacktrace indicating that a legitimate time string cannot be parsed

[ https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Xiong updated SPARK-47759: - Fix Version/s: 3.5.0 (was: 3.4.2) (was: 3.5.1)

[jira] [Resolved] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-47750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47750. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45912

[jira] [Assigned] (SPARK-47750) Postgres: Document Mapping Spark SQL Data Types to PostgreSQL

[ https://issues.apache.org/jira/browse/SPARK-47750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47750: Assignee: Kent Yao > Postgres: Document Mapping Spark SQL Data Types to PostgreSQL >

[jira] [Assigned] (SPARK-47657) Implement filter pushdown support for collation per file source

[ https://issues.apache.org/jira/browse/SPARK-47657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47657: --- Assignee: Stefan Kandic > Implement filter pushdown support for collation per file source

[jira] [Resolved] (SPARK-47657) Implement filter pushdown support for collation per file source

[ https://issues.apache.org/jira/browse/SPARK-47657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47657. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45782

[jira] [Resolved] (SPARK-47713) Fix a self-join failure

[ https://issues.apache.org/jira/browse/SPARK-47713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47713. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45846

[jira] [Updated] (SPARK-47590) Hive-thriftserver: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47590: --- Labels: pull-request-available (was: ) > Hive-thriftserver: Migrate logWarn with variables

[jira] [Resolved] (SPARK-47558) [Arbitrary State Support] State TTL support - ValueState

[ https://issues.apache.org/jira/browse/SPARK-47558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47558. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45674

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47737: Description: For more rich API support (was: Use the latest version for stability.) > Bump

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47737: Summary: Bump PyArrow to 10.0.0 (was: Bump PyArrow to 15.0.2) > Bump PyArrow to 10.0.0 >

[jira] [Created] (SPARK-47756) Reeanble UDFProfilerParityTests for pyspark-connect

Hyukjin Kwon created SPARK-47756: Summary: Reeanble UDFProfilerParityTests for pyspark-connect Key: SPARK-47756 URL: https://issues.apache.org/jira/browse/SPARK-47756 Project: Spark Issue

[jira] [Created] (SPARK-47757) Reeanble ResourceProfileTests for pyspark-connect

Hyukjin Kwon created SPARK-47757: Summary: Reeanble ResourceProfileTests for pyspark-connect Key: SPARK-47757 URL: https://issues.apache.org/jira/browse/SPARK-47757 Project: Spark Issue

[jira] [Assigned] (SPARK-47299) Use the same `versions. json` in the dropdown of different versions of PySpark documents

[ https://issues.apache.org/jira/browse/SPARK-47299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47299: Assignee: BingKun Pan > Use the same `versions. json` in the dropdown of different

[jira] [Resolved] (SPARK-47299) Use the same `versions. json` in the dropdown of different versions of PySpark documents

[ https://issues.apache.org/jira/browse/SPARK-47299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47299. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-47755) Pivot should fail when the number of distinct values is too large

[ https://issues.apache.org/jira/browse/SPARK-47755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47755. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45918

[jira] [Updated] (SPARK-47734) Fix flaky pyspark.sql.dataframe.DataFrame.writeStream doctest by stopping streaming query

[ https://issues.apache.org/jira/browse/SPARK-47734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-47734: - Fix Version/s: 3.4.3 > Fix flaky pyspark.sql.dataframe.DataFrame.writeStream doctest by

[jira] [Resolved] (SPARK-47744) Add support for negative byte types in RocksDB range scan encoder

[ https://issues.apache.org/jira/browse/SPARK-47744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-47744. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45906

[jira] [Assigned] (SPARK-47744) Add support for negative byte types in RocksDB range scan encoder

[ https://issues.apache.org/jira/browse/SPARK-47744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-47744: Assignee: Neil Ramaswamy > Add support for negative byte types in RocksDB range scan

[jira] [Resolved] (SPARK-47752) Make pyspark.pandas compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47752. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45915

[jira] [Assigned] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47753: Assignee: Hyukjin Kwon > Make pyspark.testing compatible with pyspark-connect >

[jira] [Resolved] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47753. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45916

[jira] [Assigned] (SPARK-47725) Set up the CI for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47725: -- Assignee: (was: Apache Spark) > Set up the CI for pyspark-connect package >

[jira] [Assigned] (SPARK-47754) Postgres: Support reading multidimensional arrays

[ https://issues.apache.org/jira/browse/SPARK-47754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47754: -- Assignee: Apache Spark > Postgres: Support reading multidimensional arrays >

[jira] [Assigned] (SPARK-47725) Set up the CI for pyspark-connect package

[ https://issues.apache.org/jira/browse/SPARK-47725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47725: -- Assignee: Apache Spark > Set up the CI for pyspark-connect package >

[jira] [Updated] (SPARK-47754) Postgres: Support reading multidimensional arrays

[ https://issues.apache.org/jira/browse/SPARK-47754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47754: --- Labels: pull-request-available (was: ) > Postgres: Support reading multidimensional arrays

[jira] [Created] (SPARK-47754) Postgres: Support reading multidimensional arrays

Kent Yao created SPARK-47754: Summary: Postgres: Support reading multidimensional arrays Key: SPARK-47754 URL: https://issues.apache.org/jira/browse/SPARK-47754 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

[ https://issues.apache.org/jira/browse/SPARK-47753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47753: --- Labels: pull-request-available (was: ) > Make pyspark.testing compatible with

[jira] [Updated] (SPARK-37018) Spark SQL should support create function with Aggregator

[ https://issues.apache.org/jira/browse/SPARK-37018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-37018: --- Labels: pull-request-available (was: ) > Spark SQL should support create function with

[jira] [Created] (SPARK-47753) Make pyspark.testing compatible with pyspark-connect

Hyukjin Kwon created SPARK-47753: Summary: Make pyspark.testing compatible with pyspark-connect Key: SPARK-47753 URL: https://issues.apache.org/jira/browse/SPARK-47753 Project: Spark Issue