[jira] [Assigned] (SPARK-47300) quoteIfNeeded should quote identifier starts with digits

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47300: Assignee: Wenchen Fan > quoteIfNeeded should quote identifier starts with digits >

[jira] [Resolved] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47301. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45403

[jira] [Assigned] (SPARK-47301) Fix flaky ParquetIOSuite

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47301: Assignee: BingKun Pan > Fix flaky ParquetIOSuite > > >

[jira] [Resolved] (SPARK-47315) tempView created in createTempView UT is not cleaned up

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47315. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45417

[jira] [Assigned] (SPARK-47315) tempView created in createTempView UT is not cleaned up

2024-03-07 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47315: Assignee: Zhen Wang > tempView created in createTempView UT is not cleaned up >

[jira] [Created] (SPARK-47316) Fix TimestampNTZ in Postgres Array

2024-03-07 Thread Kent Yao (Jira)
Kent Yao created SPARK-47316: Summary: Fix TimestampNTZ in Postgres Array Key: SPARK-47316 URL: https://issues.apache.org/jira/browse/SPARK-47316 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-47293) Build batchSchema with total sparkSchema instead of append one by one

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47293. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45396

[jira] [Assigned] (SPARK-47293) Build batchSchema with total sparkSchema instead of append one by one

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47293: Assignee: Binjie Yang > Build batchSchema with total sparkSchema instead of append one by one >

[jira] [Resolved] (SPARK-47280) Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47280. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45384

[jira] [Resolved] (SPARK-47285) AdaptiveSparkPlanExec should always use the context.session

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47285. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45388

[jira] [Assigned] (SPARK-47285) AdaptiveSparkPlanExec should always use the context.session

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47285: Assignee: XiDuo You > AdaptiveSparkPlanExec should always use the context.session >

[jira] [Commented] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823616#comment-17823616 ] Kent Yao commented on SPARK-47198: -- Hi [~melin], it would be better to ask your questions via the

[jira] [Resolved] (SPARK-47198) Is it possible to dynamically add backend service to ingress with Kubernetes?

2024-03-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47198. -- Resolution: Information Provided > Is it possible to dynamically add backend service to ingress with

[jira] [Created] (SPARK-47280) Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE

2024-03-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-47280: Summary: Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE Key: SPARK-47280 URL: https://issues.apache.org/jira/browse/SPARK-47280 Project: Spark Issue

[jira] [Resolved] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-26494. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45337

[jira] [Assigned] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-42627: Assignee: Kent Yao > Spark: Getting SQLException: Unsupported type -102 reading from Oracle >

[jira] [Assigned] (SPARK-26494) Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-26494: Assignee: Kent Yao > Support Oracle TIMESTAMP WITH LOCAL TIME ZONE type >

[jira] [Resolved] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle

2024-02-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-42627. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45337

[jira] [Resolved] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47132. -- Fix Version/s: 4.0.0 Resolution: Fixed > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Assigned] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47132: Assignee: Albert Ziegler > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Resolved] (SPARK-47205) Upgrade docker-java to 3.3.5

2024-02-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45307

[jira] [Resolved] (SPARK-45200) Spark 3.4.0 always using default log4j profile

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45200. -- Resolution: Not A Problem > Spark 3.4.0 always using default log4j profile >

[jira] [Resolved] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46766. -- Fix Version/s: 4.0.0 Resolution: Fixed resolved by https://github.com/apache/spark/pull/44792

[jira] [Assigned] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46766: Assignee: Kent Yao > ZSTD Buffer Pool Support For AVRO datasource >

[jira] [Created] (SPARK-47205) Upgrade docker-java to 3.3.5

2024-02-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-47205: Summary: Upgrade docker-java to 3.3.5 Key: SPARK-47205 URL: https://issues.apache.org/jira/browse/SPARK-47205 Project: Spark Issue Type: Dependency upgrade

[jira] [Resolved] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47063. -- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47063: Assignee: Pablo Langa Blanco > CAST long to timestamp has different behavior for codegen vs

[jira] [Resolved] (SPARK-47186) Improve the debuggability for docker integration test

2024-02-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47186. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45284

[jira] [Created] (SPARK-47186) Improve the debuggability for docker integration test

2024-02-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-47186: Summary: Improve the debuggability for docker integration test Key: SPARK-47186 URL: https://issues.apache.org/jira/browse/SPARK-47186 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47166) Improve merge_spark_pr.py by emphasising input and error

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47166. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45256

[jira] [Resolved] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47175. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45265

[jira] [Assigned] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47175: Assignee: Dongjoon Hyun > Remove ZOOKEEPER-1844 comment from KafkaTestUtils >

[jira] [Assigned] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47165: Assignee: Kent Yao > Pull docker image only when its' absent >

[jira] [Resolved] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47165. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45255

[jira] [Updated] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47165: - Issue Type: Test (was: Improvement) > Pull docker image only when its' absent >

[jira] [Created] (SPARK-47165) Pull docker image only when its' absent

2024-02-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-47165: Summary: Pull docker image only when its' absent Key: SPARK-47165 URL: https://issues.apache.org/jira/browse/SPARK-47165 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47130: Assignee: Kent Yao > Use listStatus to bypass block location info when cleaning driver logs >

[jira] [Resolved] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47130. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45215

[jira] [Created] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47130: Summary: Use listStatus to bypass block location info when cleaning driver logs Key: SPARK-47130 URL: https://issues.apache.org/jira/browse/SPARK-47130 Project: Spark

[jira] [Updated] (SPARK-47117) Format the whole code base

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47117: - Priority: Trivial (was: Major) > Format the whole code base > -- > >

[jira] [Updated] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34631: - Description: emphasized textcreate a table, set location as parquet, do msck repair table to get the

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819232#comment-17819232 ] Kent Yao commented on SPARK-46934: -- Hi [~dongjoon], this is not a regression. As I commented above, I

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Issue Type: Improvement (was: Test) > HiveExternalCatalog.verifyDataSchema does not fully comply with

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

2024-02-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Summary: HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules (was:

[jira] [Created] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules

2024-02-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-47101: Summary: HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules Key: SPARK-47101 URL: https://issues.apache.org/jira/browse/SPARK-47101 Project:

[jira] [Resolved] (SPARK-47085) Preformance issue on thrift API

2024-02-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47085. -- Fix Version/s: 4.0.0 Resolution: Fixed resolved by https://github.com/apache/spark/pull/45155

[jira] [Assigned] (SPARK-47085) Preformance issue on thrift API

2024-02-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47085: Assignee: Izek Greenfield > Preformance issue on thrift API > --- >

[jira] [Updated] (SPARK-46170) Support inject adaptive query post planner strategy rules in SparkSessionExtensions

2024-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46170: - Fix Version/s: 3.5.1 > Support inject adaptive query post planner strategy rules in >

[jira] [Created] (SPARK-46982) Remove _LEGACY_ERROR_TEMP_2187 in favor of CANNOT_RECOGNIZE_HIVE_TYPE

2024-02-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-46982: Summary: Remove _LEGACY_ERROR_TEMP_2187 in favor of CANNOT_RECOGNIZE_HIVE_TYPE Key: SPARK-46982 URL: https://issues.apache.org/jira/browse/SPARK-46982 Project: Spark

[jira] [Resolved] (SPARK-46958) missing timezone to coerce default values

2024-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46958. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45000

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814588#comment-17814588 ] Kent Yao commented on SPARK-46934: -- Hi [~yutinglin], How can I create an element named

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

2024-02-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814166#comment-17814166 ] Kent Yao commented on SPARK-46934: -- I will fix this > Unable to create Hive View from certain Spark

[jira] [Created] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

2024-02-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-46974: Summary: Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values Key: SPARK-46974 URL: https://issues.apache.org/jira/browse/SPARK-46974 Project:

[jira] [Created] (SPARK-46972) Asymmetrical replacement for char/varchar in V2SessionCatalog.createTable

2024-02-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-46972: Summary: Asymmetrical replacement for char/varchar in V2SessionCatalog.createTable Key: SPARK-46972 URL: https://issues.apache.org/jira/browse/SPARK-46972 Project: Spark

[jira] [Updated] (SPARK-46958) FIx coerceDefaultValue when canUpCast

2024-02-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46958: - Affects Version/s: 3.5.0 > FIx coerceDefaultValue when canUpCast >

[jira] [Created] (SPARK-46958) FIx coerceDefaultValue when canUpCast

2024-02-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-46958: Summary: FIx coerceDefaultValue when canUpCast Key: SPARK-46958 URL: https://issues.apache.org/jira/browse/SPARK-46958 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

2024-02-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46949: Assignee: Kent Yao > Support CHAR/VARCHAR through ResolveDefaultColumns >

[jira] [Resolved] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

2024-02-02 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46949. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44991

[jira] [Resolved] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46953. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46953: Assignee: Kent Yao > Wrap withTable for a test in ResolveDefaultColumnsSuite >

[jira] [Created] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

2024-02-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-46953: Summary: Wrap withTable for a test in ResolveDefaultColumnsSuite Key: SPARK-46953 URL: https://issues.apache.org/jira/browse/SPARK-46953 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46945: - Fix Version/s: 3.5.1 3.4.3 > Add

[jira] [Resolved] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

2024-02-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46945. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44985

[jira] [Created] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

2024-02-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-46949: Summary: Support CHAR/VARCHAR through ResolveDefaultColumns Key: SPARK-46949 URL: https://issues.apache.org/jira/browse/SPARK-46949 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Fix Version/s: 3.5.1 3.4.3 > Too Many Shared Locks due to

[jira] [Resolved] (SPARK-46924) Fix `Load New` button in `Master/HistoryServer` Log UI

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46924. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44957

[jira] [Commented] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812341#comment-17812341 ] Kent Yao commented on SPARK-46747: -- according to the release policies of Spark,patches never get merged

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Target Version/s: (was: 2.0.0, 2.0.1, 2.0.2, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.2.0, 2.2.1, 2.2.2, 2.2.3,

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Priority: Major (was: Critical) > Too Many Shared Locks due to PostgresDialect.getTableExistsQuery -

[jira] [Resolved] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46747. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44948

[jira] [Assigned] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46747: Assignee: Kent Yao > Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[jira] [Updated] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46914: - Priority: Minor (was: Major) > Shorten app name in the summary table on the History Page >

[jira] [Commented] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812135#comment-17812135 ] Kent Yao commented on SPARK-46747: -- It would be better if you could provide the stats of # of shared

[jira] [Created] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-46914: Summary: Shorten app name in the summary table on the History Page Key: SPARK-46914 URL: https://issues.apache.org/jira/browse/SPARK-46914 Project: Spark Issue

[jira] [Created] (SPARK-46904) Fix wrong display of History UI summary

2024-01-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-46904: Summary: Fix wrong display of History UI summary Key: SPARK-46904 URL: https://issues.apache.org/jira/browse/SPARK-46904 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-46902: Summary: Fix Spark History Server UI Key: SPARK-46902 URL: https://issues.apache.org/jira/browse/SPARK-46902 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-46863) Clean up custom.css

2024-01-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46863. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44885

[jira] [Resolved] (SPARK-46829) Remove createExecutorEnv from SparkEnv

2024-01-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46829. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44870

[jira] [Assigned] (SPARK-46829) Remove createExecutorEnv from SparkEnv

2024-01-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46829: Assignee: xiaoping.huang > Remove createExecutorEnv from SparkEnv >

[jira] [Created] (SPARK-46828) Remove the invalid assertion of remote mode for spark sql shell

2024-01-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-46828: Summary: Remove the invalid assertion of remote mode for spark sql shell Key: SPARK-46828 URL: https://issues.apache.org/jira/browse/SPARK-46828 Project: Spark

[jira] [Created] (SPARK-46822) Respect spark.sql.legacy.charVarcharAsString when casting jdbc type to catalyst type in jdbc

2024-01-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-46822: Summary: Respect spark.sql.legacy.charVarcharAsString when casting jdbc type to catalyst type in jdbc Key: SPARK-46822 URL: https://issues.apache.org/jira/browse/SPARK-46822

[jira] [Resolved] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

2024-01-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-43403. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44851

[jira] [Assigned] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

2024-01-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-43403: Assignee: Zhou Yifan > GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is >

[jira] [Reopened] (SPARK-46417) do not fail when calling getTable and throwException is false

2024-01-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-46417: -- Assignee: (was: Wenchen Fan) Ok to be reverted by

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

2024-01-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46417: - Fix Version/s: (was: 4.0.0) (was: 3.5.1) (was: 3.4.3)

[jira] [Updated] (SPARK-46811) Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46811: - Summary: Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha') (was:

[jira] [Created] (SPARK-46811) Github ActionL: TypeError: Cannot read properties of undefined (reading 'head_sha')

2024-01-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-46811: Summary: Github ActionL: TypeError: Cannot read properties of undefined (reading 'head_sha') Key: SPARK-46811 URL: https://issues.apache.org/jira/browse/SPARK-46811

[jira] [Assigned] (SPARK-46789) Add `VolumeSuite` to K8s IT

2024-01-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46789: Assignee: Dongjoon Hyun > Add `VolumeSuite` to K8s IT > --- > >

[jira] [Resolved] (SPARK-46789) Add `VolumeSuite` to K8s IT

2024-01-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46789. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44827

[jira] [Updated] (SPARK-46788) Add instructions for running Docker integration tests

2024-01-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46788: - Priority: Minor (was: Major) > Add instructions for running Docker integration tests >

[jira] [Created] (SPARK-46788) Add instructions for running Docker integration tests

2024-01-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-46788: Summary: Add instructions for running Docker integration tests Key: SPARK-46788 URL: https://issues.apache.org/jira/browse/SPARK-46788 Project: Spark Issue Type:

[jira] [Created] (SPARK-46774) Do not use deprecated mapred.output.compress in Avro files

2024-01-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-46774: Summary: Do not use deprecated mapred.output.compress in Avro files Key: SPARK-46774 URL: https://issues.apache.org/jira/browse/SPARK-46774 Project: Spark Issue

[jira] [Created] (SPARK-46772) Benchmarking Avro with ZSTD

2024-01-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-46772: Summary: Benchmarking Avro with ZSTD Key: SPARK-46772 URL: https://issues.apache.org/jira/browse/SPARK-46772 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

2024-01-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46768. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44795

[jira] [Assigned] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

2024-01-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46768: Assignee: Yang Jie > Upgrade the Guava version used by the connect module to 33.0-jre >

[jira] [Created] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

2024-01-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-46766: Summary: ZSTD Buffer Pool Support For AVRO datasource Key: SPARK-46766 URL: https://issues.apache.org/jira/browse/SPARK-46766 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46759) Codec xz and zstandard support compression level for avro files

2024-01-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-46759: Summary: Codec xz and zstandard support compression level for avro files Key: SPARK-46759 URL: https://issues.apache.org/jira/browse/SPARK-46759 Project: Spark

[jira] [Resolved] (SPARK-46754) Fix compression code resolution in avro table definition

2024-01-18 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46754. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed resolved by  [GitHub Pull

[jira] [Resolved] (SPARK-46757) Reduce the number of layers of testing dockerfile

2024-01-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46757. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44781

[jira] [Assigned] (SPARK-46757) Reduce the number of layers of testing dockerfile

2024-01-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46757: Assignee: Ruifeng Zheng > Reduce the number of layers of testing dockerfile >

<    1   2   3   4   5   6   7   8   9   10   >