[jira] [Resolved] (SPARK-47205) Upgrade docker-java to 3.3.5

[ https://issues.apache.org/jira/browse/SPARK-47205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47205. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45307 [https://github.com

[jira] [Resolved] (SPARK-45200) Spark 3.4.0 always using default log4j profile

[ https://issues.apache.org/jira/browse/SPARK-45200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45200. -- Resolution: Not A Problem > Spark 3.4.0 always using default log4j profile > -

[jira] [Resolved] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

[ https://issues.apache.org/jira/browse/SPARK-46766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46766. -- Fix Version/s: 4.0.0 Resolution: Fixed resolved by https://github.com/apache/spark/pull/44792

[jira] [Assigned] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

[ https://issues.apache.org/jira/browse/SPARK-46766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46766: Assignee: Kent Yao > ZSTD Buffer Pool Support For AVRO datasource > -

[jira] [Created] (SPARK-47205) Upgrade docker-java to 3.3.5

Kent Yao created SPARK-47205: Summary: Upgrade docker-java to 3.3.5 Key: SPARK-47205 URL: https://issues.apache.org/jira/browse/SPARK-47205 Project: Spark Issue Type: Dependency upgrade

[jira] [Resolved] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47063. -- Fix Version/s: 3.4.3 3.5.2 4.0.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted

[ https://issues.apache.org/jira/browse/SPARK-47063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47063: Assignee: Pablo Langa Blanco > CAST long to timestamp has different behavior for codegen vs inter

[jira] [Resolved] (SPARK-47186) Improve the debuggability for docker integration test

[ https://issues.apache.org/jira/browse/SPARK-47186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47186. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45284 [https://github.com

[jira] [Created] (SPARK-47186) Improve the debuggability for docker integration test

Kent Yao created SPARK-47186: Summary: Improve the debuggability for docker integration test Key: SPARK-47186 URL: https://issues.apache.org/jira/browse/SPARK-47186 Project: Spark Issue Type: Tes

[jira] [Resolved] (SPARK-47166) Improve merge_spark_pr.py by emphasising input and error

[ https://issues.apache.org/jira/browse/SPARK-47166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47166. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45256 [https://github.com

[jira] [Resolved] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47175. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45265 [https://github.com

[jira] [Assigned] (SPARK-47175) Remove ZOOKEEPER-1844 comment from KafkaTestUtils

[ https://issues.apache.org/jira/browse/SPARK-47175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47175: Assignee: Dongjoon Hyun > Remove ZOOKEEPER-1844 comment from KafkaTestUtils > ---

[jira] [Assigned] (SPARK-47165) Pull docker image only when its' absent

[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47165: Assignee: Kent Yao > Pull docker image only when its' absent > --

[jira] [Resolved] (SPARK-47165) Pull docker image only when its' absent

[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47165. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45255 [https://github.com

[jira] [Updated] (SPARK-47165) Pull docker image only when its' absent

[ https://issues.apache.org/jira/browse/SPARK-47165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47165: - Issue Type: Test (was: Improvement) > Pull docker image only when its' absent > ---

[jira] [Created] (SPARK-47165) Pull docker image only when its' absent

Kent Yao created SPARK-47165: Summary: Pull docker image only when its' absent Key: SPARK-47165 URL: https://issues.apache.org/jira/browse/SPARK-47165 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47130: Assignee: Kent Yao > Use listStatus to bypass block location info when cleaning driver logs > ---

[jira] [Resolved] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47130. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45215 [https://github.com

[jira] [Created] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

Kent Yao created SPARK-47130: Summary: Use listStatus to bypass block location info when cleaning driver logs Key: SPARK-47130 URL: https://issues.apache.org/jira/browse/SPARK-47130 Project: Spark

[jira] [Updated] (SPARK-47117) Format the whole code base

[ https://issues.apache.org/jira/browse/SPARK-47117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47117: - Priority: Trivial (was: Major) > Format the whole code base > -- > >

[jira] [Updated] (SPARK-34631) Caught Hive MetaException when query by partition (partition col start with ‘$’)

[ https://issues.apache.org/jira/browse/SPARK-34631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34631: - Description: emphasized textcreate a table, set location as parquet, do msck repair table to get the da

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819232#comment-17819232 ] Kent Yao commented on SPARK-46934: -- Hi [~dongjoon], this is not a regression. As I com

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Issue Type: Improvement (was: Test) > HiveExternalCatalog.verifyDataSchema does not fully comply with h

[jira] [Updated] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules

[ https://issues.apache.org/jira/browse/SPARK-47101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47101: - Summary: HiveExternalCatalog.verifyDataSchema does not fully comply with hive column name rules (was: H

[jira] [Created] (SPARK-47101) HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules

Kent Yao created SPARK-47101: Summary: HiveExternalCatalog.verifyDataSchema does not fully comply hive column name rules Key: SPARK-47101 URL: https://issues.apache.org/jira/browse/SPARK-47101 Project: Sp

[jira] [Resolved] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47085. -- Fix Version/s: 4.0.0 Resolution: Fixed resolved by https://github.com/apache/spark/pull/45155

[jira] [Assigned] (SPARK-47085) Preformance issue on thrift API

[ https://issues.apache.org/jira/browse/SPARK-47085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47085: Assignee: Izek Greenfield > Preformance issue on thrift API > --- > >

[jira] [Updated] (SPARK-46170) Support inject adaptive query post planner strategy rules in SparkSessionExtensions

[ https://issues.apache.org/jira/browse/SPARK-46170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46170: - Fix Version/s: 3.5.1 > Support inject adaptive query post planner strategy rules in > SparkSessionExten

[jira] [Created] (SPARK-46982) Remove _LEGACY_ERROR_TEMP_2187 in favor of CANNOT_RECOGNIZE_HIVE_TYPE

Kent Yao created SPARK-46982: Summary: Remove _LEGACY_ERROR_TEMP_2187 in favor of CANNOT_RECOGNIZE_HIVE_TYPE Key: SPARK-46982 URL: https://issues.apache.org/jira/browse/SPARK-46982 Project: Spark

[jira] [Resolved] (SPARK-46958) missing timezone to coerce default values

[ https://issues.apache.org/jira/browse/SPARK-46958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46958. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45000 [https://github.com

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814588#comment-17814588 ] Kent Yao commented on SPARK-46934: -- Hi [~yutinglin], How can I create an element named

[jira] [Commented] (SPARK-46934) Unable to create Hive View from certain Spark Dataframe StructType

[ https://issues.apache.org/jira/browse/SPARK-46934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814166#comment-17814166 ] Kent Yao commented on SPARK-46934: -- I will fix this > Unable to create Hive View from

[jira] [Created] (SPARK-46974) Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values

Kent Yao created SPARK-46974: Summary: Recover a test case for day-of-year 2-letter 'DD' pattern parsing 3-digit values Key: SPARK-46974 URL: https://issues.apache.org/jira/browse/SPARK-46974 Project: Spa

[jira] [Created] (SPARK-46972) Asymmetrical replacement for char/varchar in V2SessionCatalog.createTable

Kent Yao created SPARK-46972: Summary: Asymmetrical replacement for char/varchar in V2SessionCatalog.createTable Key: SPARK-46972 URL: https://issues.apache.org/jira/browse/SPARK-46972 Project: Spark

[jira] [Updated] (SPARK-46958) FIx coerceDefaultValue when canUpCast

[ https://issues.apache.org/jira/browse/SPARK-46958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46958: - Affects Version/s: 3.5.0 > FIx coerceDefaultValue when canUpCast > -

[jira] [Created] (SPARK-46958) FIx coerceDefaultValue when canUpCast

Kent Yao created SPARK-46958: Summary: FIx coerceDefaultValue when canUpCast Key: SPARK-46958 URL: https://issues.apache.org/jira/browse/SPARK-46958 Project: Spark Issue Type: Bug Compo

[jira] [Assigned] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

[ https://issues.apache.org/jira/browse/SPARK-46949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46949: Assignee: Kent Yao > Support CHAR/VARCHAR through ResolveDefaultColumns > --

[jira] [Resolved] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

[ https://issues.apache.org/jira/browse/SPARK-46949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46949. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44991 [https://github.com

[jira] [Resolved] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

[ https://issues.apache.org/jira/browse/SPARK-46953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46953. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

[ https://issues.apache.org/jira/browse/SPARK-46953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46953: Assignee: Kent Yao > Wrap withTable for a test in ResolveDefaultColumnsSuite > --

[jira] [Created] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite

Kent Yao created SPARK-46953: Summary: Wrap withTable for a test in ResolveDefaultColumnsSuite Key: SPARK-46953 URL: https://issues.apache.org/jira/browse/SPARK-46953 Project: Spark Issue Type: T

[jira] [Updated] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46945: - Fix Version/s: 3.5.1 3.4.3 > Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode`

[jira] [Resolved] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters

[ https://issues.apache.org/jira/browse/SPARK-46945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46945. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44985 [https://github.com

[jira] [Created] (SPARK-46949) Support CHAR/VARCHAR through ResolveDefaultColumns

Kent Yao created SPARK-46949: Summary: Support CHAR/VARCHAR through ResolveDefaultColumns Key: SPARK-46949 URL: https://issues.apache.org/jira/browse/SPARK-46949 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Fix Version/s: 3.5.1 3.4.3 > Too Many Shared Locks due to PostgresDialect.getTableExi

[jira] [Resolved] (SPARK-46924) Fix `Load New` button in `Master/HistoryServer` Log UI

[ https://issues.apache.org/jira/browse/SPARK-46924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46924. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44957 [https://github.com

[jira] [Commented] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812341#comment-17812341 ] Kent Yao commented on SPARK-46747: -- according to the release policies of Spark，patches

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Target Version/s: (was: 2.0.0, 2.0.1, 2.0.2, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.2.0, 2.2.1, 2.2.2, 2.2.3, 2

[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46747: - Priority: Major (was: Critical) > Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LI

[jira] [Resolved] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46747. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44948 [https://github.com

[jira] [Assigned] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46747: Assignee: Kent Yao > Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1 >

[jira] [Updated] (SPARK-46914) Shorten app name in the summary table on the History Page

[ https://issues.apache.org/jira/browse/SPARK-46914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46914: - Priority: Minor (was: Major) > Shorten app name in the summary table on the History Page > ---

[jira] [Commented] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812135#comment-17812135 ] Kent Yao commented on SPARK-46747: -- It would be better if you could provide the stats o

[jira] [Created] (SPARK-46914) Shorten app name in the summary table on the History Page

Kent Yao created SPARK-46914: Summary: Shorten app name in the summary table on the History Page Key: SPARK-46914 URL: https://issues.apache.org/jira/browse/SPARK-46914 Project: Spark Issue Type

[jira] [Created] (SPARK-46904) Fix wrong display of History UI summary

Kent Yao created SPARK-46904: Summary: Fix wrong display of History UI summary Key: SPARK-46904 URL: https://issues.apache.org/jira/browse/SPARK-46904 Project: Spark Issue Type: Bug C

[jira] [Created] (SPARK-46902) Fix Spark History Server UI

Kent Yao created SPARK-46902: Summary: Fix Spark History Server UI Key: SPARK-46902 URL: https://issues.apache.org/jira/browse/SPARK-46902 Project: Spark Issue Type: Sub-task Component

[jira] [Resolved] (SPARK-46863) Clean up custom.css

[ https://issues.apache.org/jira/browse/SPARK-46863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46863. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44885 [https://github.com

[jira] [Resolved] (SPARK-46829) Remove createExecutorEnv from SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46829. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44870 [https://github.com

[jira] [Assigned] (SPARK-46829) Remove createExecutorEnv from SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46829: Assignee: xiaoping.huang > Remove createExecutorEnv from SparkEnv > -

[jira] [Created] (SPARK-46828) Remove the invalid assertion of remote mode for spark sql shell

Kent Yao created SPARK-46828: Summary: Remove the invalid assertion of remote mode for spark sql shell Key: SPARK-46828 URL: https://issues.apache.org/jira/browse/SPARK-46828 Project: Spark Iss

[jira] [Created] (SPARK-46822) Respect spark.sql.legacy.charVarcharAsString when casting jdbc type to catalyst type in jdbc

Kent Yao created SPARK-46822: Summary: Respect spark.sql.legacy.charVarcharAsString when casting jdbc type to catalyst type in jdbc Key: SPARK-46822 URL: https://issues.apache.org/jira/browse/SPARK-46822

[jira] [Resolved] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

[ https://issues.apache.org/jira/browse/SPARK-43403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-43403. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44851 [https://github.com

[jira] [Assigned] (SPARK-43403) GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is closed

[ https://issues.apache.org/jira/browse/SPARK-43403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-43403: Assignee: Zhou Yifan > GET /history//1/jobs/ failed: java.lang.IllegalStateException: DB is > cl

[jira] [Reopened] (SPARK-46417) do not fail when calling getTable and throwException is false

[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reopened SPARK-46417: -- Assignee: (was: Wenchen Fan) Ok to be reverted by [2aed25b|https://github.com/apache/spark/comm

[jira] [Updated] (SPARK-46417) do not fail when calling getTable and throwException is false

[ https://issues.apache.org/jira/browse/SPARK-46417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46417: - Fix Version/s: (was: 4.0.0) (was: 3.5.1) (was: 3.4.3)

[jira] [Updated] (SPARK-46811) Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha')

[ https://issues.apache.org/jira/browse/SPARK-46811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46811: - Summary: Github Action: TypeError: Cannot read properties of undefined (reading 'head_sha') (was: Gith

[jira] [Created] (SPARK-46811) Github ActionL: TypeError: Cannot read properties of undefined (reading 'head_sha')

Kent Yao created SPARK-46811: Summary: Github ActionL: TypeError: Cannot read properties of undefined (reading 'head_sha') Key: SPARK-46811 URL: https://issues.apache.org/jira/browse/SPARK-46811 Project:

[jira] [Assigned] (SPARK-46789) Add `VolumeSuite` to K8s IT

[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46789: Assignee: Dongjoon Hyun > Add `VolumeSuite` to K8s IT > --- > >

[jira] [Resolved] (SPARK-46789) Add `VolumeSuite` to K8s IT

[ https://issues.apache.org/jira/browse/SPARK-46789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46789. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44827 [https://github.com

[jira] [Updated] (SPARK-46788) Add instructions for running Docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-46788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46788: - Priority: Minor (was: Major) > Add instructions for running Docker integration tests >

[jira] [Created] (SPARK-46788) Add instructions for running Docker integration tests

Kent Yao created SPARK-46788: Summary: Add instructions for running Docker integration tests Key: SPARK-46788 URL: https://issues.apache.org/jira/browse/SPARK-46788 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-46774) Do not use deprecated mapred.output.compress in Avro files

Kent Yao created SPARK-46774: Summary: Do not use deprecated mapred.output.compress in Avro files Key: SPARK-46774 URL: https://issues.apache.org/jira/browse/SPARK-46774 Project: Spark Issue Type

[jira] [Created] (SPARK-46772) Benchmarking Avro with ZSTD

Kent Yao created SPARK-46772: Summary: Benchmarking Avro with ZSTD Key: SPARK-46772 URL: https://issues.apache.org/jira/browse/SPARK-46772 Project: Spark Issue Type: Improvement Compon

[jira] [Resolved] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

[ https://issues.apache.org/jira/browse/SPARK-46768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46768. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44795 [https://github.com

[jira] [Assigned] (SPARK-46768) Upgrade the Guava version used by the connect module to 33.0-jre

[ https://issues.apache.org/jira/browse/SPARK-46768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46768: Assignee: Yang Jie > Upgrade the Guava version used by the connect module to 33.0-jre > -

[jira] [Created] (SPARK-46766) ZSTD Buffer Pool Support For AVRO datasource

Kent Yao created SPARK-46766: Summary: ZSTD Buffer Pool Support For AVRO datasource Key: SPARK-46766 URL: https://issues.apache.org/jira/browse/SPARK-46766 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46759) Codec xz and zstandard support compression level for avro files

Kent Yao created SPARK-46759: Summary: Codec xz and zstandard support compression level for avro files Key: SPARK-46759 URL: https://issues.apache.org/jira/browse/SPARK-46759 Project: Spark Issu

[jira] [Resolved] (SPARK-46754) Fix compression code resolution in avro table definition

[ https://issues.apache.org/jira/browse/SPARK-46754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46754. -- Fix Version/s: 4.0.0 Assignee: Kent Yao Resolution: Fixed resolved by  [GitHub Pull Re

[jira] [Resolved] (SPARK-46757) Reduce the number of layers of testing dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46757. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44781 [https://github.com

[jira] [Assigned] (SPARK-46757) Reduce the number of layers of testing dockerfile

[ https://issues.apache.org/jira/browse/SPARK-46757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46757: Assignee: Ruifeng Zheng > Reduce the number of layers of testing dockerfile > ---

[jira] [Created] (SPARK-46754) Fix compression code resolution in avro table definition

Kent Yao created SPARK-46754: Summary: Fix compression code resolution in avro table definition Key: SPARK-46754 URL: https://issues.apache.org/jira/browse/SPARK-46754 Project: Spark Issue Type:

[jira] [Created] (SPARK-46746) Attach codec extension to avro datasource files

Kent Yao created SPARK-46746: Summary: Attach codec extension to avro datasource files Key: SPARK-46746 URL: https://issues.apache.org/jira/browse/SPARK-46746 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-46612) Clickhouse's JDBC throws `java.lang.IllegalArgumentException: Unknown data type: string` when write array string with Apache Spark scala

[ https://issues.apache.org/jira/browse/SPARK-46612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46612: Assignee: Nguyen Phan Huy > Clickhouse's JDBC throws `java.lang.IllegalArgumentException: Unknown

[jira] [Resolved] (SPARK-46612) Clickhouse's JDBC throws `java.lang.IllegalArgumentException: Unknown data type: string` when write array string with Apache Spark scala

[ https://issues.apache.org/jira/browse/SPARK-46612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46612. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44459 [https://github.com

[jira] [Resolved] (SPARK-46729) Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector

[ https://issues.apache.org/jira/browse/SPARK-46729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46729. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44746 [https://github.com

[jira] [Assigned] (SPARK-46729) Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector

[ https://issues.apache.org/jira/browse/SPARK-46729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46729: Assignee: Kent Yao > Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage >

[jira] [Created] (SPARK-46729) Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector

Kent Yao created SPARK-46729: Summary: Withdraw the recommendation of using Concurrent Mark Sweep (CMS) Garbage Collector Key: SPARK-46729 URL: https://issues.apache.org/jira/browse/SPARK-46729 Project: S

[jira] [Created] (SPARK-46724) Update tuning.md to use java 17 docs

Kent Yao created SPARK-46724: Summary: Update tuning.md to use java 17 docs Key: SPARK-46724 URL: https://issues.apache.org/jira/browse/SPARK-46724 Project: Spark Issue Type: Sub-task C

[jira] [Assigned] (SPARK-46694) Drop the assumptions of 'hive version < 2.0' in Hive version related tests

[ https://issues.apache.org/jira/browse/SPARK-46694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46694: Assignee: Kent Yao > Drop the assumptions of 'hive version < 2.0' in Hive version related tests >

[jira] [Resolved] (SPARK-46694) Drop the assumptions of 'hive version < 2.0' in Hive version related tests

[ https://issues.apache.org/jira/browse/SPARK-46694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46694. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44700 [https://github.com

[jira] [Created] (SPARK-46694) Drop the assumptions of 'hive version < 2.0' in Hive version related tests

Kent Yao created SPARK-46694: Summary: Drop the assumptions of 'hive version < 2.0' in Hive version related tests Key: SPARK-46694 URL: https://issues.apache.org/jira/browse/SPARK-46694 Project: Spark

[jira] [Resolved] (SPARK-46588) Interrupt when executing ANALYSIS phase

[ https://issues.apache.org/jira/browse/SPARK-46588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46588. -- Resolution: Information Provided Jira is not a suitable place for questions, you'd better use the user

[jira] [Commented] (SPARK-46588) Interrupt when executing ANALYSIS phase

[ https://issues.apache.org/jira/browse/SPARK-46588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805873#comment-17805873 ] Kent Yao commented on SPARK-46588: -- You can call sc.setInterruptOnCancel(true) to inter

[jira] [Resolved] (SPARK-46650) Replace AtomicBoolean with volatile boolean

[ https://issues.apache.org/jira/browse/SPARK-46650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46650. -- Resolution: Not A Problem > Replace AtomicBoolean with volatile boolean >

[jira] [Commented] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar

[ https://issues.apache.org/jira/browse/SPARK-44638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805505#comment-17805505 ] Kent Yao commented on SPARK-44638: -- Can you reproduce this issue on 3.5.0 or master bra

[jira] [Created] (SPARK-46678) Set datanucleus.autoStartMechanismMode=ignored to clean the wall of noisy logs

Kent Yao created SPARK-46678: Summary: Set datanucleus.autoStartMechanismMode=ignored to clean the wall of noisy logs Key: SPARK-46678 URL: https://issues.apache.org/jira/browse/SPARK-46678 Project: Spark

[jira] [Updated] (SPARK-46674) Remove the Hive Index methods in HiveShim

[ https://issues.apache.org/jira/browse/SPARK-46674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46674: - Summary: Remove the Hive Index methods in HiveShim (was: Remove the Hive Index methods) > Remove the H

[jira] [Created] (SPARK-46674) Remove the Hive Index methods

Kent Yao created SPARK-46674: Summary: Remove the Hive Index methods Key: SPARK-46674 URL: https://issues.apache.org/jira/browse/SPARK-46674 Project: Spark Issue Type: Improvement Compo

[jira] [Assigned] (SPARK-46575) Make HiveThriftServer2.startWithContext DevelopApi retriable

[ https://issues.apache.org/jira/browse/SPARK-46575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46575: Assignee: Kent Yao > Make HiveThriftServer2.startWithContext DevelopApi retriable > -

[jira] [Resolved] (SPARK-46575) Make HiveThriftServer2.startWithContext DevelopApi retriable

[ https://issues.apache.org/jira/browse/SPARK-46575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46575. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44575 [https://github.com

<    1   2   3   4   5   6   7   8   9   10   >