[jira] [Assigned] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37452: Assignee: Kent Yao > Char and Varchar breaks backward compatibility between v3 and v2 >

[jira] [Updated] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

2021-11-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37481: - Description: # ## With FetchFailedException and Map Stage Retries When rerunning spark-sql shell

[jira] [Created] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting

2021-11-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-37481: Summary: Disappearance of skipped stages mislead the bug hunting Key: SPARK-37481 URL: https://issues.apache.org/jira/browse/SPARK-37481 Project: Spark Issue Type:

[jira] [Created] (SPARK-37452) Char and Varchar breaks backward compatibility between v3 and v2

2021-11-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-37452: Summary: Char and Varchar breaks backward compatibility between v3 and v2 Key: SPARK-37452 URL: https://issues.apache.org/jira/browse/SPARK-37452 Project: Spark

[jira] [Created] (SPARK-37215) Support Application Timeouts on YARN

2021-11-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-37215: Summary: Support Application Timeouts on YARN Key: SPARK-37215 URL: https://issues.apache.org/jira/browse/SPARK-37215 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-37098: - Fix Version/s: (was: 3.1.3) > Alter table properties should invalidate cache >

[jira] [Commented] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433614#comment-17433614 ] Kent Yao commented on SPARK-37098: -- Issuse resolved by [https://github.com/apache/spark/pull/34365] >

[jira] [Resolved] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-37098. -- Fix Version/s: 3.3.0 3.2.1 3.1.3 Resolution: Fixed >

[jira] [Assigned] (SPARK-37098) Alter table properties should invalidate cache

2021-10-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-37098: Assignee: XiDuo You > Alter table properties should invalidate cache >

[jira] [Resolved] (SPARK-36659) Promote spark.sql.execution.topKSortFallbackThreshold to user-faced config

2021-09-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-36659. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33904

[jira] [Assigned] (SPARK-36659) Promote spark.sql.execution.topKSortFallbackThreshold to user-faced config

2021-09-03 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-36659: Assignee: Kent Yao > Promote spark.sql.execution.topKSortFallbackThreshold to user-faced config

[jira] [Created] (SPARK-36662) special timestamps values support for path filters - modifiedBefore/modifiedAfter

2021-09-03 Thread Kent Yao (Jira)
Kent Yao created SPARK-36662: Summary: special timestamps values support for path filters - modifiedBefore/modifiedAfter Key: SPARK-36662 URL: https://issues.apache.org/jira/browse/SPARK-36662 Project:

[jira] [Created] (SPARK-36659) Promote spark.sql.execution.topKSortFallbackThreshold to user-faced config

2021-09-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-36659: Summary: Promote spark.sql.execution.topKSortFallbackThreshold to user-faced config Key: SPARK-36659 URL: https://issues.apache.org/jira/browse/SPARK-36659 Project: Spark

[jira] [Created] (SPARK-36634) Support access and read parquet file by column index

2021-09-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-36634: Summary: Support access and read parquet file by column index Key: SPARK-36634 URL: https://issues.apache.org/jira/browse/SPARK-36634 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36611) Remove unused listener in HiveThriftServer2AppStatusStore

2021-08-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407054#comment-17407054 ] Kent Yao commented on SPARK-36611: -- issue resolved by https://github.com/apache/spark/pull/33866 >

[jira] [Resolved] (SPARK-36611) Remove unused listener in HiveThriftServer2AppStatusStore

2021-08-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-36611. -- Fix Version/s: 3.3.0 Resolution: Fixed > Remove unused listener in

[jira] [Created] (SPARK-36477) Infering schema from JSON file shall respect ignoreCorruptFiles and handle IOE

2021-08-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-36477: Summary: Infering schema from JSON file shall respect ignoreCorruptFiles and handle IOE Key: SPARK-36477 URL: https://issues.apache.org/jira/browse/SPARK-36477 Project:

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Description:   h2. A test case Use bin/spark-sql with local mode and all other default settings with

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Description:   h2. A test case Use bin/spark-sql with local mode and all other default settings with

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Attachment: image-2021-08-06-17-57-15-765.png > Demote BroadcastJoin causes performance regression and

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Attachment: screenshot-1.png > Demote BroadcastJoin causes performance regression and increases OOM

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Description:     !image-2021-08-06-11-24-34-122.png! was:   !image-2021-08-06-11-24-34-122.png!

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Description:   !image-2021-08-06-11-24-34-122.png! was:!image-2021-08-06-11-24-34-122.png! >

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Attachment: image-2021-08-06-11-24-34-122.png > Demote BroadcastJoin causes performance regression and

[jira] [Updated] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36443: - Description: !image-2021-08-06-11-24-34-122.png! (was: !image-2021-08-06-11-19-00-105.png!) > Demote

[jira] [Created] (SPARK-36443) Demote BroadcastJoin causes performance regression and increases OOM risks

2021-08-05 Thread Kent Yao (Jira)
Kent Yao created SPARK-36443: Summary: Demote BroadcastJoin causes performance regression and increases OOM risks Key: SPARK-36443 URL: https://issues.apache.org/jira/browse/SPARK-36443 Project: Spark

[jira] [Created] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

2021-08-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-36421: Summary: Validate all SQL configs to prevent from wrong use for ConfigEntry Key: SPARK-36421 URL: https://issues.apache.org/jira/browse/SPARK-36421 Project: Spark

[jira] [Updated] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

2021-08-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36421: - Issue Type: Bug (was: Improvement) > Validate all SQL configs to prevent from wrong use for

[jira] [Updated] (SPARK-36421) Validate all SQL configs to prevent from wrong use for ConfigEntry

2021-08-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36421: - Priority: Minor (was: Major) > Validate all SQL configs to prevent from wrong use for ConfigEntry >

[jira] [Updated] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

2021-08-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36414: - Description: This reverts SPARK-31475, as there are always more concurrent jobs running in AQE mode,

[jira] [Created] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

2021-08-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-36414: Summary: Disable timeout for BroadcastQueryStageExec in AQE Key: SPARK-36414 URL: https://issues.apache.org/jira/browse/SPARK-36414 Project: Spark Issue Type:

[jira] [Updated] (SPARK-36414) Disable timeout for BroadcastQueryStageExec in AQE

2021-08-04 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36414: - Attachment: image-2021-08-04-18-53-44-879.png > Disable timeout for BroadcastQueryStageExec in AQE >

[jira] [Resolved] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

2021-07-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-36213. -- Fix Version/s: 3.1.3 3.2.0 3.0.4 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

2021-07-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-36213: Assignee: Kent Yao > Normalize PartitionSpec for DescTable with PartitionSpec >

[jira] [Updated] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

2021-07-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36213: - Description: !image-2021-07-20-16-26-09-456.png! (was: !image-2021-07-20-01-03-49-573.png!) >

[jira] [Updated] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

2021-07-20 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36213: - Attachment: image-2021-07-20-16-26-09-456.png > Normalize PartitionSpec for DescTable with

[jira] [Created] (SPARK-36213) Normalize PartitionSpec for DescTable with PartitionSpec

2021-07-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-36213: Summary: Normalize PartitionSpec for DescTable with PartitionSpec Key: SPARK-36213 URL: https://issues.apache.org/jira/browse/SPARK-36213 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-36197) InputFormat of PartitionDesc is not respected

2021-07-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-36197. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33406

[jira] [Assigned] (SPARK-36197) InputFormat of PartitionDesc is not respected

2021-07-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-36197: Assignee: Kent Yao > InputFormat of PartitionDesc is not respected >

[jira] [Created] (SPARK-36197) InputFormat of PartitionDesc is not respected

2021-07-18 Thread Kent Yao (Jira)
Kent Yao created SPARK-36197: Summary: InputFormat of PartitionDesc is not respected Key: SPARK-36197 URL: https://issues.apache.org/jira/browse/SPARK-36197 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-36180) HMS can not recognize timestamp_ntz

2021-07-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-36180: Summary: HMS can not recognize timestamp_ntz Key: SPARK-36180 URL: https://issues.apache.org/jira/browse/SPARK-36180 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36179) Support TimestampNTZType in SparkGetColumnsOperation

2021-07-16 Thread Kent Yao (Jira)
Kent Yao created SPARK-36179: Summary: Support TimestampNTZType in SparkGetColumnsOperation Key: SPARK-36179 URL: https://issues.apache.org/jira/browse/SPARK-36179 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36070) Add time cost info for writing rows out and committing the task.

2021-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-36070: Assignee: Kent Yao > Add time cost info for writing rows out and committing the task. >

[jira] [Resolved] (SPARK-36070) Add time cost info for writing rows out and committing the task.

2021-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-36070. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33279

[jira] [Updated] (SPARK-36070) Add time cost info for writing rows out and committing the task.

2021-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-36070: - Description: We have a job that has a stage that contains about 8k tasks.  Most tasks take about

[jira] [Created] (SPARK-36070) Add time cost info for writing rows out and committing the task.

2021-07-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-36070: Summary: Add time cost info for writing rows out and committing the task. Key: SPARK-36070 URL: https://issues.apache.org/jira/browse/SPARK-36070 Project: Spark

[jira] [Resolved] (SPARK-35966) Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

2021-07-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35966. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33169

[jira] [Assigned] (SPARK-35966) Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

2021-07-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35966: Assignee: Kent Yao > Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings >

[jira] [Created] (SPARK-35969) Make the pod prefix more readable and tallied with K8S DNS Label Names

2021-07-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-35969: Summary: Make the pod prefix more readable and tallied with K8S DNS Label Names Key: SPARK-35969 URL: https://issues.apache.org/jira/browse/SPARK-35969 Project: Spark

[jira] [Created] (SPARK-35966) Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings

2021-07-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-35966: Summary: Port HIVE-17952: Fix license headers to avoid dangling javadoc warnings Key: SPARK-35966 URL: https://issues.apache.org/jira/browse/SPARK-35966 Project: Spark

[jira] [Resolved] (SPARK-33898) Support SHOW CREATE TABLE in v2

2021-06-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-33898. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32931

[jira] [Assigned] (SPARK-33898) Support SHOW CREATE TABLE in v2

2021-06-28 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-33898: Assignee: PengLei > Support SHOW CREATE TABLE in v2 > --- > >

[jira] [Created] (SPARK-35910) Update remoteBlockBytes based on merged block info

2021-06-27 Thread Kent Yao (Jira)
Kent Yao created SPARK-35910: Summary: Update remoteBlockBytes based on merged block info Key: SPARK-35910 URL: https://issues.apache.org/jira/browse/SPARK-35910 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35879) Fix performance regression caused by collectFetchRequests

2021-06-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35879. -- Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-35879) Fix performance regression caused by collectFetchRequests

2021-06-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35879: Assignee: Kent Yao > Fix performance regression caused by collectFetchRequests >

[jira] [Created] (SPARK-35879) Fix performance regression caused by collectFetchRequests

2021-06-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-35879: Summary: Fix performance regression caused by collectFetchRequests Key: SPARK-35879 URL: https://issues.apache.org/jira/browse/SPARK-35879 Project: Spark Issue

[jira] [Created] (SPARK-35828) Should skip retrieving driver pod in client mode

2021-06-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-35828: Summary: Should skip retrieving driver pod in client mode Key: SPARK-35828 URL: https://issues.apache.org/jira/browse/SPARK-35828 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

2021-06-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35675. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32815

[jira] [Assigned] (SPARK-35675) EnsureRequirements remove shuffle should respect PartitioningCollection

2021-06-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35675: Assignee: XiDuo You > EnsureRequirements remove shuffle should respect PartitioningCollection >

[jira] [Created] (SPARK-35692) Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes

2021-06-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-35692: Summary: Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes Key: SPARK-35692 URL: https://issues.apache.org/jira/browse/SPARK-35692 Project: Spark Issue

[jira] [Created] (SPARK-35677) Support dynamic executor range for dynamic allocation

2021-06-08 Thread Kent Yao (Jira)
Kent Yao created SPARK-35677: Summary: Support dynamic executor range for dynamic allocation Key: SPARK-35677 URL: https://issues.apache.org/jira/browse/SPARK-35677 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35402) Increase the max thread pool size of jetty server in HistoryServer UI

2021-06-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35402: Assignee: Kent Yao > Increase the max thread pool size of jetty server in HistoryServer UI >

[jira] [Resolved] (SPARK-35402) Increase the max thread pool size of jetty server in HistoryServer UI

2021-06-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35402. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32539

[jira] [Updated] (SPARK-35402) Increase the max thread pool size of jetty server in HistoryServer UI

2021-06-01 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-35402: - Summary: Increase the max thread pool size of jetty server in HistoryServer UI (was: Make thread pool

[jira] [Comment Edited] (SPARK-33898) Support SHOW CREATE TABLE in v2

2021-05-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353687#comment-17353687 ] Kent Yao edited comment on SPARK-33898 at 5/29/21, 7:43 AM: are you

[jira] [Commented] (SPARK-33898) Support SHOW CREATE TABLE in v2

2021-05-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17353687#comment-17353687 ] Kent Yao commented on SPARK-33898: -- are you interested in this [~penglei] > Support SHOW CREATE TABLE

[jira] [Created] (SPARK-35493) spark.blockManager.port does not work for driver pod

2021-05-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-35493: Summary: spark.blockManager.port does not work for driver pod Key: SPARK-35493 URL: https://issues.apache.org/jira/browse/SPARK-35493 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-35482) case sensitive block manager port key should be used in BasicExecutorFeatureStep

2021-05-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-35482: Summary: case sensitive block manager port key should be used in BasicExecutorFeatureStep Key: SPARK-35482 URL: https://issues.apache.org/jira/browse/SPARK-35482 Project:

[jira] [Created] (SPARK-35460) invalid `spark.kubernetes.executor.podNamePrefix` causes app to hang

2021-05-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-35460: Summary: invalid `spark.kubernetes.executor.podNamePrefix` causes app to hang Key: SPARK-35460 URL: https://issues.apache.org/jira/browse/SPARK-35460 Project: Spark

[jira] [Created] (SPARK-35456) Show invalid value in config entry check error message

2021-05-19 Thread Kent Yao (Jira)
Kent Yao created SPARK-35456: Summary: Show invalid value in config entry check error message Key: SPARK-35456 URL: https://issues.apache.org/jira/browse/SPARK-35456 Project: Spark Issue Type:

[jira] [Created] (SPARK-35404) Name the timers in TaskSchedulerImpl

2021-05-14 Thread Kent Yao (Jira)
Kent Yao created SPARK-35404: Summary: Name the timers in TaskSchedulerImpl Key: SPARK-35404 URL: https://issues.apache.org/jira/browse/SPARK-35404 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-35402) Make thread pool of jetty server in Web UIs configurable

2021-05-13 Thread Kent Yao (Jira)
Kent Yao created SPARK-35402: Summary: Make thread pool of jetty server in Web UIs configurable Key: SPARK-35402 URL: https://issues.apache.org/jira/browse/SPARK-35402 Project: Spark Issue

[jira] [Assigned] (SPARK-35380) Support loading SparkSessionExtensions from ServiceLoader

2021-05-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35380: Assignee: Kent Yao > Support loading SparkSessionExtensions from ServiceLoader >

[jira] [Resolved] (SPARK-35380) Support loading SparkSessionExtensions from ServiceLoader

2021-05-13 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35380. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32515

[jira] [Created] (SPARK-35380) Support loading SparkSessionExtensions from ServiceLoader

2021-05-11 Thread Kent Yao (Jira)
Kent Yao created SPARK-35380: Summary: Support loading SparkSessionExtensions from ServiceLoader Key: SPARK-35380 URL: https://issues.apache.org/jira/browse/SPARK-35380 Project: Spark Issue

[jira] [Updated] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

2021-05-06 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-35331: - Summary: Attributes become unknown in RepartitionByExpression after aliased (was: Attributes become

[jira] [Created] (SPARK-35331) Attributes become unknown for RepartitionByExpression after aliased

2021-05-06 Thread Kent Yao (Jira)
Kent Yao created SPARK-35331: Summary: Attributes become unknown for RepartitionByExpression after aliased Key: SPARK-35331 URL: https://issues.apache.org/jira/browse/SPARK-35331 Project: Spark

[jira] [Assigned] (SPARK-35223) Add IssueNavigationLink for IDEA

2021-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35223: Assignee: Cheng Pan > Add IssueNavigationLink for IDEA > > >

[jira] [Resolved] (SPARK-35223) Add IssueNavigationLink for IDEA

2021-04-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35223. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32337

[jira] [Resolved] (SPARK-35168) mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum

2021-04-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35168. -- Fix Version/s: 3.0.3 3.1.2 3.2.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-35168) mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum

2021-04-25 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35168: Assignee: Kent Yao > mapred.reduce.tasks should be shuffle.partitions not >

[jira] [Commented] (SPARK-35168) mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum

2021-04-23 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331132#comment-17331132 ] Kent Yao commented on SPARK-35168: -- Thanks [~dongjoon] > mapred.reduce.tasks should be

[jira] [Commented] (SPARK-35090) Extract a field from ANSI interval

2021-04-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17328043#comment-17328043 ] Kent Yao commented on SPARK-35090: -- yes. thanks > Extract a field from ANSI interval >

[jira] [Commented] (SPARK-35091) Support ANSI intervals by date_part()

2021-04-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17328019#comment-17328019 ] Kent Yao commented on SPARK-35091: -- thanks [~maxgekk] for pinging me. I will take it. > Support ANSI

[jira] [Updated] (SPARK-35168) mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum

2021-04-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-35168: - Priority: Minor (was: Major) > mapred.reduce.tasks should be shuffle.partitions not >

[jira] [Created] (SPARK-35168) mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum

2021-04-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-35168: Summary: mapred.reduce.tasks should be shuffle.partitions not adaptive.coalescePartitions.initialPartitionNum Key: SPARK-35168 URL: https://issues.apache.org/jira/browse/SPARK-35168

[jira] [Created] (SPARK-35102) Make spark.sql.hive.version meaningful and not deprecated

2021-04-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-35102: Summary: Make spark.sql.hive.version meaningful and not deprecated Key: SPARK-35102 URL: https://issues.apache.org/jira/browse/SPARK-35102 Project: Spark Issue

[jira] [Assigned] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

2021-04-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-35044: Assignee: Kent Yao > Support retrieve hadoop configurations via SET syntax >

[jira] [Resolved] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

2021-04-14 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35044. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32144

[jira] [Created] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

2021-04-12 Thread Kent Yao (Jira)
Kent Yao created SPARK-35044: Summary: Support retrieve hadoop configurations via SET syntax Key: SPARK-35044 URL: https://issues.apache.org/jira/browse/SPARK-35044 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-34944) Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34944: Assignee: Kent Yao > Employ correct data type for web_returns and store_returns in TPCDS tests >

[jira] [Resolved] (SPARK-34944) Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-12 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34944. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32037

[jira] [Created] (SPARK-34944) Employ correct data type for web_returns and store_returns in TPCDS tests

2021-04-02 Thread Kent Yao (Jira)
Kent Yao created SPARK-34944: Summary: Employ correct data type for web_returns and store_returns in TPCDS tests Key: SPARK-34944 URL: https://issues.apache.org/jira/browse/SPARK-34944 Project: Spark

[jira] [Created] (SPARK-34935) CREATE TABLE LIKE should respect the reserved properties of tables

2021-04-01 Thread Kent Yao (Jira)
Kent Yao created SPARK-34935: Summary: CREATE TABLE LIKE should respect the reserved properties of tables Key: SPARK-34935 URL: https://issues.apache.org/jira/browse/SPARK-34935 Project: Spark

[jira] [Updated] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-34908: - Priority: Minor (was: Major) > Add test cases for char and varchar with functions >

[jira] [Created] (SPARK-34908) Add test cases for char and varchar with functions

2021-03-30 Thread Kent Yao (Jira)
Kent Yao created SPARK-34908: Summary: Add test cases for char and varchar with functions Key: SPARK-34908 URL: https://issues.apache.org/jira/browse/SPARK-34908 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34894: Assignee: Kent Yao > Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout` >

[jira] [Resolved] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34894. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31990

[jira] [Created] (SPARK-34894) Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout`

2021-03-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-34894: Summary: Use 'io.connectionTimeout' as a hint instead of `spark.network.timeout` Key: SPARK-34894 URL: https://issues.apache.org/jira/browse/SPARK-34894 Project: Spark

[jira] [Assigned] (SPARK-34744) Improve error message for casting cause overflow error

2021-03-26 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34744: Assignee: angerszhu (was: Apache Spark) > Improve error message for casting cause overflow

<    4   5   6   7   8   9   10   11   12   13   >