[jira] [Updated] (SPARK-48340) Support TimestampNTZ infer schema miss prefer_timestamp_ntz

2024-05-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48340: -- Attachment: image-2024-05-20-18-38-39-769.png > Support TimestampNTZ infer schema miss

[jira] [Created] (SPARK-48340) Support TimestampNTZ infer schema miss prefer_timestamp_ntz

2024-05-20 Thread angerszhu (Jira)
angerszhu created SPARK-48340: - Summary: Support TimestampNTZ infer schema miss prefer_timestamp_ntz Key: SPARK-48340 URL: https://issues.apache.org/jira/browse/SPARK-48340 Project: Spark

[jira] [Updated] (SPARK-48340) Support TimestampNTZ infer schema miss prefer_timestamp_ntz

2024-05-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48340: -- Description: !image-2024-05-20-18-38-39-769.png|width=746,height=450! (was:

[jira] [Updated] (SPARK-48265) Infer window group limit batch should do constant folding

2024-05-13 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48265: -- Description: {code:java} 24/05/13 17:39:25 ERROR [main] PlanChangeLogger: === Result of Batch

[jira] [Created] (SPARK-48265) Infer window group limit batch should do constant folding

2024-05-13 Thread angerszhu (Jira)
angerszhu created SPARK-48265: - Summary: Infer window group limit batch should do constant folding Key: SPARK-48265 URL: https://issues.apache.org/jira/browse/SPARK-48265 Project: Spark Issue

[jira] [Updated] (SPARK-48155) PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed

2024-05-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48155: -- Description: {code:java} 24/05/07 09:48:55 ERROR [main] PlanChangeLogger: === Applying Rule

[jira] [Created] (SPARK-48155) PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed

2024-05-06 Thread angerszhu (Jira)
angerszhu created SPARK-48155: - Summary: PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed Key: SPARK-48155 URL: https://issues.apache.org/jira/browse/SPARK-48155

[jira] [Updated] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48027: -- Description: {code:java} with  refund_info as (     select         loan_id,         1 as refund_type  

[jira] [Updated] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48027: -- Description: {code:java} with  refund_info as (     select         loan_id,         1 as refund_type  

[jira] [Updated] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48027: -- Attachment: image-2024-04-28-16-41-08-392.png > InjectRuntimeFilter for multi-level join should check

[jira] [Updated] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48027: -- Description: {code:java} with  refund_info as (     select         loan_id,         1 as refund_type  

[jira] [Updated] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48027: -- Attachment: image-2024-04-28-16-38-37-510.png > InjectRuntimeFilter for multi-level join should check

[jira] [Created] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-04-28 Thread angerszhu (Jira)
angerszhu created SPARK-48027: - Summary: InjectRuntimeFilter for multi-level join should check child join type Key: SPARK-48027 URL: https://issues.apache.org/jira/browse/SPARK-48027 Project: Spark

[jira] [Commented] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

2024-04-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839449#comment-17839449 ] angerszhu commented on SPARK-33826: --- What is RIK? Not sure what do you mean > InsertIntoHiveTable

[jira] [Resolved] (SPARK-47294) OptimizeSkewInRebalanceRepartitions should support ProjectExec(_,ShuffleQueryStageExec)

2024-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-47294. --- Resolution: Not A Problem > OptimizeSkewInRebalanceRepartitions should support >

[jira] [Updated] (SPARK-47294) OptimizeSkewInRebalanceRepartitions should support ProjectExec(_,ShuffleQueryStageExec)

2024-03-05 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-47294: -- Description: Current OptimizeSkewInRebalanceRepartitions only support match ShuffleQueryStageExec,

[jira] [Created] (SPARK-47294) OptimizeSkewInRebalanceRepartitions should support ProjectExec(_,ShuffleQueryStageExec)

2024-03-05 Thread angerszhu (Jira)
angerszhu created SPARK-47294: - Summary: OptimizeSkewInRebalanceRepartitions should support ProjectExec(_,ShuffleQueryStageExec) Key: SPARK-47294 URL: https://issues.apache.org/jira/browse/SPARK-47294

[jira] [Updated] (SPARK-46741) CacheTable AsSelect should inherit from CTEInChildren to make sure it can be matched

2024-01-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46741: -- Description: Current code since CaheTableAsSelelct not inherit CETInChildren,  still return

[jira] [Updated] (SPARK-46741) CacheTable AsSelect should inherit from CTEInChildren to make sure it can be matched

2024-01-16 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46741: -- Attachment: image-2024-01-17-11-48-28-867.png > CacheTable AsSelect should inherit from CTEInChildren

[jira] [Created] (SPARK-46741) CacheTable AsSelect should inherit from CTEInChildren to make sure it can be matched

2024-01-16 Thread angerszhu (Jira)
angerszhu created SPARK-46741: - Summary: CacheTable AsSelect should inherit from CTEInChildren to make sure it can be matched Key: SPARK-46741 URL: https://issues.apache.org/jira/browse/SPARK-46741

[jira] [Updated] (SPARK-46034) SparkContext add file should also copy file to local root path

2023-11-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46034: -- Description: For below case, it failed with FileNotFoundException {code:java} add jar

[jira] [Created] (SPARK-46034) SparkContext add file should also copy file to local root path

2023-11-21 Thread angerszhu (Jira)
angerszhu created SPARK-46034: - Summary: SparkContext add file should also copy file to local root path Key: SPARK-46034 URL: https://issues.apache.org/jira/browse/SPARK-46034 Project: Spark

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Attachment: image-2023-11-20-17-56-56-507.png > YarnAllocator miss clean

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Attachment: image-2023-11-20-17-56-45-212.png > YarnAllocator miss clean

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Created] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
angerszhu created SPARK-46006: - Summary: YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop Key: SPARK-46006 URL: https://issues.apache.org/jira/browse/SPARK-46006

[jira] [Updated] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once

2023-04-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-43064: -- Description: !screenshot-1.png|width=996,height=554! (was: !screenshot-1.png! ) > Spark SQL CLI

[jira] [Updated] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once

2023-04-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-43064: -- Description: !screenshot-1.png! > Spark SQL CLI SQL tab should only show once statement once >

[jira] [Updated] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once

2023-04-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-43064: -- Attachment: screenshot-1.png > Spark SQL CLI SQL tab should only show once statement once >

[jira] [Created] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once

2023-04-07 Thread angerszhu (Jira)
angerszhu created SPARK-43064: - Summary: Spark SQL CLI SQL tab should only show once statement once Key: SPARK-43064 URL: https://issues.apache.org/jira/browse/SPARK-43064 Project: Spark Issue

[jira] [Created] (SPARK-42699) SparkConnectServer should make client and AM same exit code

2023-03-07 Thread angerszhu (Jira)
angerszhu created SPARK-42699: - Summary: SparkConnectServer should make client and AM same exit code Key: SPARK-42699 URL: https://issues.apache.org/jira/browse/SPARK-42699 Project: Spark Issue

[jira] [Updated] (SPARK-42698) Client mode submit task client should keep same exitcode with AM

2023-03-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-42698: -- Parent: SPARK-36623 Issue Type: Sub-task (was: Bug) > Client mode submit task client should

[jira] [Updated] (SPARK-42698) Client mode submit task client should keep same exitcode with AM

2023-03-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-42698: -- Description: ``` try { app.start(childArgs.toArray, sparkConf) } catch { case t:

[jira] [Created] (SPARK-42698) Client mode submit task client should keep same exitcode with AM

2023-03-07 Thread angerszhu (Jira)
angerszhu created SPARK-42698: - Summary: Client mode submit task client should keep same exitcode with AM Key: SPARK-42698 URL: https://issues.apache.org/jira/browse/SPARK-42698 Project: Spark

[jira] [Updated] (SPARK-40019) Refactor comment of ArrayType

2022-08-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-40019: -- Summary: Refactor comment of ArrayType (was: Refactor comment of ArrayType and MapType) > Refactor

[jira] [Created] (SPARK-40019) Refactor comment of ArrayType and MapType

2022-08-09 Thread angerszhu (Jira)
angerszhu created SPARK-40019: - Summary: Refactor comment of ArrayType and MapType Key: SPARK-40019 URL: https://issues.apache.org/jira/browse/SPARK-40019 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-39776) Join‘ verbose string didn't contains JoinType

2022-07-14 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39776: -- Description: Current verbose string don't have joinType {code:java} (5) BroadcastHashJoin [codegen

[jira] [Updated] (SPARK-39776) Join‘ verbose string didn't contains JoinType

2022-07-14 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39776: -- Description: Current verbose string don't have joinType {code:java} override def

[jira] [Created] (SPARK-39776) Join‘ verbose string didn't contains JoinType

2022-07-14 Thread angerszhu (Jira)
angerszhu created SPARK-39776: - Summary: Join‘ verbose string didn't contains JoinType Key: SPARK-39776 URL: https://issues.apache.org/jira/browse/SPARK-39776 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-39527) V2Catalog rename not support newIdent with catalog

2022-06-20 Thread angerszhu (Jira)
angerszhu created SPARK-39527: - Summary: V2Catalog rename not support newIdent with catalog Key: SPARK-39527 URL: https://issues.apache.org/jira/browse/SPARK-39527 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-39400) spark-sql remain hive resource download dir after exit

2022-06-07 Thread angerszhu (Jira)
angerszhu created SPARK-39400: - Summary: spark-sql remain hive resource download dir after exit Key: SPARK-39400 URL: https://issues.apache.org/jira/browse/SPARK-39400 Project: Spark Issue Type:

[jira] [Created] (SPARK-39351) ShowCreateTable should redact properties

2022-05-31 Thread angerszhu (Jira)
angerszhu created SPARK-39351: - Summary: ShowCreateTable should redact properties Key: SPARK-39351 URL: https://issues.apache.org/jira/browse/SPARK-39351 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39350) DescribeNamespace should redact properties

2022-05-31 Thread angerszhu (Jira)
angerszhu created SPARK-39350: - Summary: DescribeNamespace should redact properties Key: SPARK-39350 URL: https://issues.apache.org/jira/browse/SPARK-39350 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2022-05-31 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544321#comment-17544321 ] angerszhu commented on SPARK-37609: --- Increase -Xss can resolve this. But we should better to refactor

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2022-05-31 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544281#comment-17544281 ] angerszhu commented on SPARK-37609: --- [~yumwang]Seems just an very complex table schema. Not reproduce

[jira] [Comment Edited] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2022-05-31 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544192#comment-17544192 ] angerszhu edited comment on SPARK-37609 at 5/31/22 7:43 AM: Same error in

[jira] [Comment Edited] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2022-05-31 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544192#comment-17544192 ] angerszhu edited comment on SPARK-37609 at 5/31/22 7:42 AM: Same error in

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2022-05-31 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544192#comment-17544192 ] angerszhu commented on SPARK-37609: --- Same error in spark-3.1 {code:java} 22/05/26 15:26:48 ERROR

[jira] [Created] (SPARK-39343) DescribeTableExec should redact properties

2022-05-30 Thread angerszhu (Jira)
angerszhu created SPARK-39343: - Summary: DescribeTableExec should redact properties Key: SPARK-39343 URL: https://issues.apache.org/jira/browse/SPARK-39343 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-39342) ShowTablePropertiesCommand/ShowTablePropertiesExec should redact properties.

2022-05-30 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39342: -- Summary: ShowTablePropertiesCommand/ShowTablePropertiesExec should redact properties. (was:

[jira] [Created] (SPARK-39342) ShowTablePropertiesCommand should redact properties.

2022-05-30 Thread angerszhu (Jira)
angerszhu created SPARK-39342: - Summary: ShowTablePropertiesCommand should redact properties. Key: SPARK-39342 URL: https://issues.apache.org/jira/browse/SPARK-39342 Project: Spark Issue Type:

[jira] [Created] (SPARK-39337) Refactor DescribeTableExec

2022-05-29 Thread angerszhu (Jira)
angerszhu created SPARK-39337: - Summary: Refactor DescribeTableExec Key: SPARK-39337 URL: https://issues.apache.org/jira/browse/SPARK-39337 Project: Spark Issue Type: Task Components:

[jira] [Updated] (SPARK-39337) Refactor DescribeTableExec

2022-05-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39337: -- Description: Repeated code, refactor the code. {code:java} private def addTableDetails(rows:

[jira] [Updated] (SPARK-39335) DescribeTableCommand should redact properties

2022-05-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39335: -- Summary: DescribeTableCommand should redact properties (was: Redact table should redact properties)

[jira] [Created] (SPARK-39336) Redact table/partition properties

2022-05-29 Thread angerszhu (Jira)
angerszhu created SPARK-39336: - Summary: Redact table/partition properties Key: SPARK-39336 URL: https://issues.apache.org/jira/browse/SPARK-39336 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-39335) Redact table should redact properties

2022-05-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39335: -- Parent: SPARK-39336 Issue Type: Sub-task (was: Task) > Redact table should redact properties

[jira] [Created] (SPARK-39335) Redact table should redact properties

2022-05-29 Thread angerszhu (Jira)
angerszhu created SPARK-39335: - Summary: Redact table should redact properties Key: SPARK-39335 URL: https://issues.apache.org/jira/browse/SPARK-39335 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2022-05-25 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-27442: -- Parent: SPARK-36200 Issue Type: Sub-task (was: Bug) > ParquetFileFormat fails to read column

[jira] [Created] (SPARK-39285) Spark should not check filed name when read data

2022-05-25 Thread angerszhu (Jira)
angerszhu created SPARK-39285: - Summary: Spark should not check filed name when read data Key: SPARK-39285 URL: https://issues.apache.org/jira/browse/SPARK-39285 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39224) Ignore noisy. warning message in ProcfsMetricsGetter

2022-05-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39224: -- Summary: Ignore noisy. warning message in ProcfsMetricsGetter (was: Ignore noisy. warning message in

[jira] [Created] (SPARK-39224) Ignore noisy. warning message in ProcessMetricsGetter

2022-05-18 Thread angerszhu (Jira)
angerszhu created SPARK-39224: - Summary: Ignore noisy. warning message in ProcessMetricsGetter Key: SPARK-39224 URL: https://issues.apache.org/jira/browse/SPARK-39224 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39224) Ignore noisy. warning message in ProcessMetricsGetter

2022-05-18 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39224: -- Description: There are many user complain about the noisy warning messages in ProcessMetricsGetter

[jira] [Created] (SPARK-39195) Spark should use two step update of outputCommitCoordinator

2022-05-16 Thread angerszhu (Jira)
angerszhu created SPARK-39195: - Summary: Spark should use two step update of outputCommitCoordinator Key: SPARK-39195 URL: https://issues.apache.org/jira/browse/SPARK-39195 Project: Spark Issue

[jira] [Created] (SPARK-39178) When throw SparkFatalException, should show root cause too.

2022-05-13 Thread angerszhu (Jira)
angerszhu created SPARK-39178: - Summary: When throw SparkFatalException, should show root cause too. Key: SPARK-39178 URL: https://issues.apache.org/jira/browse/SPARK-39178 Project: Spark Issue

[jira] [Created] (SPARK-39136) JDBCTable support properties

2022-05-10 Thread angerszhu (Jira)
angerszhu created SPARK-39136: - Summary: JDBCTable support properties Key: SPARK-39136 URL: https://issues.apache.org/jira/browse/SPARK-39136 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-39136) JDBCTable support properties

2022-05-10 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534220#comment-17534220 ] angerszhu commented on SPARK-39136: --- Raise a ticket soon > JDBCTable support properties >

[jira] [Created] (SPARK-39110) Add metrics properties to Environment page

2022-05-05 Thread angerszhu (Jira)
angerszhu created SPARK-39110: - Summary: Add metrics properties to Environment page Key: SPARK-39110 URL: https://issues.apache.org/jira/browse/SPARK-39110 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-39043) Hive client should not gather statistic by default.

2022-04-27 Thread angerszhu (Jira)
angerszhu created SPARK-39043: - Summary: Hive client should not gather statistic by default. Key: SPARK-39043 URL: https://issues.apache.org/jira/browse/SPARK-39043 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38910) Clean sparkStaging dir should before unregister()

2022-04-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38910: -- Description: {code:java} ShutdownHookManager.addShutdownHook(priority) { () => try {

[jira] [Updated] (SPARK-38910) Clean sparkStaging dir should before unregister()

2022-04-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38910: -- Description: {code:java} {code} Not clean the staging dir when match case {code:jave}

[jira] [Updated] (SPARK-38910) Clean sparkStaging dir should before unregister()

2022-04-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38910: -- Summary: Clean sparkStaging dir should before unregister() (was: Clean sparkStaging dir should bef)

[jira] [Updated] (SPARK-38910) Clean sparkStaging dir should bef

2022-04-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38910: -- Summary: Clean sparkStaging dir should bef (was: Clean sparkStaging dir when WAIT_FOR_APP_COMPLETION

[jira] [Created] (SPARK-38910) Clean sparkStaging dir when WAIT_FOR_APP_COMPLETION is false too

2022-04-14 Thread angerszhu (Jira)
angerszhu created SPARK-38910: - Summary: Clean sparkStaging dir when WAIT_FOR_APP_COMPLETION is false too Key: SPARK-38910 URL: https://issues.apache.org/jira/browse/SPARK-38910 Project: Spark

[jira] [Updated] (SPARK-38498) Support add StreamingListener by conf

2022-03-09 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38498: -- Description: Currently, if user want to add an customized StreamingListener to StreamingContext, we

[jira] [Created] (SPARK-38498) Support add StreamingListener by conf

2022-03-09 Thread angerszhu (Jira)
angerszhu created SPARK-38498: - Summary: Support add StreamingListener by conf Key: SPARK-38498 URL: https://issues.apache.org/jira/browse/SPARK-38498 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-38459) IsolatedClientLoader use build in hadoop version

2022-03-08 Thread angerszhu (Jira)
angerszhu created SPARK-38459: - Summary: IsolatedClientLoader use build in hadoop version Key: SPARK-38459 URL: https://issues.apache.org/jira/browse/SPARK-38459 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-38449) Not call createTable when ifNotExist=true and table eixsts

2022-03-08 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38449: -- Description: In current code of v1, when table exist and ignoreTableExists = true, when table

[jira] [Created] (SPARK-38449) Not call createTable when ifNotExist=true and table eixsts

2022-03-08 Thread angerszhu (Jira)
angerszhu created SPARK-38449: - Summary: Not call createTable when ifNotExist=true and table eixsts Key: SPARK-38449 URL: https://issues.apache.org/jira/browse/SPARK-38449 Project: Spark Issue

[jira] [Created] (SPARK-38382) Refactor migration guide's sentences

2022-03-01 Thread angerszhu (Jira)
angerszhu created SPARK-38382: - Summary: Refactor migration guide's sentences Key: SPARK-38382 URL: https://issues.apache.org/jira/browse/SPARK-38382 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-38358) Add migration guide for spark.sql.hive.convertMetastoreInsertDir and spark.sql.hive.convertMetastoreCtas

2022-02-28 Thread angerszhu (Jira)
angerszhu created SPARK-38358: - Summary: Add migration guide for spark.sql.hive.convertMetastoreInsertDir and spark.sql.hive.convertMetastoreCtas Key: SPARK-38358 URL:

[jira] [Created] (SPARK-38294) DDLUtils.verifyNotReadPath should check target is subDir

2022-02-22 Thread angerszhu (Jira)
angerszhu created SPARK-38294: - Summary: DDLUtils.verifyNotReadPath should check target is subDir Key: SPARK-38294 URL: https://issues.apache.org/jira/browse/SPARK-38294 Project: Spark Issue

[jira] [Updated] (SPARK-38270) SQL CLI AM should keep same exitcode with client

2022-02-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38270: -- Parent: SPARK-36623 Issue Type: Sub-task (was: Task) > SQL CLI AM should keep same exitcode

[jira] [Commented] (SPARK-38293) Fix flaky text of HealthTrackerIntegrationSuite

2022-02-22 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496422#comment-17496422 ] angerszhu commented on SPARK-38293: --- cc [~dongjoon] [~hyukjin.kwon] Have meet this for some times. >

[jira] [Created] (SPARK-38293) Fix flaky text of HealthTrackerIntegrationSuite

2022-02-22 Thread angerszhu (Jira)
angerszhu created SPARK-38293: - Summary: Fix flaky text of HealthTrackerIntegrationSuite Key: SPARK-38293 URL: https://issues.apache.org/jira/browse/SPARK-38293 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-38289) Refactor SQL CLI exit code related code

2022-02-22 Thread angerszhu (Jira)
angerszhu created SPARK-38289: - Summary: Refactor SQL CLI exit code related code Key: SPARK-38289 URL: https://issues.apache.org/jira/browse/SPARK-38289 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-38270) SQL CLI AM should keep same exitcode with client

2022-02-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-38270: -- Description: Currently for SQL CLI, we all use shutdown hook to stop SC {code:java} // Clean up

[jira] [Created] (SPARK-38270) SQL CLI AM should keep same exitcode with client

2022-02-20 Thread angerszhu (Jira)
angerszhu created SPARK-38270: - Summary: SQL CLI AM should keep same exitcode with client Key: SPARK-38270 URL: https://issues.apache.org/jira/browse/SPARK-38270 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-38215) InsertIntoHiveDir support convert metadata

2022-02-15 Thread angerszhu (Jira)
angerszhu created SPARK-38215: - Summary: InsertIntoHiveDir support convert metadata Key: SPARK-38215 URL: https://issues.apache.org/jira/browse/SPARK-38215 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-38197) Improve error message of BlockManager.fetchRemoteManagedBuffer

2022-02-13 Thread angerszhu (Jira)
angerszhu created SPARK-38197: - Summary: Improve error message of BlockManager.fetchRemoteManagedBuffer Key: SPARK-38197 URL: https://issues.apache.org/jira/browse/SPARK-38197 Project: Spark

[jira] [Created] (SPARK-38150) Update comment of RelationConversions

2022-02-08 Thread angerszhu (Jira)
angerszhu created SPARK-38150: - Summary: Update comment of RelationConversions Key: SPARK-38150 URL: https://issues.apache.org/jira/browse/SPARK-38150 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-35531) Can not insert into hive bucket table if create table with upper case schema

2022-02-07 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488612#comment-17488612 ] angerszhu commented on SPARK-35531: --- Sure. > Can not insert into hive bucket table if create table

[jira] [Created] (SPARK-38043) Refactor FileDataSourceBaseSuite

2022-01-27 Thread angerszhu (Jira)
angerszhu created SPARK-38043: - Summary: Refactor FileDataSourceBaseSuite Key: SPARK-38043 URL: https://issues.apache.org/jira/browse/SPARK-38043 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-37985) Fix flaky test SPARK-37578

2022-01-21 Thread angerszhu (Jira)
angerszhu created SPARK-37985: - Summary: Fix flaky test SPARK-37578 Key: SPARK-37985 URL: https://issues.apache.org/jira/browse/SPARK-37985 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-37969) Hive Serde insert should check schema before execution

2022-01-20 Thread angerszhu (Jira)
angerszhu created SPARK-37969: - Summary: Hive Serde insert should check schema before execution Key: SPARK-37969 URL: https://issues.apache.org/jira/browse/SPARK-37969 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37967) ConstantFolding/ Literal.create support ObjectType

2022-01-19 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-37967: -- Summary: ConstantFolding/ Literal.create support ObjectType (was: Literal support ObjectType) >

[jira] [Created] (SPARK-37967) Literal support ObjectType

2022-01-19 Thread angerszhu (Jira)
angerszhu created SPARK-37967: - Summary: Literal support ObjectType Key: SPARK-37967 URL: https://issues.apache.org/jira/browse/SPARK-37967 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-37966) Static insert should write _SUCCESS under partition path

2022-01-19 Thread angerszhu (Jira)
angerszhu created SPARK-37966: - Summary: Static insert should write _SUCCESS under partition path Key: SPARK-37966 URL: https://issues.apache.org/jira/browse/SPARK-37966 Project: Spark Issue

  1   2   3   4   5   6   7   8   9   10   >