[jira] [Resolved] (SPARK-34065) Cancel the duplicated jobs only in PRs at GitHub Actions

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34065. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31121

[jira] [Assigned] (SPARK-34065) Cancel the duplicated jobs only in PRs at GitHub Actions

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34065: Assignee: Hyukjin Kwon > Cancel the duplicated jobs only in PRs at GitHub Actions >

[jira] [Updated] (SPARK-34067) PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time

2021-01-10 Thread jiahong.li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiahong.li updated SPARK-34067: --- Description: in the class PartitionPruning, function prune, push pruningHasBenefit function into 

[jira] [Assigned] (SPARK-34067) PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34067: Assignee: (was: Apache Spark) > PartitionPruning push down pruningHasBenefit

[jira] [Assigned] (SPARK-34067) PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34067: Assignee: Apache Spark > PartitionPruning push down pruningHasBenefit function into

[jira] [Commented] (SPARK-34067) PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262455#comment-17262455 ] Apache Spark commented on SPARK-34067: -- User 'monkeyboy123' has created a pull request for this

[jira] [Resolved] (SPARK-31952) The metric of MemoryBytesSpill is incorrect when doing Aggregate

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31952. - Fix Version/s: 3.1.1 Resolution: Fixed Issue resolved by pull request 31035

[jira] [Created] (SPARK-34067) PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time

2021-01-10 Thread jiahong.li (Jira)
jiahong.li created SPARK-34067: -- Summary: PartitionPruning push down pruningHasBenefit function into insertPredicate function to decrease calculate time Key: SPARK-34067 URL:

[jira] [Resolved] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34060. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31112

[jira] [Assigned] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34060: --- Assignee: Maxim Gekk > ALTER TABLE .. DROP PARTITION uncaches Hive table while updating

[jira] [Commented] (SPARK-34065) Cancel the duplicated jobs only in PRs at GitHub Actions

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262418#comment-17262418 ] Apache Spark commented on SPARK-34065: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-34065) Cancel the duplicated jobs only in PRs at GitHub Actions

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34065: Assignee: (was: Apache Spark) > Cancel the duplicated jobs only in PRs at GitHub

[jira] [Assigned] (SPARK-34065) Cancel the duplicated jobs only in PRs at GitHub Actions

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34065: Assignee: Apache Spark > Cancel the duplicated jobs only in PRs at GitHub Actions >

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2021-01-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33539: --- Description: In the SPIP: Standardize Exception Messages in Spark, there are three major

[jira] [Created] (SPARK-34066) Fix misleading example about func `JsonToStructs`

2021-01-10 Thread angerszhu (Jira)
angerszhu created SPARK-34066: - Summary: Fix misleading example about func `JsonToStructs` Key: SPARK-34066 URL: https://issues.apache.org/jira/browse/SPARK-34066 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-34065) Cancel the duplicated jobs only in PRs at GitHub Actions

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34065: - Summary: Cancel the duplicated jobs only in PRs at GitHub Actions (was: Cancel the duplicated

[jira] [Created] (SPARK-34065) Cancel the duplicated jobs only in PRs

2021-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-34065: Summary: Cancel the duplicated jobs only in PRs Key: SPARK-34065 URL: https://issues.apache.org/jira/browse/SPARK-34065 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262405#comment-17262405 ] Apache Spark commented on SPARK-34064: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34064: Assignee: (was: Apache Spark) > Broadcast job is not aborted even the SQL statement

[jira] [Assigned] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34064: Assignee: Apache Spark > Broadcast job is not aborted even the SQL statement canceled >

[jira] [Commented] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262404#comment-17262404 ] Apache Spark commented on SPARK-34064: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-34042) Column pruning is not working as expected for PERMISIVE mode

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262401#comment-17262401 ] Hyukjin Kwon commented on SPARK-34042: -- [~marius.butan] mind showing a self-contained reproducer

[jira] [Commented] (SPARK-34050) Parquet 2 CSV conversion wrong quoting

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262400#comment-17262400 ] Hyukjin Kwon commented on SPARK-34050: -- [~laszlo.torok] are you able to provide a self-contained

[jira] [Updated] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-34064: --- Description: SPARK-27036 introduced a runId for BroadcastExchangeExec to resolve the problem that

[jira] [Updated] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-34064: --- Description: SPARK-27036 introduced a runId for BroadcastExchangeExec to resolve the problem that

[jira] [Updated] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated SPARK-34064: --- Attachment: Screen Shot 2021-01-11 at 12.03.13 PM.png > Broadcast job is not aborted even the SQL

[jira] [Created] (SPARK-34064) Broadcast job is not aborted even the SQL statement canceled

2021-01-10 Thread Lantao Jin (Jira)
Lantao Jin created SPARK-34064: -- Summary: Broadcast job is not aborted even the SQL statement canceled Key: SPARK-34064 URL: https://issues.apache.org/jira/browse/SPARK-34064 Project: Spark

[jira] [Resolved] (SPARK-33970) Check isNull and isNotNull in tests

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33970. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 31109

[jira] [Assigned] (SPARK-33970) Check isNull and isNotNull in tests

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33970: Assignee: Yuming Wang > Check isNull and isNotNull in tests >

[jira] [Updated] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33591: Fix Version/s: 3.1.1 3.0.2 > NULL is recognized as the "null" string in

[jira] [Updated] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33591: Labels: correctness (was: ) > NULL is recognized as the "null" string in partition specs >

[jira] [Resolved] (SPARK-34057) UnresolvedTableOrView should retain SQL text position

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34057. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31106

[jira] [Assigned] (SPARK-34057) UnresolvedTableOrView should retain SQL text position

2021-01-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34057: --- Assignee: Terry Kim > UnresolvedTableOrView should retain SQL text position >

[jira] [Commented] (SPARK-33084) Add jar support ivy path

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262347#comment-17262347 ] Apache Spark commented on SPARK-33084: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-33507) Improve and fix cache behavior in v1 and v2

2021-01-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33507: - Description: This is an umbrella JIRA to track fixes & improvements for caching behavior in Spark

[jira] [Updated] (SPARK-33507) Improve and fix cache behavior in v1 and v2

2021-01-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33507: - Description: This is an umbrella JIRA to track fixes & improvements for caching behavior in Spark

[jira] [Updated] (SPARK-34052) A cached view should become invalid after a table is dropped

2021-01-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-34052: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > A cached view should become invalid

[jira] [Updated] (SPARK-34052) A cached view should become invalid after a table is dropped

2021-01-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-34052: - Parent: (was: SPARK-33392) Issue Type: Bug (was: Sub-task) > A cached view should become

[jira] [Updated] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34055: - Fix Version/s: 3.1.1 3.0.2 > ALTER TABLE .. ADD PARTITION doesn't refresh

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262325#comment-17262325 ] Dongjoon Hyun commented on SPARK-34053: --- For the record, this will kill the previous commit's run.

[jira] [Assigned] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34053: - Assignee: Kamil Bregula > Please reduce GitHub Actions matrix or improve the build

[jira] [Resolved] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34053. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31104

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Description: Spark streaming application runs at 60s batch intervals. The application

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Environment: AWS EMR 6.1.0 Spark 3.0.0 Kinesis was: AWS EMR 6.1.0 Spark 3.0.0 >

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Environment: AWS EMR 6.1.0 Spark 3.0.0 > Major slowdown in spark streaming after 6

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Attachment: 2020-12-29.pdf > Major slowdown in spark streaming after 6 days >

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Description: Spark streaming application runs at 60s batch intervals. The application

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Attachment: slow-job > Major slowdown in spark streaming after 6 days >

[jira] [Updated] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Pietersen updated SPARK-34063: - Attachment: normal-job > Major slowdown in spark streaming after 6 days >

[jira] [Created] (SPARK-34063) Major slowdown in spark streaming after 6 days

2021-01-10 Thread Calvin Pietersen (Jira)
Calvin Pietersen created SPARK-34063: Summary: Major slowdown in spark streaming after 6 days Key: SPARK-34063 URL: https://issues.apache.org/jira/browse/SPARK-34063 Project: Spark Issue

[jira] [Resolved] (SPARK-34059) Use for/foreach rather than map to make sure execute it eagerly

2021-01-10 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34059. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31110

[jira] [Comment Edited] (SPARK-26399) Add new stage-level REST APIs and parameters

2021-01-10 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948 ] Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:22 PM: -- [~angerszhuuu] and

[jira] [Comment Edited] (SPARK-26399) Add new stage-level REST APIs and parameters

2021-01-10 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948 ] Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:22 PM: -- [~angerszhuuu] and

[jira] [Comment Edited] (SPARK-26399) Add new stage-level REST APIs and parameters

2021-01-10 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948 ] Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:20 PM: -- [~angerszhuuu] and

[jira] [Updated] (SPARK-26399) Add new stage-level REST APIs and parameters

2021-01-10 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Description: Add the peak values for the metrics to the stages REST API. Also add a new executorSummary

[jira] [Comment Edited] (SPARK-26399) Add new stage-level REST APIs and parameters

2021-01-10 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948 ] Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:18 PM: -- [~angerszhuuu] and

[jira] [Updated] (SPARK-26399) Add new stage-level REST APIs and parameters

2021-01-10 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Description: Add the peak values for the metrics to the stages REST API. Also add a new executorSummary

[jira] [Commented] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262242#comment-17262242 ] Apache Spark commented on SPARK-34055: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262237#comment-17262237 ] Apache Spark commented on SPARK-34055: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262235#comment-17262235 ] Apache Spark commented on SPARK-34055: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1726#comment-1726 ] Apache Spark commented on SPARK-34055: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262221#comment-17262221 ] Apache Spark commented on SPARK-34055: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262215#comment-17262215 ] Apache Spark commented on SPARK-34062: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34062: Assignee: (was: Apache Spark) > Call updateTableStats() from

[jira] [Assigned] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34062: Assignee: Apache Spark > Call updateTableStats() from AlterTableAddPartitionCommand >

[jira] [Commented] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262214#comment-17262214 ] Apache Spark commented on SPARK-34062: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34062: -- Summary: Call updateTableStats() from AlterTableAddPartitionCommand Key: SPARK-34062 URL: https://issues.apache.org/jira/browse/SPARK-34062 Project: Spark Issue

[jira] [Commented] (SPARK-34061) DISTINCT the INTERSECT children

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262193#comment-17262193 ] Apache Spark commented on SPARK-34061: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34061) DISTINCT the INTERSECT children

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34061: Assignee: (was: Apache Spark) > DISTINCT the INTERSECT children >

[jira] [Assigned] (SPARK-34061) DISTINCT the INTERSECT children

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34061: Assignee: Apache Spark > DISTINCT the INTERSECT children >

[jira] [Created] (SPARK-34061) DISTINCT the INTERSECT children

2021-01-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34061: --- Summary: DISTINCT the INTERSECT children Key: SPARK-34061 URL: https://issues.apache.org/jira/browse/SPARK-34061 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34060: Assignee: (was: Apache Spark) > ALTER TABLE .. DROP PARTITION uncaches Hive table

[jira] [Assigned] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34060: Assignee: Apache Spark > ALTER TABLE .. DROP PARTITION uncaches Hive table while

[jira] [Commented] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262146#comment-17262146 ] Apache Spark commented on SPARK-34060: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34060: -- Summary: ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats Key: SPARK-34060 URL: https://issues.apache.org/jira/browse/SPARK-34060 Project:

[jira] [Resolved] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34055. -- Resolution: Fixed Issue resolved by pull request 3