[
https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34065.
--
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31121
[
https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-34065:
Assignee: Hyukjin Kwon
> Cancel the duplicated jobs only in PRs at GitHub Actions
>
[
https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiahong.li updated SPARK-34067:
---
Description:
in the class PartitionPruning, function prune, push pruningHasBenefit function
into
[
https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34067:
Assignee: (was: Apache Spark)
> PartitionPruning push down pruningHasBenefit
[
https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34067:
Assignee: Apache Spark
> PartitionPruning push down pruningHasBenefit function into
[
https://issues.apache.org/jira/browse/SPARK-34067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262455#comment-17262455
]
Apache Spark commented on SPARK-34067:
--
User 'monkeyboy123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-31952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-31952.
-
Fix Version/s: 3.1.1
Resolution: Fixed
Issue resolved by pull request 31035
jiahong.li created SPARK-34067:
--
Summary: PartitionPruning push down pruningHasBenefit function
into insertPredicate function to decrease calculate time
Key: SPARK-34067
URL:
[
https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-34060.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31112
[
https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-34060:
---
Assignee: Maxim Gekk
> ALTER TABLE .. DROP PARTITION uncaches Hive table while updating
[
https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262418#comment-17262418
]
Apache Spark commented on SPARK-34065:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34065:
Assignee: (was: Apache Spark)
> Cancel the duplicated jobs only in PRs at GitHub
[
https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34065:
Assignee: Apache Spark
> Cancel the duplicated jobs only in PRs at GitHub Actions
>
[
https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-33539:
---
Description:
In the SPIP: Standardize Exception Messages in Spark, there are three major
angerszhu created SPARK-34066:
-
Summary: Fix misleading example about func `JsonToStructs`
Key: SPARK-34066
URL: https://issues.apache.org/jira/browse/SPARK-34066
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-34065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-34065:
-
Summary: Cancel the duplicated jobs only in PRs at GitHub Actions (was:
Cancel the duplicated
Hyukjin Kwon created SPARK-34065:
Summary: Cancel the duplicated jobs only in PRs
Key: SPARK-34065
URL: https://issues.apache.org/jira/browse/SPARK-34065
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262405#comment-17262405
]
Apache Spark commented on SPARK-34064:
--
User 'LantaoJin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34064:
Assignee: (was: Apache Spark)
> Broadcast job is not aborted even the SQL statement
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34064:
Assignee: Apache Spark
> Broadcast job is not aborted even the SQL statement canceled
>
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262404#comment-17262404
]
Apache Spark commented on SPARK-34064:
--
User 'LantaoJin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262401#comment-17262401
]
Hyukjin Kwon commented on SPARK-34042:
--
[~marius.butan] mind showing a self-contained reproducer
[
https://issues.apache.org/jira/browse/SPARK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262400#comment-17262400
]
Hyukjin Kwon commented on SPARK-34050:
--
[~laszlo.torok] are you able to provide a self-contained
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin updated SPARK-34064:
---
Description:
SPARK-27036 introduced a runId for BroadcastExchangeExec to resolve the problem
that
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin updated SPARK-34064:
---
Description:
SPARK-27036 introduced a runId for BroadcastExchangeExec to resolve the problem
that
[
https://issues.apache.org/jira/browse/SPARK-34064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin updated SPARK-34064:
---
Attachment: Screen Shot 2021-01-11 at 12.03.13 PM.png
> Broadcast job is not aborted even the SQL
Lantao Jin created SPARK-34064:
--
Summary: Broadcast job is not aborted even the SQL statement
canceled
Key: SPARK-34064
URL: https://issues.apache.org/jira/browse/SPARK-34064
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-33970.
--
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 31109
[
https://issues.apache.org/jira/browse/SPARK-33970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-33970:
Assignee: Yuming Wang
> Check isNull and isNotNull in tests
>
[
https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-33591:
Fix Version/s: 3.1.1
3.0.2
> NULL is recognized as the "null" string in
[
https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-33591:
Labels: correctness (was: )
> NULL is recognized as the "null" string in partition specs
>
[
https://issues.apache.org/jira/browse/SPARK-34057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-34057.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31106
[
https://issues.apache.org/jira/browse/SPARK-34057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-34057:
---
Assignee: Terry Kim
> UnresolvedTableOrView should retain SQL text position
>
[
https://issues.apache.org/jira/browse/SPARK-33084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262347#comment-17262347
]
Apache Spark commented on SPARK-33084:
--
User 'AngersZh' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-33507:
-
Description:
This is an umbrella JIRA to track fixes & improvements for caching behavior in
Spark
[
https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-33507:
-
Description:
This is an umbrella JIRA to track fixes & improvements for caching behavior in
Spark
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34052:
-
Parent: SPARK-33507
Issue Type: Sub-task (was: Bug)
> A cached view should become invalid
[
https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun updated SPARK-34052:
-
Parent: (was: SPARK-33392)
Issue Type: Bug (was: Sub-task)
> A cached view should become
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-34055:
-
Fix Version/s: 3.1.1
3.0.2
> ALTER TABLE .. ADD PARTITION doesn't refresh
[
https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262325#comment-17262325
]
Dongjoon Hyun commented on SPARK-34053:
---
For the record, this will kill the previous commit's run.
[
https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-34053:
-
Assignee: Kamil Bregula
> Please reduce GitHub Actions matrix or improve the build
[
https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-34053.
---
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31104
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Description:
Spark streaming application runs at 60s batch intervals.
The application
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Environment:
AWS EMR 6.1.0
Spark 3.0.0
Kinesis
was:
AWS EMR 6.1.0
Spark 3.0.0
>
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Environment:
AWS EMR 6.1.0
Spark 3.0.0
> Major slowdown in spark streaming after 6
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Attachment: 2020-12-29.pdf
> Major slowdown in spark streaming after 6 days
>
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Description:
Spark streaming application runs at 60s batch intervals.
The application
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Attachment: slow-job
> Major slowdown in spark streaming after 6 days
>
[
https://issues.apache.org/jira/browse/SPARK-34063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Calvin Pietersen updated SPARK-34063:
-
Attachment: normal-job
> Major slowdown in spark streaming after 6 days
>
Calvin Pietersen created SPARK-34063:
Summary: Major slowdown in spark streaming after 6 days
Key: SPARK-34063
URL: https://issues.apache.org/jira/browse/SPARK-34063
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-34059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-34059.
-
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 31110
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948
]
Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:22 PM:
--
[~angerszhuuu] and
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948
]
Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:22 PM:
--
[~angerszhuuu] and
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948
]
Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:20 PM:
--
[~angerszhuuu] and
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ron Hu updated SPARK-26399:
---
Description:
Add the peak values for the metrics to the stages REST API. Also add a new
executorSummary
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261948#comment-17261948
]
Ron Hu edited comment on SPARK-26399 at 1/10/21, 6:18 PM:
--
[~angerszhuuu] and
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ron Hu updated SPARK-26399:
---
Description:
Add the peak values for the metrics to the stages REST API. Also add a new
executorSummary
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262242#comment-17262242
]
Apache Spark commented on SPARK-34055:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262237#comment-17262237
]
Apache Spark commented on SPARK-34055:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262235#comment-17262235
]
Apache Spark commented on SPARK-34055:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1726#comment-1726
]
Apache Spark commented on SPARK-34055:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262221#comment-17262221
]
Apache Spark commented on SPARK-34055:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262215#comment-17262215
]
Apache Spark commented on SPARK-34062:
--
User 'MaxGekk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34062:
Assignee: (was: Apache Spark)
> Call updateTableStats() from
[
https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34062:
Assignee: Apache Spark
> Call updateTableStats() from AlterTableAddPartitionCommand
>
[
https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262214#comment-17262214
]
Apache Spark commented on SPARK-34062:
--
User 'MaxGekk' has created a pull request for this issue:
Maxim Gekk created SPARK-34062:
--
Summary: Call updateTableStats() from AlterTableAddPartitionCommand
Key: SPARK-34062
URL: https://issues.apache.org/jira/browse/SPARK-34062
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-34061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262193#comment-17262193
]
Apache Spark commented on SPARK-34061:
--
User 'wangyum' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-34061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34061:
Assignee: (was: Apache Spark)
> DISTINCT the INTERSECT children
>
[
https://issues.apache.org/jira/browse/SPARK-34061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34061:
Assignee: Apache Spark
> DISTINCT the INTERSECT children
>
Yuming Wang created SPARK-34061:
---
Summary: DISTINCT the INTERSECT children
Key: SPARK-34061
URL: https://issues.apache.org/jira/browse/SPARK-34061
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34060:
Assignee: (was: Apache Spark)
> ALTER TABLE .. DROP PARTITION uncaches Hive table
[
https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34060:
Assignee: Apache Spark
> ALTER TABLE .. DROP PARTITION uncaches Hive table while
[
https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262146#comment-17262146
]
Apache Spark commented on SPARK-34060:
--
User 'MaxGekk' has created a pull request for this issue:
Maxim Gekk created SPARK-34060:
--
Summary: ALTER TABLE .. DROP PARTITION uncaches Hive table while
updating table stats
Key: SPARK-34060
URL: https://issues.apache.org/jira/browse/SPARK-34060
Project:
[
https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-34055.
--
Resolution: Fixed
Issue resolved by pull request 3
76 matches
Mail list logo