[
https://issues.apache.org/jira/browse/SPARK-44719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752049#comment-17752049
]
Manu Zhang commented on SPARK-44719:
Is there a 2.3.10 release?
> NoClassDefFoundError when using
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Summary: Spark application hangs when YarnAllocator adds running executors
after processing
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Description:
I see application hangs when containers are preempted immediately after
allocation as
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Summary: Spark application hangs when YarnAllocator adding running
executors after processing
[
https://issues.apache.org/jira/browse/SPARK-43510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-43510:
---
Description:
I see application hangs when containers are preempted immediately after
allocation as
Manu Zhang created SPARK-43510:
--
Summary: Spark application hangs when YarnAllocator processing
completed containers before updating internal state
Key: SPARK-43510
URL:
[
https://issues.apache.org/jira/browse/SPARK-39430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17700074#comment-17700074
]
Manu Zhang commented on SPARK-39430:
We are using Spark 3.1.1.
All the UI pages are in server
Manu Zhang created SPARK-39672:
--
Summary: NotExists subquery failed with conflicting attributes
Key: SPARK-39672
URL: https://issues.apache.org/jira/browse/SPARK-39672
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557794#comment-17557794
]
Manu Zhang commented on SPARK-30696:
[~maxgekk], any update on this?
I find another issue in 3.1.1.
Manu Zhang created SPARK-39344:
--
Summary: Only disable bucketing when autoBucketedScan is enabled
if bucket columns are not in scan output
Key: SPARK-39344
URL: https://issues.apache.org/jira/browse/SPARK-39344
[
https://issues.apache.org/jira/browse/SPARK-39278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-39278:
---
Description:
Before [https://github.com/apache/spark/pull/23698,]
The precedence of configuring
Manu Zhang created SPARK-39278:
--
Summary: Alternative configs of Hadoop Filesystems to access break
backward compatibility
Key: SPARK-39278
URL: https://issues.apache.org/jira/browse/SPARK-39278
[
https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-39238:
---
Description:
The result of following SQL is 1.00 while 1. is expected
[
https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-39238:
---
Description:
The result of following SQL is 1.00 while 1. is expected
Manu Zhang created SPARK-39238:
--
Summary: Decimal precision loss from applying
WidenSetOperationTypes before DecimalPrecision
Key: SPARK-39238
URL: https://issues.apache.org/jira/browse/SPARK-39238
[
https://issues.apache.org/jira/browse/SPARK-38211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-38211:
---
Summary: Add SQL migration guide on restoring loose upcast from string
(was: Add SQL migration
Manu Zhang created SPARK-38211:
--
Summary: Add SQL migration guide on preserving loose upcast
Key: SPARK-38211
URL: https://issues.apache.org/jira/browse/SPARK-38211
Project: Spark
Issue Type:
Manu Zhang created SPARK-38207:
--
Summary: Add bucketed scan behavior change to migration guide
Key: SPARK-38207
URL: https://issues.apache.org/jira/browse/SPARK-38207
Project: Spark
Issue Type:
Manu Zhang created SPARK-37633:
--
Summary: Unwrap cast should skip if downcast failed with ansi
enabled
Key: SPARK-37633
URL: https://issues.apache.org/jira/browse/SPARK-37633
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450236#comment-17450236
]
Manu Zhang commented on SPARK-34714:
FYI, this was resolved by
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445558#comment-17445558
]
Manu Zhang commented on SPARK-31646:
Only very shortly and by a small amount which I think is more
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420688#comment-17420688
]
Manu Zhang commented on SPARK-31646:
{quote}So I will try to derive numBackLoggedConnections outside
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416656#comment-17416656
]
Manu Zhang commented on SPARK-31646:
[~yzhangal],
Please check this comment
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416656#comment-17416656
]
Manu Zhang edited comment on SPARK-31646 at 9/17/21, 12:40 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416147#comment-17416147
]
Manu Zhang commented on SPARK-31646:
[~yzhangal], please check
[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-35160:
---
Description:
Currently, when running on YARN and failing to get Hive delegation token, a
Spark SQL
[
https://issues.apache.org/jira/browse/SPARK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334443#comment-17334443
]
Manu Zhang commented on SPARK-32083:
This issue has been fixed in
[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331114#comment-17331114
]
Manu Zhang commented on SPARK-35160:
[~hyukjin.kwon],
Thanks for reminder. I've added my proposal
[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-35160:
---
Description:
Currently, when running on YARN and failing to get Hive delegation token, a
Spark SQL
Manu Zhang created SPARK-35160:
--
Summary: Spark application submitted despite failing to get Hive
delegation token
Key: SPARK-35160
URL: https://issues.apache.org/jira/browse/SPARK-35160
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang resolved SPARK-32698.
Resolution: Won't Do
> Do not fall back to default parallelism if the minimum number of coalesced
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Description:
With AQE, local shuffle reader breaks users' repartitioning for dynamic
partition
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Priority: Major (was: Minor)
> AQE local shuffle reader breaks repartitioning for dynamic
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Description:
With AQE, local shuffle reader breaks users' repartitioning for dynamic
partition
[
https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32932:
---
Summary: AQE local shuffle reader breaks repartitioning for dynamic
partition overwrite (was: AQE
Manu Zhang created SPARK-32932:
--
Summary: AQE local reader optimizer breaks repartitioning for
dynamic partition overwrite
Key: SPARK-32932
URL: https://issues.apache.org/jira/browse/SPARK-32932
[
https://issues.apache.org/jira/browse/SPARK-32753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32753:
---
Priority: Major (was: Minor)
> Deduplicating and repartitioning the same column create duplicate
[
https://issues.apache.org/jira/browse/SPARK-32753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-32753:
---
Description:
To reproduce:
{code:java}
Manu Zhang created SPARK-32753:
--
Summary: Deduplicating and repartitioning the same column create
duplicate rows with AQE
Key: SPARK-32753
URL: https://issues.apache.org/jira/browse/SPARK-32753
Project:
Manu Zhang created SPARK-32698:
--
Summary: Do not fall back to default parallelism if the minimum
number of coalesced partitions is not set in AQE
Key: SPARK-32698
URL:
Manu Zhang created SPARK-32083:
--
Summary: Unnecessary tasks are launched when input is empty with
AQE
Key: SPARK-32083
URL: https://issues.apache.org/jira/browse/SPARK-32083
Project: Spark
Manu Zhang created SPARK-31942:
--
Summary: Revert SPARK-31864 Adjust AQE skew join trigger condition
Key: SPARK-31942
URL: https://issues.apache.org/jira/browse/SPARK-31942
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-31870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31870:
---
Summary: AdaptiveQueryExecSuite: "Do not optimize skew join if introduce
additional shuffle" test
Manu Zhang created SPARK-31870:
--
Summary: AdaptiveQueryExecSuite: "Do not optimize skew join if
introduce additional shuffle" test doesn't optimize skew join at all
Key: SPARK-31870
URL:
[
https://issues.apache.org/jira/browse/SPARK-30331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-30331:
---
Parent: SPARK-31412
Issue Type: Sub-task (was: Bug)
> The final AdaptiveSparkPlan event is
[
https://issues.apache.org/jira/browse/SPARK-31658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31658:
---
Parent: SPARK-31412
Issue Type: Sub-task (was: Improvement)
> SQL UI doesn't show write
Manu Zhang created SPARK-31658:
--
Summary: SQL UI doesn't show write commands of AQE plan
Key: SPARK-31658
URL: https://issues.apache.org/jira/browse/SPARK-31658
Project: Spark
Issue Type:
Manu Zhang created SPARK-31646:
--
Summary: Remove unused registeredConnections counter from
ShuffleMetrics
Key: SPARK-31646
URL: https://issues.apache.org/jira/browse/SPARK-31646
Project: Spark
Manu Zhang created SPARK-31611:
--
Summary: Register NettyMemoryMetrics into Node Manager's metrics
system
Key: SPARK-31611
URL: https://issues.apache.org/jira/browse/SPARK-31611
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31219:
---
Description:
Recently, we find our YarnShuffleService has a lot of [half-open
Manu Zhang created SPARK-31219:
--
Summary: YarnShuffleService doesn't close idle netty channel
Key: SPARK-31219
URL: https://issues.apache.org/jira/browse/SPARK-31219
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-31047:
---
Component/s: (was: Input/Output)
SQL
> Improve file listing for ViewFileSystem
Manu Zhang created SPARK-31047:
--
Summary: Improve file listing for ViewFileSystem
Key: SPARK-31047
URL: https://issues.apache.org/jira/browse/SPARK-31047
Project: Spark
Issue Type: Improvement
Manu Zhang created SPARK-30331:
--
Summary: The final AdaptiveSparkPlan event is not marked with
`isFinalPlan=true`
Key: SPARK-30331
URL: https://issues.apache.org/jira/browse/SPARK-30331
Project: Spark
Manu Zhang created SPARK-30217:
--
Summary: Improve partition pruning rule to enforce idempotence
Key: SPARK-30217
URL: https://issues.apache.org/jira/browse/SPARK-30217
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-29793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983339#comment-16983339
]
Manu Zhang commented on SPARK-29793:
[~maryannxue],
Is the {{AdaptiveSparkPlan(isFinal=true)}}
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983155#comment-16983155
]
Manu Zhang edited comment on SPARK-29792 at 11/27/19 4:05 AM:
--
I find most
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983155#comment-16983155
]
Manu Zhang commented on SPARK-29792:
I find most metrics are missing from SQL execution graph for
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-29792:
---
Attachment: image-2019-11-27-11-46-01-587.png
> SQL metrics cannot be updated to subqueries in AQE
[
https://issues.apache.org/jira/browse/SPARK-29792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manu Zhang updated SPARK-29792:
---
Attachment: (was: image-2019-11-27-11-46-01-587.png)
> SQL metrics cannot be updated to
[
https://issues.apache.org/jira/browse/SPARK-28531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977109#comment-16977109
]
Manu Zhang commented on SPARK-28531:
[~manifoldQAQ],
I saw the PR was closed. What's the status of
[
https://issues.apache.org/jira/browse/SPARK-27689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16897948#comment-16897948
]
Manu Zhang commented on SPARK-27689:
[~lambda], [~hyukjin.kwon], [~yumwang],
This issue should be
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892595#comment-16892595
]
Manu Zhang edited comment on SPARK-22063 at 7/28/19 4:19 AM:
-
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892595#comment-16892595
]
Manu Zhang edited comment on SPARK-22063 at 7/25/19 9:41 AM:
-
Is there any
[
https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892595#comment-16892595
]
Manu Zhang commented on SPARK-22063:
Is there any update in this thread ? Which lint-r version is
[
https://issues.apache.org/jira/browse/SPARK-26977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775783#comment-16775783
]
Manu Zhang commented on SPARK-26977:
I'd love to
> Warn against subclassing scala.App doesn't work
Manu Zhang created SPARK-26977:
--
Summary: Warn against subclassing scala.App doesn't work
Key: SPARK-26977
URL: https://issues.apache.org/jira/browse/SPARK-26977
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-15041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616243#comment-16616243
]
Manu Zhang commented on SPARK-15041:
Is there a plan to add such strategies as min/max ?
> adding
[
https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165674#comment-16165674
]
Manu Zhang commented on SPARK-12837:
[~todd_leo], please check out [executor side
69 matches
Mail list logo
