[
https://issues.apache.org/jira/browse/SPARK-38401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-38401:
--
Description:
It has several issues with method `ShuffledRowRDD#getPreferredLocations`.
* it does not
[
https://issues.apache.org/jira/browse/SPARK-38293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500577#comment-17500577
]
Yang Jie commented on SPARK-38293:
--
we can add `TestUtils.configTestLog4j2("DBUG")` to
[
https://issues.apache.org/jira/browse/SPARK-38401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500582#comment-17500582
]
Apache Spark commented on SPARK-38401:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38401:
Assignee: (was: Apache Spark)
> Unify get preferred locations for shuffle in AQE
> --
[
https://issues.apache.org/jira/browse/SPARK-38401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38401:
Assignee: Apache Spark
> Unify get preferred locations for shuffle in AQE
> -
[
https://issues.apache.org/jira/browse/SPARK-38399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mengdou updated SPARK-38399:
Description:
Why doesn't shuffle hash join support building left table for left-outer-join,
but it suppor
[
https://issues.apache.org/jira/browse/SPARK-38399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mengdou updated SPARK-38399:
Attachment: image-2022-03-03-16-34-17-909.png
> Why doesn't shuffle hash join support build left table for
[
https://issues.apache.org/jira/browse/SPARK-38399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mengdou updated SPARK-38399:
Description:
Why doesn't shuffle hash join support building left table for left-outer-join,
but it suppor
[
https://issues.apache.org/jira/browse/SPARK-38103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500589#comment-17500589
]
Yuto Akutsu commented on SPARK-38103:
-
I'll work on this.
> Use error classes in th
[
https://issues.apache.org/jira/browse/SPARK-38398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-38398.
---
Fix Version/s: 3.3.0
3.2.2
Resolution: Fixed
Issue resolved by pul
[
https://issues.apache.org/jira/browse/SPARK-38403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500604#comment-17500604
]
Yikun Jiang commented on SPARK-38403:
-
Ah, yes, it's this fix, I also do a compare v
[
https://issues.apache.org/jira/browse/SPARK-38403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang resolved SPARK-38403.
-
Resolution: Fixed
master:
[https://github.com/apache/spark/pull/35572]
3.2 backport:
https://
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500638#comment-17500638
]
Apache Spark commented on SPARK-33206:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500641#comment-17500641
]
Apache Spark commented on SPARK-33206:
--
User 'attilapiros' has created a pull reque
junbiao chen created SPARK-38405:
Summary: Supports customization of the entire optimizer and
planner.
Key: SPARK-38405
URL: https://issues.apache.org/jira/browse/SPARK-38405
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-38353.
--
Fix Version/s: 3.3.0
3.2.2
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-38353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-38353:
Assignee: Yihong He
> Instrument __enter__ and __exit__ magic methods for pandas API on S
[
https://issues.apache.org/jira/browse/SPARK-38397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38397:
-
Affects Version/s: 3.3.0
(was: 3.4.0)
> Support Kueue: K8s-native Job
[
https://issues.apache.org/jira/browse/SPARK-38405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
junbiao chen updated SPARK-38405:
-
Description:
In some scenarios, users need to add some optimization rules after all existing
op
XiDuo You created SPARK-38406:
-
Summary: Improve perfermance of ShufflePartitionsUtil
createSkewPartitionSpecs
Key: SPARK-38406
URL: https://issues.apache.org/jira/browse/SPARK-38406
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-38406:
--
Description:
If shuffle is skewed with tens of thousands of map partitions and reduce
partitions in A
[
https://issues.apache.org/jira/browse/SPARK-38406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-38406:
--
Parent: SPARK-37063
Issue Type: Sub-task (was: Improvement)
> Improve perfermance of ShuffleP
[
https://issues.apache.org/jira/browse/SPARK-38406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38406:
Assignee: Apache Spark
> Improve perfermance of ShufflePartitionsUtil createSkewPartition
[
https://issues.apache.org/jira/browse/SPARK-38406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38406:
Assignee: (was: Apache Spark)
> Improve perfermance of ShufflePartitionsUtil createSk
[
https://issues.apache.org/jira/browse/SPARK-38406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500749#comment-17500749
]
Apache Spark commented on SPARK-38406:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-38378.
-
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35701
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-38378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-38378:
---
Assignee: Zhen Li
> ANTLR grammar definition in separate Parser and Lexer files
> -
[
https://issues.apache.org/jira/browse/SPARK-38351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-38351.
--
Fix Version/s: 3.3.0
Resolution: Fixed
Issue resolved by pull request 35560
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-38351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-38351:
Assignee: Martin Tzvetanov Grigorov
> [TESTS] Replace 'abc symbols with Symbol("abc") in
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500794#comment-17500794
]
Apache Spark commented on SPARK-33206:
--
User 'attilapiros' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500802#comment-17500802
]
Martin Tzvetanov Grigorov commented on SPARK-38351:
---
[~srowen] Should
[
https://issues.apache.org/jira/browse/SPARK-38351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500805#comment-17500805
]
Sean R. Owen commented on SPARK-38351:
--
[~mgrigorov] meh, if they're more test chan
[
https://issues.apache.org/jira/browse/SPARK-38351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500812#comment-17500812
]
Martin Tzvetanov Grigorov commented on SPARK-38351:
---
Yes, there are mo
Gengliang Wang created SPARK-38407:
--
Summary: ANSI Cast: loosen the limitation of casting non-null
complex types
Key: SPARK-38407
URL: https://issues.apache.org/jira/browse/SPARK-38407
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38407:
Assignee: Gengliang Wang (was: Apache Spark)
> ANSI Cast: loosen the limitation of casti
[
https://issues.apache.org/jira/browse/SPARK-38407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38407:
Assignee: Apache Spark (was: Gengliang Wang)
> ANSI Cast: loosen the limitation of casti
[
https://issues.apache.org/jira/browse/SPARK-38407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500862#comment-17500862
]
Apache Spark commented on SPARK-38407:
--
User 'gengliangwang' has created a pull req
Holden Karau created SPARK-38408:
Summary: Add option for partial nested field writes with nullable
fields.
Key: SPARK-38408
URL: https://issues.apache.org/jira/browse/SPARK-38408
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500970#comment-17500970
]
Apache Spark commented on SPARK-38394:
--
User 'steveloughran' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38394:
Assignee: Apache Spark
> build of spark sql against hadoop-3.4.0-snapshot failing with bo
[
https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38394:
Assignee: (was: Apache Spark)
> build of spark sql against hadoop-3.4.0-snapshot fail
[
https://issues.apache.org/jira/browse/SPARK-38394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500971#comment-17500971
]
Apache Spark commented on SPARK-38394:
--
User 'steveloughran' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-33206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-33206:
--
Fix Version/s: 3.1.3
> Spark Shuffle Index Cache calculates memory usage wrong
> -
[
https://issues.apache.org/jira/browse/SPARK-37753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eugene Koifman updated SPARK-37753:
---
Description:
In the current implementation of {{DynamicJoinSelection}} the logic checks if
[
https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500989#comment-17500989
]
Jason Xu commented on SPARK-38388:
--
Hi [~jiangxb1987], would you have any suggestion on
[
https://issues.apache.org/jira/browse/SPARK-38179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chao Sun resolved SPARK-38179.
--
Resolution: Won't Fix
> Improve WritableColumnVector to better support null struct
> -
[
https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500997#comment-17500997
]
Xingbo Jiang commented on SPARK-38388:
--
Have you tried override the `getOutputDeter
[
https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37895:
Assignee: Apache Spark
> Error while joining two tables with non-english field names
> --
[
https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-37895:
Assignee: (was: Apache Spark)
> Error while joining two tables with non-english field
[
https://issues.apache.org/jira/browse/SPARK-37895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17500999#comment-17500999
]
Apache Spark commented on SPARK-37895:
--
User 'planga82' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501008#comment-17501008
]
Erik Krogen commented on SPARK-38408:
-
Sounds very similar to what was done in SPARK
[
https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonas updated SPARK-38409:
--
Description:
[PrometheusServlet|[https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/sp
[
https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonas updated SPARK-38409:
--
Description:
[PrometheusServlet|[https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/sp
[
https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonas updated SPARK-38409:
--
Description: [PrometheusServlet|#L63]] exports gauges with value null as
{{{}gauge_name{} null{}}}. This can f
[
https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonas updated SPARK-38409:
--
Description: [PrometheusServlet|#L63] exports gauges with value null as
{{{}gauge_name{} null{}}}. This can fo
[
https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonas updated SPARK-38409:
--
Description:
[PrometheusServlet|#L63]] exports gauges with value null as {{{}gauge_name{}
null{}}}. This can
Jonas created SPARK-38409:
-
Summary: PrometheusServlet exports gauges with null values
Key: SPARK-38409
URL: https://issues.apache.org/jira/browse/SPARK-38409
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-36163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501026#comment-17501026
]
William Shen commented on SPARK-36163:
--
Any interest in backporting this to 3.1.x a
[
https://issues.apache.org/jira/browse/SPARK-38361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-38361:
---
Summary: Add factory method getConnection into JDBCDialect. (was: Let
factory method getConnection
[
https://issues.apache.org/jira/browse/SPARK-38361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501109#comment-17501109
]
Apache Spark commented on SPARK-38361:
--
User 'beliefer' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-38361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-38361:
---
Description:
At present, the parameter of the factory method for obtaining JDBC connection
is empty
[
https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-38189:
Summary: Add priority scheduling doc for Spark on K8S (was: Support
priority scheduling (Introduc
[
https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yikun Jiang updated SPARK-38189:
Component/s: Documentation
> Add priority scheduling doc for Spark on K8S
> --
XiDuo You created SPARK-38410:
-
Summary: Support specify initial partition number for rebalance
Key: SPARK-38410
URL: https://issues.apache.org/jira/browse/SPARK-38410
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-38189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501148#comment-17501148
]
Apache Spark commented on SPARK-38189:
--
User 'Yikun' has created a pull request for
Cheng Pan created SPARK-38411:
-
Summary: Use UTF-8 to read event log
Key: SPARK-38411
URL: https://issues.apache.org/jira/browse/SPARK-38411
Project: Spark
Issue Type: Bug
Components: S
[
https://issues.apache.org/jira/browse/SPARK-38410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38410:
Assignee: (was: Apache Spark)
> Support specify initial partition number for rebalanc
[
https://issues.apache.org/jira/browse/SPARK-38410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38410:
Assignee: Apache Spark
> Support specify initial partition number for rebalance
> ---
[
https://issues.apache.org/jira/browse/SPARK-38410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501149#comment-17501149
]
Apache Spark commented on SPARK-38410:
--
User 'ulysses-you' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38411:
Assignee: Apache Spark
> Use UTF-8 to read event log
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-38411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501153#comment-17501153
]
Apache Spark commented on SPARK-38411:
--
User 'pan3793' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-38411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38411:
Assignee: (was: Apache Spark)
> Use UTF-8 to read event log
> ---
[
https://issues.apache.org/jira/browse/SPARK-38410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501150#comment-17501150
]
Apache Spark commented on SPARK-38410:
--
User 'ulysses-you' has created a pull reque
Jungtaek Lim created SPARK-38412:
Summary: `from` and `to` is swapped in the
StateSchemaCompatibilityChecker
Key: SPARK-38412
URL: https://issues.apache.org/jira/browse/SPARK-38412
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-38412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-38412:
-
Description:
During the work in SPARK-38024, I figured out the parameter is swapped which
led t
[
https://issues.apache.org/jira/browse/SPARK-38412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim updated SPARK-38412:
-
Description:
During the work in SPARK-38204, I figured out the parameter is swapped which
led t
[
https://issues.apache.org/jira/browse/SPARK-38412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17501178#comment-17501178
]
Apache Spark commented on SPARK-38412:
--
User 'HeartSaVioR' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-38412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38412:
Assignee: (was: Apache Spark)
> `from` and `to` is swapped in the StateSchemaCompatib
[
https://issues.apache.org/jira/browse/SPARK-38412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-38412:
Assignee: Apache Spark
> `from` and `to` is swapped in the StateSchemaCompatibilityChecke
79 matches
Mail list logo
