[
https://issues.apache.org/jira/browse/SPARK-40481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-40481:
--
Affects Version/s: 3.4.0
(was: 3.3.0)
> Ignore stage fetch failure
[
https://issues.apache.org/jira/browse/SPARK-40515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614860#comment-17614860
]
Yikun Jiang commented on SPARK-40515:
-
https://issues.apache.org/jira/browse/INFRA-23750
Only
[
https://issues.apache.org/jira/browse/SPARK-32288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614856#comment-17614856
]
Apache Spark commented on SPARK-32288:
--
User 'warrenzhu25' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-40718.
---
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38179
[
https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-40718:
-
Assignee: Martin Grund
> Replace shaded netty with grpc netty to avoid double shaded
[
https://issues.apache.org/jira/browse/SPARK-40722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Xia updated SPARK-40722:
-
Description:
{code:java}
2022-10-09 17:22:42.517 [INFO ] [YARN application state monitor ]
[
https://issues.apache.org/jira/browse/SPARK-40722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Xia updated SPARK-40722:
-
Summary: How to set BlockManager info of hostname as ipaddress (was: how
to set driver hostname as
Chen Xia created SPARK-40722:
Summary: how to set driver hostname as ipaddress
Key: SPARK-40722
URL: https://issues.apache.org/jira/browse/SPARK-40722
Project: Spark
Issue Type: Question
[
https://issues.apache.org/jira/browse/SPARK-40721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614751#comment-17614751
]
Apache Spark commented on SPARK-40721:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40721:
Assignee: (was: Apache Spark)
> Use `||` instead of `|` in TimSort
>
[
https://issues.apache.org/jira/browse/SPARK-40721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614752#comment-17614752
]
Apache Spark commented on SPARK-40721:
--
User 'LuciferYang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40721:
Assignee: Apache Spark
> Use `||` instead of `|` in TimSort
>
Yang Jie created SPARK-40721:
Summary: Use `||` instead of `|` in TimSort
Key: SPARK-40721
URL: https://issues.apache.org/jira/browse/SPARK-40721
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Keller updated SPARK-40703:
-
Attachment: (was: test.py)
> Performance regression for joins in Spark 3.3 vs Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Keller updated SPARK-40703:
-
Attachment: test.py
> Performance regression for joins in Spark 3.3 vs Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614738#comment-17614738
]
Bryan Keller commented on SPARK-40703:
--
[~csun] I added a pyspark script that shows the difference
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Keller updated SPARK-40703:
-
Attachment: test.py
> Performance regression for joins in Spark 3.3 vs Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-40675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40675.
--
Resolution: Fixed
Resolved by https://github.com/apache/spark/pull/38131
> Supplement
[
https://issues.apache.org/jira/browse/SPARK-40675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reopened SPARK-40675:
--
> Supplement missing spark configuration in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40710.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38160
[
https://issues.apache.org/jira/browse/SPARK-40710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40710:
Assignee: Qian Sun
> Supplement undocumented parquet configurations in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40675.
--
Fix Version/s: 3.4.0
Assignee: Qian Sun
Resolution: Done
> Supplement missing
[
https://issues.apache.org/jira/browse/SPARK-40709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40709.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38156
[
https://issues.apache.org/jira/browse/SPARK-40699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40699.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38150
[
https://issues.apache.org/jira/browse/SPARK-40709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40709:
Assignee: Qian Sun
> Supplement undocumented avro configurations in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40699:
Assignee: Qian Sun
> Supplement undocumented yarn configuration in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-40710:
-
Priority: Minor (was: Major)
> Supplement undocumented parquet configurations in documentation
[
https://issues.apache.org/jira/browse/SPARK-40675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-40675:
-
Priority: Minor (was: Major)
> Supplement missing spark configuration in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-40699:
-
Priority: Minor (was: Major)
> Supplement undocumented yarn configuration in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-40709:
-
Priority: Minor (was: Major)
> Supplement undocumented avro configurations in documentation
>
[
https://issues.apache.org/jira/browse/SPARK-40712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen updated SPARK-40712:
-
Priority: Minor (was: Major)
> upgrade sbt-assembly plugin to 1.2.0
>
[
https://issues.apache.org/jira/browse/SPARK-40712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-40712.
--
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38164
[
https://issues.apache.org/jira/browse/SPARK-40712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen reassigned SPARK-40712:
Assignee: Yang Jie
> upgrade sbt-assembly plugin to 1.2.0
>
wse/SPARK-40720
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
>Affects Versions: 2.4.5, 3.2.0
>Reporter: tenglei
>Priority: Major
> Attachments: 20221009-195522(WeLinkPC).png
>
>
> In a high concu
wse/SPARK-40720
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
>Affects Versions: 2.4.5, 3.2.0
>Reporter: tenglei
>Priority: Major
> Attachments: 20221009-195522(WeLinkPC).png
>
>
> In a high concu
UI
>Affects Versions: 2.4.5, 3.2.0
>Reporter: tenglei
>Assignee: Apache Spark
>Priority: Major
> Attachments: 20221009-195522(WeLinkPC).png
>
>
> In a high concurrency scenario, we can see from the spark-ui that there are a
> l
nts: Web UI
>Affects Versions: 2.4.5, 3.2.0
>Reporter: tenglei
>Priority: Major
> Attachments: 20221009-195522(WeLinkPC).png
>
>
> In a high concurrency scenario, we can see from the spark-ui that there are a
> lot of jobs running all t
> Components: Web UI
>Affects Versions: 2.4.5, 3.2.0
>Reporter: tenglei
>Priority: Major
> Attachments: 20221009-195522(WeLinkPC).png
>
>
> In a high concurrency scenario, we can see from the spark-ui that there are a
> lot
[
https://issues.apache.org/jira/browse/SPARK-40720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tenglei updated SPARK-40720:
Attachment: 20221009-195522(WeLinkPC).png
> Spark-UI jobs status not updating under high concurre
[
https://issues.apache.org/jira/browse/SPARK-40720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tenglei updated SPARK-40720:
Description:
In a high concurrency scenario, we can see from the spark-ui that there are a
lot of jobs
[
https://issues.apache.org/jira/browse/SPARK-40720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
tenglei updated SPARK-40720:
Description:
In a high concurrency scenario, we can see from the spark-ui interface that
there are a lot
tenglei created SPARK-40720:
---
Summary: Spark-UI jobs status not updating under high concurrency
scenario
Key: SPARK-40720
URL: https://issues.apache.org/jira/browse/SPARK-40720
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-40719:
--
Affects Version/s: 3.1.3
> CTAS should respect TBLPROPERTIES during execution
>
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-40719:
--
Affects Version/s: 3.2.2
3.2.1
3.2.0
> CTAS
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40719:
Assignee: Apache Spark
> CTAS should respect TBLPROPERTIES during execution
>
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614686#comment-17614686
]
Apache Spark commented on SPARK-40719:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40719:
Assignee: (was: Apache Spark)
> CTAS should respect TBLPROPERTIES during execution
>
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614685#comment-17614685
]
Apache Spark commented on SPARK-40719:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-40719:
--
Description:
Currently, Spark `CTAS` has inconsistent behavior when we use `STORED AS` and
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-40719:
--
Description:
{code}
spark-sql> CREATE TABLE t1 STORED AS PARQUET TBLPROPERTIES
Dongjoon Hyun created SPARK-40719:
-
Summary: CTAS should respect TBLPROPERTIES during execution
Key: SPARK-40719
URL: https://issues.apache.org/jira/browse/SPARK-40719
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-40719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-40719:
--
Description:
{code}
spark-sql> CREATE TABLE t1 STORED AS PARQUET TBLPROPERTIES
[
https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614676#comment-17614676
]
Apache Spark commented on SPARK-40718:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40718:
Assignee: (was: Apache Spark)
> Replace shaded netty with grpc netty to avoid double
[
https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614675#comment-17614675
]
Apache Spark commented on SPARK-40718:
--
User 'grundprinzip' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40718:
Assignee: Apache Spark
> Replace shaded netty with grpc netty to avoid double shaded
Martin Grund created SPARK-40718:
Summary: Replace shaded netty with grpc netty to avoid double
shaded dependency.
Key: SPARK-40718
URL: https://issues.apache.org/jira/browse/SPARK-40718
Project:
[
https://issues.apache.org/jira/browse/SPARK-40716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614662#comment-17614662
]
Apache Spark commented on SPARK-40716:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40716:
Assignee: Apache Spark
> Relax the restrictions of broadcast join on bloom filter
>
[
https://issues.apache.org/jira/browse/SPARK-40716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614661#comment-17614661
]
Apache Spark commented on SPARK-40716:
--
User 'beliefer' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40716:
Assignee: (was: Apache Spark)
> Relax the restrictions of broadcast join on bloom
[
https://issues.apache.org/jira/browse/SPARK-40663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614656#comment-17614656
]
Apache Spark commented on SPARK-40663:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40715:
Assignee: Apache Spark
> Support preferring shuffled hash join thought LocalMapThreshold
[
https://issues.apache.org/jira/browse/SPARK-40715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614652#comment-17614652
]
Apache Spark commented on SPARK-40715:
--
User 'wankunde' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40715:
Assignee: (was: Apache Spark)
> Support preferring shuffled hash join thought
[
https://issues.apache.org/jira/browse/SPARK-40663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614650#comment-17614650
]
Apache Spark commented on SPARK-40663:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40716:
---
Description:
Currently, if the creation side of bloom filter could be broadcasted, Spark
cannot
[
https://issues.apache.org/jira/browse/SPARK-40717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40717:
Assignee: (was: Apache Spark)
> Support Column Alias in connect DSL
>
[
https://issues.apache.org/jira/browse/SPARK-40717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614645#comment-17614645
]
Apache Spark commented on SPARK-40717:
--
User 'amaliujia' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-40717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40717:
Assignee: Apache Spark
> Support Column Alias in connect DSL
>
Rui Wang created SPARK-40717:
Summary: Support Column Alias in connect DSL
Key: SPARK-40717
URL: https://issues.apache.org/jira/browse/SPARK-40717
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiaan.geng updated SPARK-40716:
---
Description: Currently,
> Relax the restrictions of broadcast join on bloom filter
>
jiaan.geng created SPARK-40716:
--
Summary: Relax the restrictions of broadcast join on bloom filter
Key: SPARK-40716
URL: https://issues.apache.org/jira/browse/SPARK-40716
Project: Spark
Issue
Wan Kun created SPARK-40715:
---
Summary: Support preferring shuffled hash join thought
LocalMapThreshold is less than advisory partition size
Key: SPARK-40715
URL: https://issues.apache.org/jira/browse/SPARK-40715
[
https://issues.apache.org/jira/browse/SPARK-40714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40714:
Assignee: Apache Spark (was: Max Gekk)
> Remove PartitionAlreadyExistsException
>
[
https://issues.apache.org/jira/browse/SPARK-40714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-40714:
Assignee: Max Gekk (was: Apache Spark)
> Remove PartitionAlreadyExistsException
>
[
https://issues.apache.org/jira/browse/SPARK-40714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614643#comment-17614643
]
Apache Spark commented on SPARK-40714:
--
User 'MaxGekk' has created a pull request for this issue:
Max Gekk created SPARK-40714:
Summary: Remove PartitionAlreadyExistsException
Key: SPARK-40714
URL: https://issues.apache.org/jira/browse/SPARK-40714
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-40663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614635#comment-17614635
]
Apache Spark commented on SPARK-40663:
--
User 'itholic' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614632#comment-17614632
]
Apache Spark commented on SPARK-8731:
-
User 'zhouyifan279' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614630#comment-17614630
]
Apache Spark commented on SPARK-8731:
-
User 'zhouyifan279' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614621#comment-17614621
]
Apache Spark commented on SPARK-9213:
-
User 'lyy-pineapple' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-40663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614596#comment-17614596
]
Apache Spark commented on SPARK-40663:
--
User 'itholic' has created a pull request for this issue:
83 matches
Mail list logo