[
https://issues.apache.org/jira/browse/SPARK-30440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009433#comment-17009433
]
Ajith S commented on SPARK-30440:
-
Found a race between reviveOffers in
org.apache.spar
[
https://issues.apache.org/jira/browse/SPARK-30440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009427#comment-17009427
]
wuyi commented on SPARK-30440:
--
[~kabhwan] thanks for reporting it. Let me take a look.
>
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009420#comment-17009420
]
Dongjoon Hyun commented on SPARK-30429:
---
Thank you so much for the investigation!
[
https://issues.apache.org/jira/browse/SPARK-30440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009407#comment-17009407
]
Jungtaek Lim commented on SPARK-30440:
--
cc. [~Ngone51] since the failing test is ad
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009398#comment-17009398
]
Maxim Gekk commented on SPARK-30429:
Bisect have found the first bad commit. I speci
[
https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009381#comment-17009381
]
Sanket Reddy edited comment on SPARK-30411 at 1/7/20 5:39 AM:
[
https://issues.apache.org/jira/browse/SPARK-30432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
li xiaosen updated SPARK-30432:
---
Shepherd: (was: Saisai Shao)
> reduce degree recomputation in StronglyConnectedComponents
> --
[
https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009381#comment-17009381
]
Sanket Reddy commented on SPARK-30411:
--
[~yumwang]
[PR-22078|https://github.com/a
[
https://issues.apache.org/jira/browse/SPARK-30414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30414.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27089
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-30433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30433.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27105
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30433:
---
Assignee: wuyi
> Make conflict attributes resolution more scalable in ResolveReferences
> -
[
https://issues.apache.org/jira/browse/SPARK-30444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009370#comment-17009370
]
Aman Omer commented on SPARK-30444:
---
I am looking into this one.
> The same job will
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:47 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:25 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:17 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:16 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:14 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-30432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
li xiaosen updated SPARK-30432:
---
Description:
So the computation happens every time in the do-while loop, the first time the
oute
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:10 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale edited comment on SPARK-2984 at 1/7/20 4:09 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009361#comment-17009361
]
Andrew F Vitale commented on SPARK-2984:
Hi Steve
Is your recommended solution f
[
https://issues.apache.org/jira/browse/SPARK-30432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
li xiaosen updated SPARK-30432:
---
Fix Version/s: (was: 2.4.4)
Target Version/s: 2.4.5, 3.0.0 (was: 2.4.4, 2.4.5)
Affe
[
https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-25403.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 22721
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-25403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-25403:
---
Assignee: Yuming Wang
> Broadcast join is changing to sort merge join , after spark-beeline
[
https://issues.apache.org/jira/browse/SPARK-19784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-19784:
---
Assignee: Yuming Wang
> refresh datasource table after alter the location
> ---
[
https://issues.apache.org/jira/browse/SPARK-19784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19784.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 22721
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30260.
---
Resolution: Duplicate
> Spark-Shell throw ClassNotFoundException exception for more than one
[
https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30260:
--
Fix Version/s: (was: 2.4.3)
(was: 2.3.0)
> Spark-Shell throw ClassN
[
https://issues.apache.org/jira/browse/SPARK-30260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30260:
--
Target Version/s: (was: 2.3.0, 2.4.3)
> Spark-Shell throw ClassNotFoundException exception f
[
https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009293#comment-17009293
]
Yuming Wang commented on SPARK-30411:
-
Please see
[PR-22078|https://github.com/apac
[
https://issues.apache.org/jira/browse/SPARK-30444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dong Wang updated SPARK-30444:
--
Description:
When I run the example sql.SparkSQLExample, df.show() at line 60 would trigger
an action
[
https://issues.apache.org/jira/browse/SPARK-30444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dong Wang updated SPARK-30444:
--
Description:
When I run the example sql.SparkSQLExample, df.show() at line 60 would trigger
an action
Dong Wang created SPARK-30444:
-
Summary: The same job will be computated for many times when using
Dataset.show()
Key: SPARK-30444
URL: https://issues.apache.org/jira/browse/SPARK-30444
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009273#comment-17009273
]
Ping Liu edited comment on SPARK-27842 at 1/7/20 1:21 AM:
--
Hi P
[
https://issues.apache.org/jira/browse/SPARK-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009273#comment-17009273
]
Ping Liu edited comment on SPARK-27842 at 1/7/20 1:19 AM:
--
Hi P
[
https://issues.apache.org/jira/browse/SPARK-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009273#comment-17009273
]
Ping Liu edited comment on SPARK-27842 at 1/7/20 1:20 AM:
--
Hi P
[
https://issues.apache.org/jira/browse/SPARK-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009273#comment-17009273
]
Ping Liu edited comment on SPARK-27842 at 1/7/20 1:17 AM:
--
Hi P
[
https://issues.apache.org/jira/browse/SPARK-27842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009273#comment-17009273
]
Ping Liu commented on SPARK-27842:
--
Hi Peter,
I just did some investigation. I found
[
https://issues.apache.org/jira/browse/SPARK-30430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30430.
--
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27101
[https://gi
[
https://issues.apache.org/jira/browse/SPARK-30430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-30430:
Assignee: Hyukjin Kwon
> Add a note that UserDefinedFunction's constructor is private
> -
[
https://issues.apache.org/jira/browse/SPARK-30154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiangrui Meng resolved SPARK-30154.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26910
[https://
Luke Richter created SPARK-30443:
Summary: "Managed memory leak detected" even with no calls to
take() or limit()
Key: SPARK-30443
URL: https://issues.apache.org/jira/browse/SPARK-30443
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009189#comment-17009189
]
Maxim Gekk commented on SPARK-30429:
[~dongjoon] I ran git bisect. Let see what it w
Jesse Collins created SPARK-30442:
-
Summary: Write mode ignored when using CodecStreams
Key: SPARK-30442
URL: https://issues.apache.org/jira/browse/SPARK-30442
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009118#comment-17009118
]
Dongjoon Hyun commented on SPARK-30429:
---
Thank you for reporting, [~maxgekk].
Do y
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin reassigned SPARK-30313:
--
Assignee: Jungtaek Lim
> Flaky test: MasterSuite.master/worker web ui
[
https://issues.apache.org/jira/browse/SPARK-30313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Masiero Vanzin resolved SPARK-30313.
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull reque
[
https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiamuzhou updated SPARK-30441:
--
Affects Version/s: 2.1.0
2.3.0
2.4.0
> Improve the memor
[
https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiamuzhou updated SPARK-30441:
--
Description:
This is very consume memory when It use StronglyConnectedComponents(see
figure1.png). Be
[
https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiamuzhou updated SPARK-30441:
--
Fix Version/s: (was: 3.1.0)
(was: 2.4.5)
Target Version/s: 3.0.0
jiamuzhou created SPARK-30441:
-
Summary: Improve the memory usage in StronglyConnectedComponents
Key: SPARK-30441
URL: https://issues.apache.org/jira/browse/SPARK-30441
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiamuzhou updated SPARK-30441:
--
Description:
This is very consume memory when It use StronglyConnectedComponents(see
figure1.png). Be
[
https://issues.apache.org/jira/browse/SPARK-30441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jiamuzhou updated SPARK-30441:
--
Attachment: figure2.png
figure1.png
> Improve the memory usage in StronglyConnectedCom
[
https://issues.apache.org/jira/browse/SPARK-30226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30226.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26678
[https://gith
[
https://issues.apache.org/jira/browse/SPARK-30226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30226:
---
Assignee: Ximo Guanter
> Remove withXXX functions in WriteBuilder
> ---
[
https://issues.apache.org/jira/browse/SPARK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-29800:
---
Assignee: angerszhu
> Rewrite non-correlated EXISTS subquery use ScalaSubquery to optimize
[
https://issues.apache.org/jira/browse/SPARK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29800.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 26437
[https://gith
Wenchen Fan created SPARK-30439:
---
Summary: support NOT NULL in column data type
Key: SPARK-30439
URL: https://issues.apache.org/jira/browse/SPARK-30439
Project: Spark
Issue Type: Improvement
Jungtaek Lim created SPARK-30440:
Summary: Flaky test:
org.apache.spark.scheduler.TaskSetManagerSuite.reset
Key: SPARK-30440
URL: https://issues.apache.org/jira/browse/SPARK-30440
Project: Spark
Jungtaek Lim created SPARK-30438:
Summary: Flaky test:
org.apache.spark.deploy.StandaloneDynamicAllocationSuite."dynamic allocation
default behavior"
Key: SPARK-30438
URL: https://issues.apache.org/jira/browse/SP
[
https://issues.apache.org/jira/browse/SPARK-30437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aman Omer updated SPARK-30437:
--
Summary: Uneven spaces for some fields in EXPLAIN FORMATTED (was: Uneven
spaces for some fields for E
Aman Omer created SPARK-30437:
-
Summary: Uneven spaces for some fields for EXPLAIN FORMATTED
Key: SPARK-30437
URL: https://issues.apache.org/jira/browse/SPARK-30437
Project: Spark
Issue Type: Imp
[
https://issues.apache.org/jira/browse/SPARK-30436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008793#comment-17008793
]
Jungtaek Lim commented on SPARK-30436:
--
Working on this. Given create external tabl
Jungtaek Lim created SPARK-30436:
Summary: CREATE EXTERNAL TABLE doesn't work without STORED AS
Key: SPARK-30436
URL: https://issues.apache.org/jira/browse/SPARK-30436
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-30400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AK97 updated SPARK-30400:
-
Component/s: (was: Build)
Tests
SQL
> Test failure in SQL module on ppc64l
[
https://issues.apache.org/jira/browse/SPARK-30400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
AK97 updated SPARK-30400:
-
Issue Type: Bug (was: Test)
> Test failure in SQL module on ppc64le
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008708#comment-17008708
]
Aman Omer commented on SPARK-30421:
---
I am panning to add a marker to Project when it i
angerszhu created SPARK-30435:
-
Summary: update Spark SQL guide of Supported Hive Features
Key: SPARK-30435
URL: https://issues.apache.org/jira/browse/SPARK-30435
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008705#comment-17008705
]
Aman Omer commented on SPARK-30421:
---
In Analysis planning phase, rule _*ResolveMissing
Hyukjin Kwon created SPARK-30434:
Summary: Move pandas related functionalities into 'pandas'
sub-package
Key: SPARK-30434
URL: https://issues.apache.org/jira/browse/SPARK-30434
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008699#comment-17008699
]
Aman Omer commented on SPARK-30421:
---
Plans for
{code:java}
df.drop("bar").where($"bar
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008699#comment-17008699
]
Aman Omer edited comment on SPARK-30421 at 1/6/20 10:07 AM:
[
https://issues.apache.org/jira/browse/SPARK-30433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi updated SPARK-30433:
-
Summary: Make conflict attributes resolution more scalable in
ResolveReferences (was: Make conflict attributes
wuyi created SPARK-30433:
Summary: Make conflict attributes resolution more scalable
Key: SPARK-30433
URL: https://issues.apache.org/jira/browse/SPARK-30433
Project: Spark
Issue Type: Improvement
li xiaosen created SPARK-30432:
--
Summary: reduce degree recomputation in StronglyConnectedComponents
Key: SPARK-30432
URL: https://issues.apache.org/jira/browse/SPARK-30432
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-30421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008640#comment-17008640
]
Aman Omer commented on SPARK-30421:
---
Thanks [~tobias_hermann] for reporting this issue
[
https://issues.apache.org/jira/browse/SPARK-30381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengruifeng updated SPARK-30381:
-
Summary: GBT reuse treePoints for all trees (was: GBT reuse splits for all
trees)
> GBT reuse
Kent Yao created SPARK-30431:
Summary: Update SqlBase.g4 to create commentSpec pattern as same
as locationSpec
Key: SPARK-30431
URL: https://issues.apache.org/jira/browse/SPARK-30431
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-30430:
-
Priority: Trivial (was: Major)
> Add a note that UserDefinedFunction's constructor is private
>
[
https://issues.apache.org/jira/browse/SPARK-30430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-30430:
-
Issue Type: Documentation (was: New Feature)
> Add a note that UserDefinedFunction's constructo
Hyukjin Kwon created SPARK-30430:
Summary: Add a note that UserDefinedFunction's constructor is
private
Key: SPARK-30430
URL: https://issues.apache.org/jira/browse/SPARK-30430
Project: Spark
81 matches
Mail list logo