[
https://issues.apache.org/jira/browse/SPARK-18357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15647941#comment-15647941
]
Thomas Graves commented on SPARK-18357:
---
[~kishorvpatil] can you fix please
> YARN
[
https://issues.apache.org/jira/browse/SPARK-18357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-18357:
--
Assignee: Kishor Patil
> YARN --files/--archives broke
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-18357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-18357.
---
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.0
> YARN --files/--archi
[
https://issues.apache.org/jira/browse/SPARK-17843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-17843.
---
Resolution: Fixed
Assignee: Vinayak Joshi
Fix Version/s: 2.2.0
[
https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667226#comment-15667226
]
Thomas Graves commented on SPARK-18085:
---
I think at a high level its fine.
You men
[
https://issues.apache.org/jira/browse/SPARK-17843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-17843:
--
Fix Version/s: 2.0.3
> History Server gives no feedback about the application list being incomp
[
https://issues.apache.org/jira/browse/SPARK-18733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726671#comment-15726671
]
Thomas Graves commented on SPARK-18733:
---
yes looks like a dup but I'm not sure on c
[
https://issues.apache.org/jira/browse/SPARK-18733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15726701#comment-15726701
]
Thomas Graves commented on SPARK-18733:
---
oh nevermind its looking at lastupdated ti
[
https://issues.apache.org/jira/browse/SPARK-19033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15795863#comment-15795863
]
Thomas Graves commented on SPARK-19033:
---
this should actually be an improvement to
[
https://issues.apache.org/jira/browse/SPARK-19033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-19033:
--
Assignee: Saisai Shao
> HistoryServer still uses old ACLs even if ACLs are updated
> --
[
https://issues.apache.org/jira/browse/SPARK-19033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-19033.
---
Resolution: Fixed
Fix Version/s: 2.2.0
2.1.1
> HistoryServer still
Thomas Graves created SPARK-19112:
-
Summary: add codec for ZStandard
Key: SPARK-19112
URL: https://issues.apache.org/jira/browse/SPARK-19112
Project: Spark
Issue Type: Improvement
C
[
https://issues.apache.org/jira/browse/SPARK-19112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811935#comment-15811935
]
Thomas Graves commented on SPARK-19112:
---
For any sort of Hadoop output formats we g
[
https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815078#comment-15815078
]
Thomas Graves commented on SPARK-19143:
---
[~mridulm80] You say "we added", you are
[
https://issues.apache.org/jira/browse/SPARK-19021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-19021.
---
Resolution: Fixed
Assignee: Saisai Shao
Fix Version/s: 2.2.0
> Generailize HD
Thomas Graves created SPARK-19179:
-
Summary: spark.yarn.access.namenodes description is wrong
Key: SPARK-19179
URL: https://issues.apache.org/jira/browse/SPARK-19179
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-19179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-19179:
--
Assignee: Saisai Shao
> spark.yarn.access.namenodes description is wrong
>
[
https://issues.apache.org/jira/browse/SPARK-19179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-19179.
---
Resolution: Fixed
Fix Version/s: 2.2.0
> spark.yarn.access.namenodes description is wr
[
https://issues.apache.org/jira/browse/SPARK-21157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16179496#comment-16179496
]
Thomas Graves commented on SPARK-21157:
---
Just to point out that yarn/mapreduce/tez
Thomas Graves created SPARK-22151:
-
Summary: PYTHONPATH not picked up from the spark.yarn.appMasterEnv
properly
Key: SPARK-22151
URL: https://issues.apache.org/jira/browse/SPARK-22151
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-22151:
--
Description:
Running in yarn cluster mode and trying to set pythonpath via
spark.yarn.appMaste
[
https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184120#comment-16184120
]
Thomas Graves commented on SPARK-21737:
---
We definitely still want to do this. I do
Thomas Graves created SPARK-22218:
-
Summary: spark shuffle services fails to update secret on
application re-attempts
Key: SPARK-22218
URL: https://issues.apache.org/jira/browse/SPARK-22218
Project: S
[
https://issues.apache.org/jira/browse/SPARK-22218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16194803#comment-16194803
]
Thomas Graves commented on SPARK-22218:
---
Working on a patch for this.
> spark shuf
[
https://issues.apache.org/jira/browse/SPARK-22218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-22218:
--
Description:
Running on yarn, If you have any application re-attempts using the spark 2.2
shuf
[
https://issues.apache.org/jira/browse/SPARK-21737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198665#comment-16198665
]
Thomas Graves commented on SPARK-21737:
---
I haven't had time to think about it much
[
https://issues.apache.org/jira/browse/SPARK-22465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246595#comment-16246595
]
Thomas Graves commented on SPARK-22465:
---
Its not strictly the 2G limit. He did hit
Thomas Graves created SPARK-22577:
-
Summary: executor page blacklist status should update with TaskSet
level blacklisting
Key: SPARK-22577
URL: https://issues.apache.org/jira/browse/SPARK-22577
Projec
Thomas Graves created SPARK-22620:
-
Summary: Deadlock in blacklisting when executor is removed due to
a heartbeat timeout
Key: SPARK-22620
URL: https://issues.apache.org/jira/browse/SPARK-22620
Projec
[
https://issues.apache.org/jira/browse/SPARK-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268792#comment-16268792
]
Thomas Graves commented on SPARK-22620:
---
Note this was running spark on yarn in clu
[
https://issues.apache.org/jira/browse/SPARK-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269517#comment-16269517
]
Thomas Graves commented on SPARK-22620:
---
Looking at this some more it seems that no
[
https://issues.apache.org/jira/browse/SPARK-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-18750.
---
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 2.2.0
Title: Message Title
Thomas Graves commented on SPARK-16742
[
https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849965#comment-15849965
]
Thomas Graves commented on SPARK-18085:
---
Are the ui updates just updates to use new
[
https://issues.apache.org/jira/browse/SPARK-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15888430#comment-15888430
]
Thomas Graves commented on SPARK-18769:
---
{quote}
A little clarification in case the
[
https://issues.apache.org/jira/browse/SPARK-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15890629#comment-15890629
]
Thomas Graves commented on SPARK-18769:
---
[~yuming] I already made a comment on that
[
https://issues.apache.org/jira/browse/SPARK-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892318#comment-15892318
]
Thomas Graves commented on SPARK-18769:
---
I definitely understand there is an actual
Thomas Graves created SPARK-19812:
-
Summary: YARN shuffle service fix moving recovery DB directories
Key: SPARK-19812
URL: https://issues.apache.org/jira/browse/SPARK-19812
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-19812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-19812:
--
Summary: YARN shuffle service fails to relocate recovery DB directories
(was: YARN shuffle ser
[
https://issues.apache.org/jira/browse/SPARK-19812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894584#comment-15894584
]
Thomas Graves commented on SPARK-19812:
---
note that it will go ahead and start using
[
https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905247#comment-15905247
]
Thomas Graves commented on SPARK-19143:
---
Made some comments in the design doc.
My
[
https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905247#comment-15905247
]
Thomas Graves edited comment on SPARK-19143 at 3/10/17 3:20 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943284#comment-15943284
]
Thomas Graves commented on SPARK-19143:
---
I assume this needs to go through the new
[
https://issues.apache.org/jira/browse/SPARK-19904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943799#comment-15943799
]
Thomas Graves commented on SPARK-19904:
---
Is this done or what is this waiting on?
[
https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944046#comment-15944046
]
Thomas Graves commented on SPARK-19143:
---
Yes I can be Shephard.
> API in Spark for
Thomas Graves created SPARK-20178:
-
Summary: Improve Scheduler fetch failures
Key: SPARK-20178
URL: https://issues.apache.org/jira/browse/SPARK-20178
Project: Spark
Issue Type: Epic
[
https://issues.apache.org/jira/browse/SPARK-20178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950917#comment-15950917
]
Thomas Graves commented on SPARK-20178:
---
Overall what I would like to accomplish is
[
https://issues.apache.org/jira/browse/SPARK-20178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950917#comment-15950917
]
Thomas Graves edited comment on SPARK-20178 at 3/31/17 1:53 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-20178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15969388#comment-15969388
]
Thomas Graves commented on SPARK-20178:
---
One thing I ran into today which is somewh
Thomas Graves created SPARK-20340:
-
Summary: Size estimate very wrong in ExternalAppendOnlyMap from
CoGroupedRDD, cause OOM
Key: SPARK-20340
URL: https://issues.apache.org/jira/browse/SPARK-20340
Proj
[
https://issues.apache.org/jira/browse/SPARK-20340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971071#comment-15971071
]
Thomas Graves commented on SPARK-20340:
---
Right, I figured it was probably for perfo
[
https://issues.apache.org/jira/browse/SPARK-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971365#comment-15971365
]
Thomas Graves commented on SPARK-14245:
---
see the commend in the PR, I think there w
[
https://issues.apache.org/jira/browse/SPARK-20391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975029#comment-15975029
]
Thomas Graves commented on SPARK-20391:
---
I agree that if its been released we can't
[
https://issues.apache.org/jira/browse/SPARK-20391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15975115#comment-15975115
]
Thomas Graves commented on SPARK-20391:
---
> My proposal was to add 2 extra fields wh
[
https://issues.apache.org/jira/browse/SPARK-19812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979349#comment-15979349
]
Thomas Graves commented on SPARK-19812:
---
Sorry wasn't clear in the original descrip
[
https://issues.apache.org/jira/browse/SPARK-19812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-19812:
--
Summary: YARN shuffle service fails to relocate recovery DB across NFS
directories (was: YARN
[
https://issues.apache.org/jira/browse/SPARK-19812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-19812.
---
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.0
> YARN shuffle service
[
https://issues.apache.org/jira/browse/SPARK-20178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985447#comment-15985447
]
Thomas Graves commented on SPARK-20178:
---
Another thing we should tie in here is han
Thomas Graves created SPARK-20480:
-
Summary: FileFormatWriter hides FetchFailedException from scheduler
Key: SPARK-20480
URL: https://issues.apache.org/jira/browse/SPARK-20480
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-20480:
--
Description:
I was running a large job where it was getting faiures, noticed they were
listed
[
https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985567#comment-15985567
]
Thomas Graves commented on SPARK-20480:
---
exception in task manager looks like:
17/0
[
https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985571#comment-15985571
]
Thomas Graves commented on SPARK-20480:
---
Note with blacklisting on this caused the
[
https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985590#comment-15985590
]
Thomas Graves commented on SPARK-20480:
---
ah it looks like it should, hadn't seen th
[
https://issues.apache.org/jira/browse/SPARK-20480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-20480.
-
Resolution: Duplicate
> FileFormatWriter hides FetchFailedException from scheduler
>
[
https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-20426.
---
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.0
> OneForOneStreamManag
[
https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-20426:
-
Assignee: jin xing
> OneForOneStreamManager occupies too much memory.
>
[
https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-20426:
--
Fix Version/s: (was: 2.2.1)
> OneForOneStreamManager occupies too much memory.
> --
[
https://issues.apache.org/jira/browse/SPARK-20426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-20426:
--
Fix Version/s: 2.2.1
> OneForOneStreamManager occupies too much memory.
> -
Thomas Graves created SPARK-20589:
-
Summary: Allow limiting task concurrency per stage
Key: SPARK-20589
URL: https://issues.apache.org/jira/browse/SPARK-20589
Project: Spark
Issue Type: Impro
[
https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995650#comment-15995650
]
Thomas Graves commented on SPARK-20589:
---
thanks for the suggestions [~mridulm80].
[
https://issues.apache.org/jira/browse/SPARK-18971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998531#comment-15998531
]
Thomas Graves commented on SPARK-18971:
---
[~zsxwing]have you seen any issues with th
[
https://issues.apache.org/jira/browse/SPARK-18971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15998531#comment-15998531
]
Thomas Graves edited comment on SPARK-18971 at 5/5/17 4:31 PM:
[
https://issues.apache.org/jira/browse/SPARK-19112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16000703#comment-16000703
]
Thomas Graves commented on SPARK-19112:
---
Execution time is definitely worse, did yo
[
https://issues.apache.org/jira/browse/SPARK-19112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16000705#comment-16000705
]
Thomas Graves commented on SPARK-19112:
---
also can you put some more details about t
[
https://issues.apache.org/jira/browse/SPARK-20355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-20355.
---
Resolution: Fixed
Assignee: Sanket Reddy
Fix Version/s: 2.3.0
> Display Spark
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005182#comment-16005182
]
Thomas Graves commented on SPARK-19354:
---
This is definitely causing issues with bla
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-19354:
--
Issue Type: Bug (was: Improvement)
> Killed tasks are getting marked as FAILED
> -
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005189#comment-16005189
]
Thomas Graves commented on SPARK-19354:
---
[~squito] wondering if you have seen the i
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-19354:
--
Priority: Major (was: Minor)
> Killed tasks are getting marked as FAILED
> ---
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005189#comment-16005189
]
Thomas Graves edited comment on SPARK-19354 at 5/10/17 6:37 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16005817#comment-16005817
]
Thomas Graves commented on SPARK-19354:
---
Right from what I've seen not a blacklisti
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006464#comment-16006464
]
Thomas Graves commented on SPARK-19354:
---
thanks for pointing those out, that does f
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves closed SPARK-19354.
-
Resolution: Duplicate
> Killed tasks are getting marked as FAILED
> -
Thomas Graves created SPARK-20713:
-
Summary: Speculative task that got CommitDenied exception shows up
as failed
Key: SPARK-20713
URL: https://issues.apache.org/jira/browse/SPARK-20713
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16006549#comment-16006549
]
Thomas Graves commented on SPARK-19354:
---
just an fyi, filed https://issues.apache.o
[
https://issues.apache.org/jira/browse/SPARK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-21321.
---
Resolution: Fixed
Assignee: Jong Yoon Lee
Fix Version/s: 2.3.0
[
https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091531#comment-16091531
]
Thomas Graves commented on SPARK-15703:
---
It should not be breaking dynamic allocati
[
https://issues.apache.org/jira/browse/SPARK-21243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-21243:
-
Assignee: Dhruve Ashar
> Limit the number of maps in a single shuffle fetch
> --
[
https://issues.apache.org/jira/browse/SPARK-21243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-21243.
---
Resolution: Fixed
Fix Version/s: 2.3.0
> Limit the number of maps in a single shuffle
[
https://issues.apache.org/jira/browse/SPARK-21460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16095546#comment-16095546
]
Thomas Graves commented on SPARK-21460:
---
I didn't think that was the case, but took
Thomas Graves created SPARK-21501:
-
Summary: Spark shuffle index cache size should be memory based
Key: SPARK-21501
URL: https://issues.apache.org/jira/browse/SPARK-21501
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-21243:
--
Fix Version/s: 2.2.1
> Limit the number of maps in a single shuffle fetch
> ---
[
https://issues.apache.org/jira/browse/SPARK-21501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-21501:
--
Affects Version/s: (was: 2.0.0)
2.1.0
> Spark shuffle index cache si
[
https://issues.apache.org/jira/browse/SPARK-21501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098907#comment-16098907
]
Thomas Graves commented on SPARK-21501:
---
The issue was actually introduced with SPA
[
https://issues.apache.org/jira/browse/SPARK-21501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1616#comment-1616
]
Thomas Graves commented on SPARK-21501:
---
We want to change it from a # of entries t
Thomas Graves created SPARK-21530:
-
Summary: Update description of
spark.shuffle.maxChunksBeingTransferred
Key: SPARK-21530
URL: https://issues.apache.org/jira/browse/SPARK-21530
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-21541.
---
Resolution: Fixed
Assignee: Parth Gandhi
Fix Version/s: 2.3.0
> Spark Logs sh
[
https://issues.apache.org/jira/browse/SPARK-21541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105133#comment-16105133
]
Thomas Graves commented on SPARK-21541:
---
it was merged
https://github.com/apache/s
[
https://issues.apache.org/jira/browse/SPARK-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16105164#comment-16105164
]
Thomas Graves commented on SPARK-17321:
---
Can you clarify? as stated above you sho
[
https://issues.apache.org/jira/browse/SPARK-21585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108901#comment-16108901
]
Thomas Graves commented on SPARK-21585:
---
[~srowen]do you know if the github pull re
1201 - 1300 of 1865 matches
Mail list logo
