[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822166#comment-16822166
]
Thomas Graves edited comment on SPARK-27495 at 4/19/19 8:28 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822166#comment-16822166
]
Thomas Graves commented on SPARK-27495:
---
Unfortunately the link to the original de
[
https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27492:
--
Description: For the SPIP - Accelerator-aware task scheduling for Spark,
https://issues.apache
[
https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27492:
--
Summary: GPU scheduling - High level user documentation (was: High level
user documentation)
[
https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821900#comment-16821900
]
Thomas Graves commented on SPARK-27492:
---
Sorry, it is under the epic and didn't re
[
https://issues.apache.org/jira/browse/SPARK-24655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821270#comment-16821270
]
Thomas Graves commented on SPARK-24655:
---
>From the linked issues it seems the goal
Thomas Graves created SPARK-27495:
-
Summary: Support Stage level resource scheduling
Key: SPARK-27495
URL: https://issues.apache.org/jira/browse/SPARK-27495
Project: Spark
Issue Type: Story
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27495:
--
Summary: Support Stage level resource configuration and scheduling (was:
Support Stage level
Thomas Graves created SPARK-27492:
-
Summary: High level user documentation
Key: SPARK-27492
URL: https://issues.apache.org/jira/browse/SPARK-27492
Project: Spark
Issue Type: Story
C
Thomas Graves created SPARK-27489:
-
Summary: UI updates to show executor resource information
Key: SPARK-27489
URL: https://issues.apache.org/jira/browse/SPARK-27489
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reopened SPARK-27364:
---
reopening since it has a subtask
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820120#comment-16820120
]
Thomas Graves commented on SPARK-27364:
---
based on no comments on this I'm going to
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27364.
---
Resolution: Fixed
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820119#comment-16820119
]
Thomas Graves commented on SPARK-27488:
---
Note, the api design is here: https://iss
Thomas Graves created SPARK-27488:
-
Summary: Driver interface to support GPU resources
Key: SPARK-27488
URL: https://issues.apache.org/jira/browse/SPARK-27488
Project: Spark
Issue Type: Stor
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16819153#comment-16819153
]
Thomas Graves commented on SPARK-27396:
---
Since I don't hear any strong objections
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818053#comment-16818053
]
Thomas Graves commented on SPARK-25250:
---
[~cloud_fan] can you please add details a
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815465#comment-16815465
]
Thomas Graves edited comment on SPARK-27364 at 4/11/19 2:37 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815465#comment-16815465
]
Thomas Graves commented on SPARK-27364:
---
So there is actually another one we need
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812488#comment-16812488
]
Thomas Graves edited comment on SPARK-27364 at 4/11/19 1:48 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815414#comment-16815414
]
Thomas Graves commented on SPARK-27176:
---
looks like I see one: https://github.com/
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815408#comment-16815408
]
Thomas Graves commented on SPARK-27176:
---
It looks like the hadoop-3.2 profile no l
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815403#comment-16815403
]
Thomas Graves commented on SPARK-27396:
---
I can shephard it.
> SPIP: Public APIs f
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27361:
-
Assignee: Thomas Graves
> YARN support for GPU-aware scheduling
> -
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812488#comment-16812488
]
Thomas Graves edited comment on SPARK-27364 at 4/8/19 3:10 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812488#comment-16812488
]
Thomas Graves edited comment on SPARK-27364 at 4/8/19 3:01 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812488#comment-16812488
]
Thomas Graves commented on SPARK-27364:
---
There are 3 main user facing impacts for
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809893#comment-16809893
]
Thomas Graves commented on SPARK-27364:
---
working on this, will post a basic design
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27024:
--
Description:
The executor interface shall deal with the resources allocated to the executor
b
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27024:
--
Description: The executor interface shall deal with the resources allocated
to the executor by
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784555#comment-16784555
]
Thomas Graves edited comment on SPARK-27005 at 3/5/19 3:40 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16784555#comment-16784555
]
Thomas Graves commented on SPARK-27005:
---
so we have both a google design doc and t
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16782167#comment-16782167
]
Thomas Graves commented on SPARK-27024:
---
This and SPARK-27005 basically split the
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781734#comment-16781734
]
Thomas Graves commented on SPARK-27024:
---
I will be looking at this and propose a d
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781728#comment-16781728
]
Thomas Graves commented on SPARK-27005:
---
It seems like we are mixing gpu's as stat
[
https://issues.apache.org/jira/browse/SPARK-26792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756750#comment-16756750
]
Thomas Graves commented on SPARK-26792:
---
don't see a problem with changing the def
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16752356#comment-16752356
]
Thomas Graves commented on SPARK-9:
---
This is interesting, a few questions
* I
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750375#comment-16750375
]
Thomas Graves commented on SPARK-24615:
---
[~jerryshao] just curious where this is
[
https://issues.apache.org/jira/browse/SPARK-26413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750174#comment-16750174
]
Thomas Graves commented on SPARK-26413:
---
Just a note I think this overlaps with
h
[
https://issues.apache.org/jira/browse/SPARK-26689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750125#comment-16750125
]
Thomas Graves commented on SPARK-26689:
---
Can you add more details about your setup
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738622#comment-16738622
]
Thomas Graves commented on SPARK-24374:
---
[~luzengxiang] are you just saying when s
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-26269:
--
Fix Version/s: 2.4.1
> YarnAllocator should have same blacklist behaviour with YARN to maxmize
[
https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-26285:
-
Assignee: Alessandro Bellina
> Add a metric source for accumulators (aka AccumulatorSou
[
https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26285.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Add a metric source for accumulators (aka Ac
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-26269:
--
Issue Type: Bug (was: Improvement)
> YarnAllocator should have same blacklist behaviour with
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-26269:
-
Assignee: wuyi
> YarnAllocator should have same blacklist behaviour with YARN to maxmiz
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26269.
---
Resolution: Fixed
Fix Version/s: (was: 2.4.0)
3.0.0
> YarnAllo
[
https://issues.apache.org/jira/browse/SPARK-26201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26201.
---
Resolution: Fixed
Assignee: Sanket Chintapalli
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-26201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702028#comment-16702028
]
Thomas Graves commented on SPARK-26201:
---
the issue here seems to be that it isn't
Thomas Graves created SPARK-26201:
-
Summary: python broadcast.value on driver fails with disk
encryption enabled
Key: SPARK-26201
URL: https://issues.apache.org/jira/browse/SPARK-26201
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16700493#comment-16700493
]
Thomas Graves commented on SPARK-26089:
---
Yeah that seems to make sense and I would
[
https://issues.apache.org/jira/browse/SPARK-26089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16699639#comment-16699639
]
Thomas Graves commented on SPARK-26089:
---
it would definitely be nice to improve bl
[
https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-21809.
---
Resolution: Fixed
Assignee: Parth Gandhi
Fix Version/s: 3.0.0
> Change Stage
[
https://issues.apache.org/jira/browse/SPARK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683876#comment-16683876
]
Thomas Graves commented on SPARK-25995:
---
I haven't looked at the details but I wou
Thomas Graves created SPARK-25995:
-
Summary: sparkR should ensure user args are after the argument
used for the port
Key: SPARK-25995
URL: https://issues.apache.org/jira/browse/SPARK-25995
Project: Sp
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-22148.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.1
> TaskSetManager.abor
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-22148:
-
Assignee: Dhruve Ashar
> TaskSetManager.abortIfCompletelyBlacklisted should not abort w
[
https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-15815.
---
Resolution: Duplicate
> Hang while enable blacklistExecutor and DynamicExecutorAllocator
>
[
https://issues.apache.org/jira/browse/SPARK-25023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25023:
-
Assignee: Thomas Graves
> Clarify Spark security documentation
> --
[
https://issues.apache.org/jira/browse/SPARK-25023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25023.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.1
> Clarify Spark secur
[
https://issues.apache.org/jira/browse/SPARK-25855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665690#comment-16665690
]
Thomas Graves commented on SPARK-25855:
---
it seems like it depends on whether you c
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25753.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> binaryFiles broken for small files
> ---
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25753:
-
Assignee: liuxian
> binaryFiles broken for small files
> --
[
https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657318#comment-16657318
]
Thomas Graves commented on SPARK-25692:
---
[~redsanket] can you please take a look a
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651840#comment-16651840
]
Thomas Graves edited comment on SPARK-25732 at 10/16/18 2:53 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651840#comment-16651840
]
Thomas Graves edited comment on SPARK-25732 at 10/16/18 2:49 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651840#comment-16651840
]
Thomas Graves commented on SPARK-25732:
---
sorry just realized I misread the second
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651827#comment-16651827
]
Thomas Graves commented on SPARK-25732:
---
yeah I understand the concern, we don't w
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651657#comment-16651657
]
Thomas Graves commented on SPARK-25732:
---
So like Marcelo mentioned can't you re-us
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650560#comment-16650560
]
Thomas Graves commented on SPARK-25732:
---
I would much rather see Spark start to pu
[
https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reopened SPARK-21809:
---
> Change Stage Page to use datatables to support sorting columns and searching
> ---
[
https://issues.apache.org/jira/browse/SPARK-24851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-24851.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Map a Stage ID to it's Associated Job ID in
[
https://issues.apache.org/jira/browse/SPARK-24851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-24851:
-
Assignee: Parth Gandhi
> Map a Stage ID to it's Associated Job ID in UI
> -
[
https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25641.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Change the spark.shuffle.server.chunkFetchHa
[
https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25641:
-
Assignee: Sanket Reddy
> Change the spark.shuffle.server.chunkFetchHandlerThreadsPercen
[
https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637248#comment-16637248
]
Thomas Graves commented on SPARK-25501:
---
the spip title has "Structured Streaming"
[
https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637240#comment-16637240
]
Thomas Graves commented on SPARK-25501:
---
did you post SPIP to the dev list, I didn
[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-18364:
-
Assignee: Marek Simunek
> Expose metrics for YarnShuffleService
> -
[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-18364.
---
Resolution: Fixed
Fix Version/s: 2.5.0
> Expose metrics for YarnShuffleService
>
[
https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25538:
--
Priority: Blocker (was: Major)
> incorrect row counts after distinct()
>
[
https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-24355:
-
Assignee: Sanket Chintapalli
> Improve Spark shuffle server responsiveness to non-Chunk
[
https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623660#comment-16623660
]
Thomas Graves commented on SPARK-24355:
---
pr that got merged didn't get linked prop
[
https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-24355.
---
Resolution: Fixed
Fix Version/s: 2.5.0
> Improve Spark shuffle server responsiveness
[
https://issues.apache.org/jira/browse/SPARK-24415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24415:
--
Fix Version/s: 2.3.2
> Stage page aggregated executor metrics wrong when failures
> -
[
https://issues.apache.org/jira/browse/SPARK-25231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25231.
---
Resolution: Fixed
Assignee: Parth Gandhi
Fix Version/s: 2.4.0
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24909:
--
Fix Version/s: 2.3.2
> Spark scheduler can hang when fetch failures, executor lost, task runni
Thomas Graves created SPARK-25263:
-
Summary: Add scheduler integration test for SPARK-24909
Key: SPARK-25263
URL: https://issues.apache.org/jira/browse/SPARK-25263
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594281#comment-16594281
]
Thomas Graves commented on SPARK-25250:
---
We are hitting a race condition here betw
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25250:
--
Description:
We recently had a scenario where a race condition occurred when a task from
prev
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25250:
--
Priority: Major (was: Minor)
> Race condition with tasks running when new attempt for same st
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24909:
--
Description:
The DAGScheduler can hang if the executor was lost (due to fetch failure) and
al
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24909:
--
Description:
The DAGScheduler can hang if the executor was lost (due to fetch failure) and
al
[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16581608#comment-16581608
]
Thomas Graves commented on SPARK-24924:
---
I'd be ok with that but CSV has been that
[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16581117#comment-16581117
]
Thomas Graves commented on SPARK-24924:
---
[~cloud_fan] [~hyukjin.kwon] seems no one
[
https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25043:
-
Assignee: Alessandro Bellina
> spark-sql should print the appId and master on startup
>
[
https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25043.
---
Resolution: Fixed
Fix Version/s: 2.4.0
> spark-sql should print the appId and master
[
https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579854#comment-16579854
]
Thomas Graves commented on SPARK-24787:
---
Yes it was caused by hsync, hsync has to
[
https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579851#comment-16579851
]
Thomas Graves commented on SPARK-24918:
---
Personally I like the explicit config on
[
https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25051:
--
Priority: Blocker (was: Major)
> where clause on dataset gives AnalysisException
> --
[
https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576709#comment-16576709
]
Thomas Graves commented on SPARK-23298:
---
[~mjukiewicz] have you tried spark with f
501 - 600 of 1865 matches
Mail list logo