[
https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27492:
--
Description: For the SPIP - Accelerator-aware task scheduling for Spark,
[
https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27492:
--
Summary: GPU scheduling - High level user documentation (was: High level
user documentation)
[
https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821900#comment-16821900
]
Thomas Graves commented on SPARK-27492:
---
Sorry, it is under the epic and didn't realize it didn't
[
https://issues.apache.org/jira/browse/SPARK-24655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821270#comment-16821270
]
Thomas Graves commented on SPARK-24655:
---
>From the linked issues it seems the goals would be:
*
Thomas Graves created SPARK-27495:
-
Summary: Support Stage level resource scheduling
Key: SPARK-27495
URL: https://issues.apache.org/jira/browse/SPARK-27495
Project: Spark
Issue Type: Story
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27495:
--
Summary: Support Stage level resource configuration and scheduling (was:
Support Stage level
Thomas Graves created SPARK-27492:
-
Summary: High level user documentation
Key: SPARK-27492
URL: https://issues.apache.org/jira/browse/SPARK-27492
Project: Spark
Issue Type: Story
Thomas Graves created SPARK-27489:
-
Summary: UI updates to show executor resource information
Key: SPARK-27489
URL: https://issues.apache.org/jira/browse/SPARK-27489
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reopened SPARK-27364:
---
reopening since it has a subtask
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820120#comment-16820120
]
Thomas Graves commented on SPARK-27364:
---
based on no comments on this I'm going to resolve this
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27364.
---
Resolution: Fixed
> User-facing APIs for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820119#comment-16820119
]
Thomas Graves commented on SPARK-27488:
---
Note, the api design is here:
Thomas Graves created SPARK-27488:
-
Summary: Driver interface to support GPU resources
Key: SPARK-27488
URL: https://issues.apache.org/jira/browse/SPARK-27488
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819153#comment-16819153
]
Thomas Graves commented on SPARK-27396:
---
Since I don't hear any strong objections against the
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818053#comment-16818053
]
Thomas Graves commented on SPARK-25250:
---
[~cloud_fan] can you please add details as to where and
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815465#comment-16815465
]
Thomas Graves edited comment on SPARK-27364 at 4/11/19 2:37 PM:
So there
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815465#comment-16815465
]
Thomas Graves commented on SPARK-27364:
---
So there is actually another one we need for standalone
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812488#comment-16812488
]
Thomas Graves edited comment on SPARK-27364 at 4/11/19 1:48 PM:
There
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815414#comment-16815414
]
Thomas Graves commented on SPARK-27176:
---
looks like I see one:
[
https://issues.apache.org/jira/browse/SPARK-27176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815408#comment-16815408
]
Thomas Graves commented on SPARK-27176:
---
It looks like the hadoop-3.2 profile no longer works, do
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815403#comment-16815403
]
Thomas Graves commented on SPARK-27396:
---
I can shephard it.
> SPIP: Public APIs for extended
[
https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-27361:
-
Assignee: Thomas Graves
> YARN support for GPU-aware scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812488#comment-16812488
]
Thomas Graves edited comment on SPARK-27364 at 4/8/19 3:10 PM:
---
There are
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812488#comment-16812488
]
Thomas Graves edited comment on SPARK-27364 at 4/8/19 3:01 PM:
---
There are
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812488#comment-16812488
]
Thomas Graves commented on SPARK-27364:
---
There are 3 main user facing impacts for the user for
[
https://issues.apache.org/jira/browse/SPARK-27364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809893#comment-16809893
]
Thomas Graves commented on SPARK-27364:
---
working on this, will post a basic design when I have
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27024:
--
Description:
The executor interface shall deal with the resources allocated to the executor
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27024:
--
Description: The executor interface shall deal with the resources allocated
to the executor
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784555#comment-16784555
]
Thomas Graves edited comment on SPARK-27005 at 3/5/19 3:40 PM:
---
so we have
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784555#comment-16784555
]
Thomas Graves commented on SPARK-27005:
---
so we have both a google design doc and the comment
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782167#comment-16782167
]
Thomas Graves commented on SPARK-27024:
---
This and SPARK-27005 basically split the design of the
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781734#comment-16781734
]
Thomas Graves commented on SPARK-27024:
---
I will be looking at this and propose a design.
> Design
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781728#comment-16781728
]
Thomas Graves commented on SPARK-27005:
---
It seems like we are mixing gpu's as static resource vs
[
https://issues.apache.org/jira/browse/SPARK-26792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756750#comment-16756750
]
Thomas Graves commented on SPARK-26792:
---
don't see a problem with changing the default in 3.0, its
[
https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752356#comment-16752356
]
Thomas Graves commented on SPARK-9:
---
This is interesting, a few questions
* I'm assuming all
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750375#comment-16750375
]
Thomas Graves commented on SPARK-24615:
---
[~jerryshao] just curious where this is at, are you
[
https://issues.apache.org/jira/browse/SPARK-26413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750174#comment-16750174
]
Thomas Graves commented on SPARK-26413:
---
Just a note I think this overlaps with
[
https://issues.apache.org/jira/browse/SPARK-26689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750125#comment-16750125
]
Thomas Graves commented on SPARK-26689:
---
Can you add more details about your setup? Which
[
https://issues.apache.org/jira/browse/SPARK-24374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738622#comment-16738622
]
Thomas Graves commented on SPARK-24374:
---
[~luzengxiang] are you just saying when spark tries to
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-26269:
--
Fix Version/s: 2.4.1
> YarnAllocator should have same blacklist behaviour with YARN to
[
https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-26285:
-
Assignee: Alessandro Bellina
> Add a metric source for accumulators (aka
[
https://issues.apache.org/jira/browse/SPARK-26285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26285.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Add a metric source for accumulators (aka
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-26269:
--
Issue Type: Bug (was: Improvement)
> YarnAllocator should have same blacklist behaviour with
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-26269:
-
Assignee: wuyi
> YarnAllocator should have same blacklist behaviour with YARN to
[
https://issues.apache.org/jira/browse/SPARK-26269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26269.
---
Resolution: Fixed
Fix Version/s: (was: 2.4.0)
3.0.0
>
[
https://issues.apache.org/jira/browse/SPARK-26201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-26201.
---
Resolution: Fixed
Assignee: Sanket Chintapalli
Fix Version/s: 3.0.0
[
https://issues.apache.org/jira/browse/SPARK-26201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702028#comment-16702028
]
Thomas Graves commented on SPARK-26201:
---
the issue here seems to be that it isn't decrypting the
Thomas Graves created SPARK-26201:
-
Summary: python broadcast.value on driver fails with disk
encryption enabled
Key: SPARK-26201
URL: https://issues.apache.org/jira/browse/SPARK-26201
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700493#comment-16700493
]
Thomas Graves commented on SPARK-26089:
---
Yeah that seems to make sense and I wouldn't think would
[
https://issues.apache.org/jira/browse/SPARK-26089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16699639#comment-16699639
]
Thomas Graves commented on SPARK-26089:
---
it would definitely be nice to improve blacklisting,
[
https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-21809.
---
Resolution: Fixed
Assignee: Parth Gandhi
Fix Version/s: 3.0.0
> Change
[
https://issues.apache.org/jira/browse/SPARK-25995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683876#comment-16683876
]
Thomas Graves commented on SPARK-25995:
---
I haven't looked at the details but I would say whatever
Thomas Graves created SPARK-25995:
-
Summary: sparkR should ensure user args are after the argument
used for the port
Key: SPARK-25995
URL: https://issues.apache.org/jira/browse/SPARK-25995
Project:
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-22148.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.1
>
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-22148:
-
Assignee: Dhruve Ashar
> TaskSetManager.abortIfCompletelyBlacklisted should not abort
[
https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-15815.
---
Resolution: Duplicate
> Hang while enable blacklistExecutor and DynamicExecutorAllocator
>
[
https://issues.apache.org/jira/browse/SPARK-25023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25023:
-
Assignee: Thomas Graves
> Clarify Spark security documentation
>
[
https://issues.apache.org/jira/browse/SPARK-25023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25023.
---
Resolution: Fixed
Fix Version/s: 3.0.0
2.4.1
> Clarify Spark
[
https://issues.apache.org/jira/browse/SPARK-25855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16665690#comment-16665690
]
Thomas Graves commented on SPARK-25855:
---
it seems like it depends on whether you care to see the
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25753.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> binaryFiles broken for small files
>
[
https://issues.apache.org/jira/browse/SPARK-25753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25753:
-
Assignee: liuxian
> binaryFiles broken for small files
>
[
https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657318#comment-16657318
]
Thomas Graves commented on SPARK-25692:
---
[~redsanket] can you please take a look at this
> Flaky
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651840#comment-16651840
]
Thomas Graves edited comment on SPARK-25732 at 10/16/18 2:53 PM:
-
sorry
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651840#comment-16651840
]
Thomas Graves edited comment on SPARK-25732 at 10/16/18 2:49 PM:
-
sorry
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651840#comment-16651840
]
Thomas Graves commented on SPARK-25732:
---
sorry just realized I misread the second one. why would
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651827#comment-16651827
]
Thomas Graves commented on SPARK-25732:
---
yeah I understand the concern, we don't want to confuse
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651657#comment-16651657
]
Thomas Graves commented on SPARK-25732:
---
So like Marcelo mentioned can't you re-use the
[
https://issues.apache.org/jira/browse/SPARK-25732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650560#comment-16650560
]
Thomas Graves commented on SPARK-25732:
---
I would much rather see Spark start to push tokens and
[
https://issues.apache.org/jira/browse/SPARK-21809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reopened SPARK-21809:
---
> Change Stage Page to use datatables to support sorting columns and searching
>
[
https://issues.apache.org/jira/browse/SPARK-24851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-24851.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Map a Stage ID to it's Associated Job ID in
[
https://issues.apache.org/jira/browse/SPARK-24851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-24851:
-
Assignee: Parth Gandhi
> Map a Stage ID to it's Associated Job ID in UI
>
[
https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25641.
---
Resolution: Fixed
Fix Version/s: 3.0.0
> Change the
[
https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25641:
-
Assignee: Sanket Reddy
> Change the
[
https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637248#comment-16637248
]
Thomas Graves commented on SPARK-25501:
---
the spip title has "Structured Streaming", is there some
[
https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16637240#comment-16637240
]
Thomas Graves commented on SPARK-25501:
---
did you post SPIP to the dev list, I didn't see it go by
[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-18364:
-
Assignee: Marek Simunek
> Expose metrics for YarnShuffleService
>
[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-18364.
---
Resolution: Fixed
Fix Version/s: 2.5.0
> Expose metrics for YarnShuffleService
>
[
https://issues.apache.org/jira/browse/SPARK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25538:
--
Priority: Blocker (was: Major)
> incorrect row counts after distinct()
>
[
https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-24355:
-
Assignee: Sanket Chintapalli
> Improve Spark shuffle server responsiveness to
[
https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623660#comment-16623660
]
Thomas Graves commented on SPARK-24355:
---
pr that got merged didn't get linked properly:
[
https://issues.apache.org/jira/browse/SPARK-24355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-24355.
---
Resolution: Fixed
Fix Version/s: 2.5.0
> Improve Spark shuffle server responsiveness
[
https://issues.apache.org/jira/browse/SPARK-24415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24415:
--
Fix Version/s: 2.3.2
> Stage page aggregated executor metrics wrong when failures
>
[
https://issues.apache.org/jira/browse/SPARK-25231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25231.
---
Resolution: Fixed
Assignee: Parth Gandhi
Fix Version/s: 2.4.0
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24909:
--
Fix Version/s: 2.3.2
> Spark scheduler can hang when fetch failures, executor lost, task
Thomas Graves created SPARK-25263:
-
Summary: Add scheduler integration test for SPARK-24909
Key: SPARK-25263
URL: https://issues.apache.org/jira/browse/SPARK-25263
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594281#comment-16594281
]
Thomas Graves commented on SPARK-25250:
---
We are hitting a race condition here between the
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25250:
--
Description:
We recently had a scenario where a race condition occurred when a task from
[
https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25250:
--
Priority: Major (was: Minor)
> Race condition with tasks running when new attempt for same
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24909:
--
Description:
The DAGScheduler can hang if the executor was lost (due to fetch failure) and
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-24909:
--
Description:
The DAGScheduler can hang if the executor was lost (due to fetch failure) and
[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581608#comment-16581608
]
Thomas Graves commented on SPARK-24924:
---
I'd be ok with that but CSV has been that way already for
[
https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581117#comment-16581117
]
Thomas Graves commented on SPARK-24924:
---
[~cloud_fan] [~hyukjin.kwon] seems no one else has a
[
https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-25043:
-
Assignee: Alessandro Bellina
> spark-sql should print the appId and master on startup
[
https://issues.apache.org/jira/browse/SPARK-25043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-25043.
---
Resolution: Fixed
Fix Version/s: 2.4.0
> spark-sql should print the appId and master
[
https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579854#comment-16579854
]
Thomas Graves commented on SPARK-24787:
---
Yes it was caused by hsync, hsync has to go to the
[
https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579851#comment-16579851
]
Thomas Graves commented on SPARK-24918:
---
Personally I like the explicit config on better
[
https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-25051:
--
Priority: Blocker (was: Major)
> where clause on dataset gives AnalysisException
>
[
https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576709#comment-16576709
]
Thomas Graves commented on SPARK-23298:
---
[~mjukiewicz] have you tried spark with fix for
[
https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576700#comment-16576700
]
Thomas Graves commented on SPARK-25081:
---
thanks, wanted to clarify since the description only
[
https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576234#comment-16576234
]
Thomas Graves commented on SPARK-25081:
---
Does this ever result in the task reading the wrong data
501 - 600 of 1766 matches
Mail list logo
