[ 
https://issues.apache.org/jira/browse/SPARK-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069653#comment-14069653
 ] 

Colin Patrick McCabe commented on SPARK-1767:
---------------------------------------------

[~pwendell], [~kayousterhout]: yeah, you're right.  The order in 
{{preferredLocations}} doesn't matter here.  I think we need to pass back some 
more information through this API to the scheduler.  I believe we can do this 
by using a short string prefix.  If it contains an underscore, it won't be 
possible to confuse it with a valid hostname.  This will avoid creating 
compatibility problems, I believe.

> Prefer HDFS-cached replicas when scheduling data-local tasks
> ------------------------------------------------------------
>
>                 Key: SPARK-1767
>                 URL: https://issues.apache.org/jira/browse/SPARK-1767
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.0.0
>            Reporter: Sandy Ryza
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to