[ https://issues.apache.org/jira/browse/SPARK-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069653#comment-14069653 ]
Colin Patrick McCabe commented on SPARK-1767: --------------------------------------------- [~pwendell], [~kayousterhout]: yeah, you're right. The order in {{preferredLocations}} doesn't matter here. I think we need to pass back some more information through this API to the scheduler. I believe we can do this by using a short string prefix. If it contains an underscore, it won't be possible to confuse it with a valid hostname. This will avoid creating compatibility problems, I believe. > Prefer HDFS-cached replicas when scheduling data-local tasks > ------------------------------------------------------------ > > Key: SPARK-1767 > URL: https://issues.apache.org/jira/browse/SPARK-1767 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 1.0.0 > Reporter: Sandy Ryza > -- This message was sent by Atlassian JIRA (v6.2#6252)