[
https://issues.apache.org/jira/browse/SAMZA-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16452823#comment-16452823
]
ASF GitHub Bot commented on SAMZA-1687:
---------------------------------------
GitHub user vjagadish opened a pull request:
https://github.com/apache/samza/pull/488
SAMZA-1687: Prioritize preferred host requests over ANY-HOST requests
Working on a documentation that describes this better, but a TL;DR summary
is that we should prioritize preferred-host requests over ANY_HOST requests.
Yarn enforces these two checks:
1. ANY_HOST requests should always be made with relax-locality = true
2. A request with relax-locality = false should not be in the same priority
as another with relax-locality = true
Since the Samza AM makes preferred-host requests with relax-locality =
false, it follows that ANY_HOST requests should specify a different
priority-level. We can safely set priority of preferred-host requests to be
higher than any-host requests since data-locality is critical.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vjagadish1989/samza priority-host-affinity
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/488.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #488
----
commit 2b640f1ba6813f1b193e9433801ef3f5cae85551
Author: Jagadish <jvenkatraman@...>
Date: 2018-04-21T02:49:54Z
Update PMC membership on the Samza web-page
commit 7c38f4990f024ebf7a5ea5815c1adf97ee0ff953
Author: Jagadish <jvenkatraman@...>
Date: 2018-04-23T20:41:37Z
Merge branch 'master' of https://github.com/apache/samza
commit 32ea1c259e0eeb3fd94c84241b0012babe55eff8
Author: Jagadish <jvenkatraman@...>
Date: 2018-04-25T18:17:31Z
Prioritize preferred host requests over ANY_HOST requests
----
> Prioritize preferred host requests over ANY-HOST requests
> ---------------------------------------------------------
>
> Key: SAMZA-1687
> URL: https://issues.apache.org/jira/browse/SAMZA-1687
> Project: Samza
> Issue Type: Bug
> Reporter: Jagadish
> Assignee: Jagadish
> Priority: Major
>
> Yarn enforces these two checks:
> 1. ANY_HOST requests should always be made with relax-locality = true
> 2. A request with relax-locality = false should not be in the same priority
> as another with relax-locality = true
> Since the Samza AM makes preferred-host requests with relax-locality = false,
> it follows that ANY_HOST requests should specify a different priority-level.
> We can safely set priority of preferred-host requests to be higher than
> any-host requests since data-locality is critical.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
