GitHub user fredji97 opened a pull request:
https://github.com/apache/samza/pull/97
SAMZA-1143 Include fs.<scheme>.impl.* subkeys to YarnConfiguration used in
YarnJobFactory and YarnClusterResourceManager
SAMZA-1143 Include fs.<scheme>.impl.* subkeys, in addition to
fs.<scheme>.impl, to YarnConfiguration used in YarnJobFactory and
YarnClusterResourceManager.
When there are additional subconfigurations under fs.myScheme.impl, such as
fs.myScheme.impl.client, we need to keep the set of configuration completed in
YarnJobFactory and YarnClusterResourceManager. When the context is set for
localizing the resource in ClientHelper and YarnContainerRunner, it may rely on
this configuration to get the FileStatus information, which may or may not
depends on fs.<scheme>.impl and all possible fs.<scheme>.impl.*
sub-configuration.
This is an enhanced feature to the PR#90.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/fredji97/samza fsImplSubkeys
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/97.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #97
----
commit 988d43573656c7d795b251c824c7fad3c6f5d9f3
Author: Fred Ji <[email protected]>
Date: 2017-03-27T22:19:26Z
SAMZA-1143 Copy fs.<scheme>.impl.* subkeys, in addition to
fs.<scheme>.impl, to YarnConfiguration used in YarnJobFactory and
YarnClusterResourceManager. When there are additional subconfigurations under
fs.<scheme>.impl, such as fs.<scheme>.impl.client, we need to keep the set of
configuration completed.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
