GitHub user fredji97 opened a pull request: https://github.com/apache/samza/pull/97
SAMZA-1143 Include fs.<scheme>.impl.* subkeys to YarnConfiguration used in YarnJobFactory and YarnClusterResourceManager SAMZA-1143 Include fs.<scheme>.impl.* subkeys, in addition to fs.<scheme>.impl, to YarnConfiguration used in YarnJobFactory and YarnClusterResourceManager. When there are additional subconfigurations under fs.myScheme.impl, such as fs.myScheme.impl.client, we need to keep the set of configuration completed in YarnJobFactory and YarnClusterResourceManager. When the context is set for localizing the resource in ClientHelper and YarnContainerRunner, it may rely on this configuration to get the FileStatus information, which may or may not depends on fs.<scheme>.impl and all possible fs.<scheme>.impl.* sub-configuration. This is an enhanced feature to the PR#90. You can merge this pull request into a Git repository by running: $ git pull https://github.com/fredji97/samza fsImplSubkeys Alternatively you can review and apply these changes as the patch at: https://github.com/apache/samza/pull/97.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #97 ---- commit 988d43573656c7d795b251c824c7fad3c6f5d9f3 Author: Fred Ji <f...@linkedin.com> Date: 2017-03-27T22:19:26Z SAMZA-1143 Copy fs.<scheme>.impl.* subkeys, in addition to fs.<scheme>.impl, to YarnConfiguration used in YarnJobFactory and YarnClusterResourceManager. When there are additional subconfigurations under fs.<scheme>.impl, such as fs.<scheme>.impl.client, we need to keep the set of configuration completed. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---