[ https://issues.apache.org/jira/browse/SLIDER-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320120#comment-14320120 ]
Jonathan Maron commented on SLIDER-783: --------------------------------------- This is probably something that could be addressed by SLIDER-757 and SLIDER-773 given its need to include additional defined resources in the AM classpath. Duplicate? > Unable to use custom classpath in slider AM > ------------------------------------------- > > Key: SLIDER-783 > URL: https://issues.apache.org/jira/browse/SLIDER-783 > Project: Slider > Issue Type: Bug > Affects Versions: Slider 0.60 > Environment: Hadoop 2.6 > Reporter: Lee Yang > Priority: Minor > > We have a custom hadoop JAR which is injected via our hadoop configuration. > However, slider does not seem to pick up the local hadoop classpath, so I get > the following error: > {noformat} > 2015-02-11 22:18:57,502 [main] ERROR main.ServiceLauncher - Exception: > java.lang.RuntimeException: java.lang.ClassNotFoundException: Class > org.apache.hadoop.net.YahooDNSToSwitchMapping not found > java.lang.RuntimeException: java.lang.RuntimeException: > java.lang.ClassNotFoundException: Class > org.apache.hadoop.net.YahooDNSToSwitchMapping not found > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2106) > at org.apache.hadoop.yarn.util.RackResolver.init(RackResolver.java:52) > at > org.apache.hadoop.yarn.client.api.impl.AMRMClientImpl.serviceInit(AMRMClientImpl.java:178) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.client.api.async.impl.AMRMClientAsyncImpl.serviceInit(AMRMClientAsyncImpl.java:89) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.slider.server.services.utility.LaunchedWorkflowCompositeService.deployChildService(LaunchedWorkflowCompositeService.java:108) > at > org.apache.slider.server.appmaster.SliderAppMaster.createAndRunCluster(SliderAppMaster.java:677) > at > org.apache.slider.server.appmaster.SliderAppMaster.runService(SliderAppMaster.java:543) > at > org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:188) > at > org.apache.slider.core.main.ServiceLauncher.launchServiceRobustly(ServiceLauncher.java:475) > at > org.apache.slider.core.main.ServiceLauncher.launchServiceAndExit(ServiceLauncher.java:403) > at > org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:630) > at > org.apache.slider.server.appmaster.SliderAppMaster.main(SliderAppMaster.java:2277) > Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: > Class org.apache.hadoop.net.YahooDNSToSwitchMapping not found > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2074) > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2098) > ... 13 more > Caused by: java.lang.ClassNotFoundException: Class > org.apache.hadoop.net.YahooDNSToSwitchMapping not found > at > org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1980) > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2072) > ... 14 more > {noformat} > I've tried various attempts to inject this jar into the classpath, from the > "additional_cp" param, to modifying the process launch cmd line directly. > None of these seem to be respected, so I eventually worked around this by > symlinking the jar into my slider installation's lib directory, which > currently includes it's own copies of the hadoop 2.6 jars. -- This message was sent by Atlassian JIRA (v6.3.4#6332)