[ https://issues.apache.org/jira/browse/SPARK-6436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves closed SPARK-6436. -------------------------------- Resolution: Invalid This is working for me. Sorry for the confusion, I had build environment issues. > io/netty missing from external shuffle service jars for yarn > ------------------------------------------------------------ > > Key: SPARK-6436 > URL: https://issues.apache.org/jira/browse/SPARK-6436 > Project: Spark > Issue Type: Bug > Components: Shuffle, YARN > Affects Versions: 1.3.0 > Reporter: Thomas Graves > > I was trying to use the external shuffle service on yarn but it appears that > io/netty isn't included in the network jars. I loaded up network-common, > network-yarn, and network-shuffle. If there is some other jar supposed to be > included please let me know. > 2015-03-20 14:25:07,142 [main] FATAL > org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting > NodeManager > java.lang.NoClassDefFoundError: io/netty/channel/EventLoopGroup > at > org.apache.spark.network.shuffle.ExternalShuffleBlockManager.<init>(ExternalShuffleBlockManager.java:64) > at > org.apache.spark.network.shuffle.ExternalShuffleBlockHandler.<init>(ExternalShuffleBlockHandler.java:53) > at > org.apache.spark.network.yarn.YarnShuffleService.serviceInit(YarnShuffleService.java:105) > at > org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:143) -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org