[ https://issues.apache.org/jira/browse/YARN-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677493#comment-16677493 ]
Subru Krishnan commented on YARN-8979: -------------------------------------- [~shenyinjie], thanks for reporting this. This is a known issue caused by YARN-4083. We work around this by separating the client configuration (i.e. Spark, Tez, MR) from server configuration (i.e. NM, RM, Router, etc). Unfortunately this involves a code change that will require to have an independent conf dir for clients which might break existing deployments (as everyone will need to clone their conf dirs), so has never been committed. > Spark on yarn job failed with yarn federation enabled > ------------------------------------------------------ > > Key: YARN-8979 > URL: https://issues.apache.org/jira/browse/YARN-8979 > Project: Hadoop YARN > Issue Type: Bug > Affects Versions: 3.1.0 > Reporter: Shen Yinjie > Priority: Major > > when I ran spark job on yarn with yarn federation enabled,job failed and > throw Exception as snapshot. > ps: MR and Tez jobs are OK. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org