Hi,
I have installed tez on an existing hadoop cluster (HDP 2.1.2 with kerberos installed). When I run a very basic pig script I get the error you see below. It effectively fails with java.io.FileNotFoundException: tez.session.local-resources.pb.file-name (No such file or directory) I have done some googleing on that term and I was unable to figure out what went wrong. Do you guys have any suggestions what I have done wrong? Thanks. Niels Basjes 2015-02-26 17:15:53,310 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS 2015-02-26 17:15:53,364 INFO [main] org.apache.tez.dag.app.DAGAppMaster: Created DAGAppMaster for application appattempt_1423554480020_30727_000002 2015-02-26 17:15:53,534 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2015-02-26 17:15:53,661 INFO [main] org.apache.tez.dag.app.DAGAppMaster: Adding session token to jobTokenSecretManager for application 2015-02-26 17:15:53,667 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.rm.container.AMContainerEventType for class org.apache.tez.dag.app.rm.container.AMContainerMap 2015-02-26 17:15:53,668 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.rm.node.AMNodeEventType for class org.apache.tez.dag.app.rm.node.AMNodeMap 2015-02-26 17:15:53,669 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.dag.event.DAGAppMasterEventType for class org.apache.tez.dag.app.DAGAppMaster$DAGAppMasterEventHandler 2015-02-26 17:15:53,670 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.dag.event.DAGEventType for class org.apache.tez.dag.app.DAGAppMaster$DagEventDispatcher 2015-02-26 17:15:53,670 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.dag.event.VertexEventType for class org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher 2015-02-26 17:15:53,671 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.dag.event.TaskEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskEventDispatcher 2015-02-26 17:15:53,672 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.dag.event.TaskAttemptEventType for class org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher 2015-02-26 17:15:53,673 INFO [main] org.apache.tez.dag.app.DAGAppMaster: AM will unregister as this is the last attempt, currentAttempt=2, maxAttempts=2 2015-02-26 17:15:53,674 INFO [main] org.apache.tez.dag.app.rm.TaskSchedulerEventHandler: TaskScheduler notified that it should unregister from RM 2015-02-26 17:15:53,674 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.rm.AMSchedulerEventType for class org.apache.tez.dag.app.rm.TaskSchedulerEventHandler 2015-02-26 17:15:53,675 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.tez.dag.app.rm.NMCommunicatorEventType for class org.apache.tez.dag.app.launcher.ContainerLauncherImpl 2015-02-26 17:15:54,586 WARN [main] org.apache.hadoop.hdfs.BlockReaderLocal: The short-circuit local reads feature cannot be used because libhadoop cannot be loaded. 2015-02-26 17:15:54,588 INFO [main] org.apache.hadoop.service.AbstractService: Service org.apache.tez.dag.app.DAGAppMaster failed in state INITED; cause: java.io.FileNotFoundException: tez.session.local-resources.pb.file-name (No such file or directory) java.io.FileNotFoundException: tez.session.local-resources.pb.file-name (No such file or directory) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.<init>(FileInputStream.java:146) at java.io.FileInputStream.<init>(FileInputStream.java:101) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:386) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.tez.dag.app.DAGAppMaster$5.run(DAGAppMaster.java:1954) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:1951) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:1790) 2015-02-26 17:15:54,591 INFO [main] org.apache.tez.dag.history.HistoryEventHandler: Stopping HistoryEventHandler 2015-02-26 17:15:54,592 FATAL [main] org.apache.tez.dag.app.DAGAppMaster: Error starting DAGAppMaster org.apache.hadoop.service.ServiceStateException: java.io.FileNotFoundException: tez.session.local-resources.pb.file-name (No such file or directory) at org.apache.hadoop.service.ServiceStateException.convert(ServiceStateException.java:59) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:172) at org.apache.tez.dag.app.DAGAppMaster$5.run(DAGAppMaster.java:1954) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) at org.apache.tez.dag.app.DAGAppMaster.initAndStartAppMaster(DAGAppMaster.java:1951) at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:1790) Caused by: java.io.FileNotFoundException: tez.session.local-resources.pb.file-name (No such file or directory) at java.io.FileInputStream.open(Native Method) at java.io.FileInputStream.<init>(FileInputStream.java:146) at java.io.FileInputStream.<init>(FileInputStream.java:101) at org.apache.tez.dag.app.DAGAppMaster.serviceInit(DAGAppMaster.java:386) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) ... 6 more -- Best regards / Met vriendelijke groeten, Niels Basjes