There is no support to copy local resources to the local working directory
of the DAG. TEZ-1339 is tracking to add that if needed. The expectation is
that jars will already be setup in the local AM classpath and the tasks
will inherit that classpath since they are running inline in the AM JVM
(transitively the Junit JVM if running under Junit).

-----Original Message-----
From: Chris K Wensel [mailto:[email protected]]
Sent: Wednesday, September 03, 2014 1:47 PM
To: [email protected]
Subject: local resources in local mode


Just wondering if LocalResources will be copied to the local working
directory if the DAG is run in local mode and the resource path is local
to the filesystem (file:/).

So far i'm not seeing evidence of this, but I likely have something
borked.

Would this be expected behavior? this JIRA is light on content:
https://issues.apache.org/jira/browse/TEZ-1339

The logs don't show any attempts and failures.

Or should this be handled manually.

My intent is to have local jars be added to the local classpath. This
works great when testing with the mini tez cluster enabled and copying to
HDFS and setting the resource to that location.

ckw

--
Chris K Wensel
[email protected]
http://concurrentinc.com

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Reply via email to