Re: Tez Jars/Lib Exception

[Achal Soni]

I was referring to this:

    String jarPath = ClassUtil.findContainingJar(getClass());

    Path remoteJarPath = remoteFs.makeQualified(

        new Path(remoteStagingDir, "dag_job.jar"));

    remoteFs.copyFromLocalFile(new Path(jarPath), remoteJarPath);

    FileStatus jarFileStatus = remoteFs.getFileStatus(remoteJarPath);


    Map<String, LocalResource> commonLocalResources =

        new HashMap<String, LocalResource>();

    LocalResource dagJarLocalRsrc = LocalResource.newInstance(

        ConverterUtils.getYarnUrlFromPath(remoteJarPath),

        LocalResourceType.FILE,

        LocalResourceVisibility.APPLICATION,

        jarFileStatus.getLen(),

        jarFileStatus.getModificationTime());

    commonLocalResources.put("dag_job.jar", dagJarLocalRsrc);


This causes issues in Eclipse because there is no jar per se.


On Mon, Jul 22, 2013 at 11:25 PM, Hitesh Shah <hit...@apache.org> wrote:

> I am not sure what you mean by the jar containing the submission. All the
> tez jars ( from the distribution tarball ) are added as local resources for
> the AM as well as all vertices by default.
>
> -- Hitesh
>
> On Jul 22, 2013, at 10:59 PM, Achal Soni wrote:
>
> > Ah I see. And is it necessary to add the jar containing the submission
> as a
> > local resource? This is causing issues when running from Eclipse. I guess
> > it is necessary for the map and reduce classes?
> >
> > - Achal
>
>