well, yes, you can, but it would be much more convenient if spark were to
automatically take care of all the jars under lib_managed, rather than
having to list 20-30 jar in --files and --addJars
On Thu, Jan 9, 2014 at 6:10 PM, Liu, Raymond raymond@intel.com wrote:
I think you could put the
I think you could put the spark jar and other jar your app depends on while not
changes a lot on HDFS, and use --files or --addjars ( depends on the mode you
run YarnClient/YarnStandalone ) to refer to them.
And then just need to redeploy your thin app jar on each invoke.
Best Regards,
Raymond
