You can set SPARK_PREPEND_CLASSES=1 and it should pick your new mllib
classes whenever you compile them.
I don't see anything similar for examples/, so if you modify example
code you need to re-build the examples module ("package" or "install"
- just "compile" won't work, since you need to build the new jar).
On Thu, Dec 4, 2014 at 10:23 PM, MEETHU MATHEW <meethu2...@yahoo.co.in> wrote:
> Hi all,
>
> I made some code changes in mllib project and as mentioned in the previous
> mails I did
>
> mvn install -pl mllib
>
> Now I run a program in examples using run-example, the new code is not
> executing.Instead the previous code itself is running.
>
> But if I do an "mvn install" in the entire spark project , I can see the
> new code running.But installing the entire spark takes a lot of time and so
> its difficult to do this each time I make some changes.
>
> Can someone tell me how to compile mllib alone and get the changes working?
>
> Thanks & Regards,
> Meethu M
>
>
> On Friday, 28 November 2014 2:39 PM, MEETHU MATHEW <meethu2...@yahoo.co.in>
> wrote:
>
>
> Hi,
> I have a similar problem.I modified the code in mllib and examples.
> I did
> mvn install -pl mllib
> mvn install -pl examples
>
> But when I run the program in examples using run-example,the older version
> of mllib (before the changes were made) is getting executed.
> How to get the changes made in mllib while calling it from examples
> project?
>
> Thanks & Regards,
> Meethu M
>
>
> On Monday, 24 November 2014 3:33 PM, Yiming (John) Zhang <sdi...@gmail.com>
> wrote:
>
>
> Thank you, Marcelo and Sean, "mvn install" is a good answer for my demands.
>
> -----邮件原件-----
> 发件人: Marcelo Vanzin [mailto:van...@cloudera.com]
> 发送时间: 2014年11月21日 1:47
> 收件人: yiming zhang
> 抄送: Sean Owen; user@spark.apache.org
> 主题: Re: How to incrementally compile spark examples using mvn
>
> Hi Yiming,
>
> On Wed, Nov 19, 2014 at 5:35 PM, Yiming (John) Zhang <sdi...@gmail.com>
> wrote:
>> Thank you for your reply. I was wondering whether there is a method of
>> reusing locally-built components without installing them? That is, if I have
>> successfully built the spark project as a whole, how should I configure it
>> so that I can incrementally build (only) the "spark-examples" sub project
>> without the need of downloading or installation?
>
> As Sean suggest, you shouldn't need to install anything. After "mvn
> install", your local repo is a working Spark installation, and you can use
> spark-submit and other tool directly within it.
>
> You just need to remember to rebuild the assembly/ project when modifying
> Spark code (or the examples/ project when modifying examples).
>
>
> --
> Marcelo
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>
>
>
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
