i suddenly also run into the issue that maven is trying to download
snapshots that dont exists for other sub projects.
did something change in the maven build?
does maven not have capability to smartly compile the other sub-projects
that a sub-project depends on?
i rather avoid "mvn install" since this creates a local maven repo. i have
been stung by that before (spend a day trying to do something and got weird
errors because some toy version i once build was stuck in my local maven
repo and it somehow got priority over a real maven repo).
On Fri, Dec 5, 2014 at 5:28 PM, Marcelo Vanzin <van...@cloudera.com> wrote:
> You can set SPARK_PREPEND_CLASSES=1 and it should pick your new mllib
> classes whenever you compile them.
>
> I don't see anything similar for examples/, so if you modify example
> code you need to re-build the examples module ("package" or "install"
> - just "compile" won't work, since you need to build the new jar).
>
> On Thu, Dec 4, 2014 at 10:23 PM, MEETHU MATHEW <meethu2...@yahoo.co.in>
> wrote:
> > Hi all,
> >
> > I made some code changes in mllib project and as mentioned in the
> previous
> > mails I did
> >
> > mvn install -pl mllib
> >
> > Now I run a program in examples using run-example, the new code is not
> > executing.Instead the previous code itself is running.
> >
> > But if I do an "mvn install" in the entire spark project , I can see the
> > new code running.But installing the entire spark takes a lot of time and
> so
> > its difficult to do this each time I make some changes.
> >
> > Can someone tell me how to compile mllib alone and get the changes
> working?
> >
> > Thanks & Regards,
> > Meethu M
> >
> >
> > On Friday, 28 November 2014 2:39 PM, MEETHU MATHEW <
> meethu2...@yahoo.co.in>
> > wrote:
> >
> >
> > Hi,
> > I have a similar problem.I modified the code in mllib and examples.
> > I did
> > mvn install -pl mllib
> > mvn install -pl examples
> >
> > But when I run the program in examples using run-example,the older
> version
> > of mllib (before the changes were made) is getting executed.
> > How to get the changes made in mllib while calling it from examples
> > project?
> >
> > Thanks & Regards,
> > Meethu M
> >
> >
> > On Monday, 24 November 2014 3:33 PM, Yiming (John) Zhang <
> sdi...@gmail.com>
> > wrote:
> >
> >
> > Thank you, Marcelo and Sean, "mvn install" is a good answer for my
> demands.
> >
> > -----邮件原件-----
> > 发件人: Marcelo Vanzin [mailto:van...@cloudera.com]
> > 发送时间: 2014年11月21日 1:47
> > 收件人: yiming zhang
> > 抄送: Sean Owen; user@spark.apache.org
> > 主题: Re: How to incrementally compile spark examples using mvn
> >
> > Hi Yiming,
> >
> > On Wed, Nov 19, 2014 at 5:35 PM, Yiming (John) Zhang <sdi...@gmail.com>
> > wrote:
> >> Thank you for your reply. I was wondering whether there is a method of
> >> reusing locally-built components without installing them? That is, if I
> have
> >> successfully built the spark project as a whole, how should I configure
> it
> >> so that I can incrementally build (only) the "spark-examples" sub
> project
> >> without the need of downloading or installation?
> >
> > As Sean suggest, you shouldn't need to install anything. After "mvn
> > install", your local repo is a working Spark installation, and you can
> use
> > spark-submit and other tool directly within it.
> >
> > You just need to remember to rebuild the assembly/ project when modifying
> > Spark code (or the examples/ project when modifying examples).
> >
> >
> > --
> > Marcelo
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> > For additional commands, e-mail: user-h...@spark.apache.org
> >
> >
> >
> >
>
>
>
> --
> Marcelo
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>
