Maven definitely compiles "what is needed", but not if you tell it to
only compile one module alone. Unless you have previously built and
installed the other local snapshot artifacts it needs, that invocation
can't proceed because you have restricted it to build one module whose
dependencies don't exist.
On Fri, Dec 5, 2014 at 6:44 PM, Koert Kuipers <ko...@tresata.com> wrote:
> i think what changed is that core now has dependencies on other sub
> projects. ok... so i am forced to install stuff because maven cannot compile
> "what is needed". i will install
>
> On Fri, Dec 5, 2014 at 7:12 PM, Koert Kuipers <ko...@tresata.com> wrote:
>>
>> i suddenly also run into the issue that maven is trying to download
>> snapshots that dont exists for other sub projects.
>>
>> did something change in the maven build?
>>
>> does maven not have capability to smartly compile the other sub-projects
>> that a sub-project depends on?
>>
>> i rather avoid "mvn install" since this creates a local maven repo. i have
>> been stung by that before (spend a day trying to do something and got weird
>> errors because some toy version i once build was stuck in my local maven
>> repo and it somehow got priority over a real maven repo).
>>
>> On Fri, Dec 5, 2014 at 5:28 PM, Marcelo Vanzin <van...@cloudera.com>
>> wrote:
>>>
>>> You can set SPARK_PREPEND_CLASSES=1 and it should pick your new mllib
>>> classes whenever you compile them.
>>>
>>> I don't see anything similar for examples/, so if you modify example
>>> code you need to re-build the examples module ("package" or "install"
>>> - just "compile" won't work, since you need to build the new jar).
>>>
>>> On Thu, Dec 4, 2014 at 10:23 PM, MEETHU MATHEW <meethu2...@yahoo.co.in>
>>> wrote:
>>> > Hi all,
>>> >
>>> > I made some code changes in mllib project and as mentioned in the
>>> > previous
>>> > mails I did
>>> >
>>> > mvn install -pl mllib
>>> >
>>> > Now I run a program in examples using run-example, the new code is not
>>> > executing.Instead the previous code itself is running.
>>> >
>>> > But if I do an "mvn install" in the entire spark project , I can see
>>> > the
>>> > new code running.But installing the entire spark takes a lot of time
>>> > and so
>>> > its difficult to do this each time I make some changes.
>>> >
>>> > Can someone tell me how to compile mllib alone and get the changes
>>> > working?
>>> >
>>> > Thanks & Regards,
>>> > Meethu M
>>> >
>>> >
>>> > On Friday, 28 November 2014 2:39 PM, MEETHU MATHEW
>>> > <meethu2...@yahoo.co.in>
>>> > wrote:
>>> >
>>> >
>>> > Hi,
>>> > I have a similar problem.I modified the code in mllib and examples.
>>> > I did
>>> > mvn install -pl mllib
>>> > mvn install -pl examples
>>> >
>>> > But when I run the program in examples using run-example,the older
>>> > version
>>> > of mllib (before the changes were made) is getting executed.
>>> > How to get the changes made in mllib while calling it from examples
>>> > project?
>>> >
>>> > Thanks & Regards,
>>> > Meethu M
>>> >
>>> >
>>> > On Monday, 24 November 2014 3:33 PM, Yiming (John) Zhang
>>> > <sdi...@gmail.com>
>>> > wrote:
>>> >
>>> >
>>> > Thank you, Marcelo and Sean, "mvn install" is a good answer for my
>>> > demands.
>>> >
>>> > -----邮件原件-----
>>> > 发件人: Marcelo Vanzin [mailto:van...@cloudera.com]
>>> > 发送时间: 2014年11月21日 1:47
>>> > 收件人: yiming zhang
>>> > 抄送: Sean Owen; user@spark.apache.org
>>> > 主题: Re: How to incrementally compile spark examples using mvn
>>> >
>>> > Hi Yiming,
>>> >
>>> > On Wed, Nov 19, 2014 at 5:35 PM, Yiming (John) Zhang <sdi...@gmail.com>
>>> > wrote:
>>> >> Thank you for your reply. I was wondering whether there is a method of
>>> >> reusing locally-built components without installing them? That is, if
>>> >> I have
>>> >> successfully built the spark project as a whole, how should I
>>> >> configure it
>>> >> so that I can incrementally build (only) the "spark-examples" sub
>>> >> project
>>> >> without the need of downloading or installation?
>>> >
>>> > As Sean suggest, you shouldn't need to install anything. After "mvn
>>> > install", your local repo is a working Spark installation, and you can
>>> > use
>>> > spark-submit and other tool directly within it.
>>> >
>>> > You just need to remember to rebuild the assembly/ project when
>>> > modifying
>>> > Spark code (or the examples/ project when modifying examples).
>>> >
>>> >
>>> > --
>>> > Marcelo
>>> >
>>> >
>>> > ---------------------------------------------------------------------
>>> > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>>> > For additional commands, e-mail: user-h...@spark.apache.org
>>> >
>>> >
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Marcelo
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>>> For additional commands, e-mail: user-h...@spark.apache.org
>>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
