Is mLI available? Where is the repo located?
—
Sent from Mailbox for iPhone
On Tue, Sep 10, 2013 at 10:45 PM, Gowtham N <gowtham.n.m...@gmail.com>
wrote:
> It worked.
> I was using old master for spark, which I forked many days a ago.
> On Tue, Sep 10, 2013 at 1:25 PM, Shivaram Venkataraman <
> shiva...@eecs.berkeley.edu> wrote:
>> For some more notes on how to debug this: After you do publish-local in
>> Spark, you should have a file in ~/.ivy2 that you can check for using
>> `ls
>> ~/.ivy2/local/org.apache.spark/spark-core_2.9.3/0.8.0-SNAPSHOT/jars/spark-core_2.9.3.jar`
>>
>> Or `sbt/sbt publish-local` also prints something like this on the console
>>
>> [info] published spark-core_2.9.3 to
>> /home/shivaram/.ivy2/local/org.apache.spark/spark-core_2.9.3/0.8.0-SNAPSHOT/jars/spark-core_2.9.3.jar
>>
>> After that MLI's build should be able to pick this jar up.
>>
>> Thanks
>> Shivaram
>>
>>
>>
>>
>> On Tue, Sep 10, 2013 at 1:14 PM, Gowtham N <gowtham.n.m...@gmail.com>wrote:
>>
>>> I did it as publish-local.
>>> I forked mesos/spark to gowthamnatarajan/spark. And I am using that. I
>>> forked a few days ago, but did a upstream update today.
>>>
>>> For safety, I will directly clone from mesos now.
>>>
>>>
>>>
>>> On Tue, Sep 10, 2013 at 1:10 PM, Shivaram Venkataraman <
>>> shiva...@eecs.berkeley.edu> wrote:
>>>
>>>> Did you check out spark from the master branch of github.com/mesos/spark?
>>>> The package names changed recently so you might need to pull. Also just
>>>> checking that you did publish-local in Spark (not public-local as
>>>> specified
>>>> in the email) ?
>>>>
>>>> Thanks
>>>> Shivaram
>>>>
>>>>
>>>> On Tue, Sep 10, 2013 at 1:01 PM, Gowtham N <gowtham.n.m...@gmail.com>
>>>> wrote:
>>>>
>>>> > still getting the same error.
>>>> >
>>>> > I have spark and MLI folder within a folder called git
>>>> >
>>>> > I did clean, package and public-local for spark.
>>>> > Then for mli did clean, and then package.
>>>> > I am still getting the error.
>>>> >
>>>> > [warn] ::::::::::::::::::::::::::::::::::::::::::::::
>>>> > [warn] :: UNRESOLVED DEPENDENCIES ::
>>>> > [warn] ::::::::::::::::::::::::::::::::::::::::::::::
>>>> > [warn] :: org.apache.spark#spark-core_2.9.3;0.8.0-SNAPSHOT: not found
>>>> > [warn] :: org.apache.spark#spark-mllib_2.9.3;0.8.0-SNAPSHOT: not found
>>>> > [warn] ::::::::::::::::::::::::::::::::::::::::::::::
>>>> > [error] {file:/Users/gowthamn/git/MLI/}default-0b9403/*:update:
>>>> > sbt.ResolveException: unresolved dependency:
>>>> > org.apache.spark#spark-core_2.9.3;0.8.0-SNAPSHOT: not found
>>>> > [error] unresolved dependency:
>>>> > org.apache.spark#spark-mllib_2.9.3;0.8.0-SNAPSHOT: not found
>>>> >
>>>> > should I modify the contents of build.sbt?
>>>> > Currently its
>>>> >
>>>> > libraryDependencies ++= Seq(
>>>> > "org.apache.spark" % "spark-core_2.9.3" % "0.8.0-SNAPSHOT",
>>>> > "org.apache.spark" % "spark-mllib_2.9.3" % "0.8.0-SNAPSHOT",
>>>> > "org.scalatest" %% "scalatest" % "1.9.1" % "test"
>>>> > )
>>>> >
>>>> > resolvers ++= Seq(
>>>> > "Typesafe" at "http://repo.typesafe.com/typesafe/releases";,
>>>> > "Scala Tools Snapshots" at "http://scala-tools.org/repo-snapshots/";,
>>>> > "ScalaNLP Maven2" at "http://repo.scalanlp.org/repo";,
>>>> > "Spray" at "http://repo.spray.cc";
>>>> > )
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > On Tue, Sep 10, 2013 at 11:58 AM, Evan R. Sparks <
>>>> evan.spa...@gmail.com
>>>> > >wrote:
>>>> >
>>>> > > Hi Gowtham,
>>>> > >
>>>> > > You'll need to do "sbt/sbt publish-local" in the spark directory
>>>> > > before trying to build MLI.
>>>> > >
>>>> > > - Evan
>>>> > >
>>>> > > On Tue, Sep 10, 2013 at 11:37 AM, Gowtham N <
>>>> gowtham.n.m...@gmail.com>
>>>> > > wrote:
>>>> > > > I cloned MLI, but am unable to compile it.
>>>> > > >
>>>> > > > I get the following dependency exception with other projects.
>>>> > > >
>>>> > > > org.apache.spark#spark-core_2.9.3;0.8.0-SNAPSHOT: not found
>>>> > > > org.apache.spark#spark-mllib_2.9.3;0.8.0-SNAPSHOT: not found
>>>> > > >
>>>> > > > Why am I getting this error?
>>>> > > >
>>>> > > > I did not change anything from build.sbt
>>>> > > >
>>>> > > > libraryDependencies ++= Seq(
>>>> > > > "org.apache.spark" % "spark-core_2.9.3" % "0.8.0-SNAPSHOT",
>>>> > > > "org.apache.spark" % "spark-mllib_2.9.3" % "0.8.0-SNAPSHOT",
>>>> > > > "org.scalatest" %% "scalatest" % "1.9.1" % "test"
>>>> > > > )
>>>> > >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > Gowtham Natarajan
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> Gowtham Natarajan
>>>
>>
>>
> --
> Gowtham Natarajan
