Hi all,
sure ... if you send me the list, I can try to find out what's going on (or not
going on)
Chris
Am 19.05.20, 12:01 schrieb "Trevor Grant" <trevor.d.gr...@gmail.com>:
Hey- sorry for not following up here. I thought I had emailed this last
week ( I was actually just digging around to find out why no one had
responded ... the answer was I never sent the email.)
Built a docker container with Ubuntu 18.04 ( has java 11)
Kept failing on
```
java.lang.IllegalArgumentException: Unsupported class file major version 55
at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:166)
```
This is a known issue in Spark too, feel free to google it - but the gist
is- we won't be able to officially support Java 11, though a clever person
_can_ hack around this. Spark also does not support Java 11 for same
reasons.
Built another container with the following docker file:
```
FROM openjdk:8
RUN apt update && apt install git maven -y
RUN git clone https://github.com/chrisdutz/mahout.git /mahout
RUN cd /mahout && mvn clean package
```
This one fails in the old "Map Reduce" based Mahout. In the tests there's
1000 "NoClassDef" and Null pointed failures, which leads me to believe
something got moved in the refactor. (I've got a text file of the output I
can send too, but this, bc of Dockers, _should_ be very reproducible).
If someone else could confirm, that would be cool.
On Fri, May 8, 2020 at 1:20 PM Trevor Grant <trevor.d.gr...@gmail.com>
wrote:
> My next plan is to just make dockers of java 8/9/10 and try building in
> there. if it works cool, if it doesn't ill let chris know. What was your
> build result?
>
> On Fri, May 8, 2020 at 1:19 PM Trevor Grant <trevor.d.gr...@gmail.com>
> wrote:
>
>> No one came :(
>>
>> On Fri, May 8, 2020 at 1:08 PM Andrew Musselman <
>> andrew.mussel...@gmail.com> wrote:
>>
>>> Looks like my meeting ran over top of it; any outcomes?
>>>
>>> On Fri, May 8, 2020 at 06:57 Andrew Musselman <
>>> andrew.mussel...@gmail.com>
>>> wrote:
>>>
>>> > I'll be there at quarter after
>>> >
>>> > On Fri, May 8, 2020 at 06:51 Trevor Grant <trevor.d.gr...@gmail.com>
>>> > wrote:
>>> >
>>> >> Who can be there for this today?
>>> >>
>>> >> On Fri, Apr 24, 2020 at 8:31 AM Andrew Musselman <
>>> >> andrew.mussel...@gmail.com>
>>> >> wrote:
>>> >>
>>> >> > Alright, great; here's the link to join:
>>> >> >
>>> >> >
>>> >>
>>>
https://hangouts.google.com/hangouts/_/calendar/YW5kcmV3Lm11c3NlbG1hbkBnbWFpbC5jb20.4tg9vg3t51gjlco0ebl5siim1s
>>> >> >
>>> >> > On Fri, Apr 24, 2020 at 02:19 Christofer Dutz <
>>> >> christofer.d...@c-ware.de>
>>> >> > wrote:
>>> >> >
>>> >> > > Hi all,
>>> >> > >
>>> >> > > just found the email with the time for the call today ... that's
>>> >> 19:00 /
>>> >> > > 7pm here ... perfect.
>>> >> > > Would just need some information on how to join.
>>> >> > >
>>> >> > > Chris
>>> >> > >
>>> >> > >
>>> >> > > Am 20.04.20, 17:31 schrieb "Andrew Musselman" <
>>> >> > andrew.mussel...@gmail.com
>>> >> > > >:
>>> >> > >
>>> >> > > Thanks Chris, will take a look at your PR.
>>> >> > >
>>> >> > > I think we would be fine upgrading anything that is still
>>> making
>>> >> > > improvements, probably makes sense to discuss Friday on our
>>> call
>>> >> if
>>> >> > > you can
>>> >> > > make it.
>>> >> > >
>>> >> > > Best
>>> >> > > Andrew
>>> >> > >
>>> >> > > On Mon, Apr 20, 2020 at 1:53 AM Christofer Dutz <
>>> >> > > christofer.d...@c-ware.de>
>>> >> > > wrote:
>>> >> > >
>>> >> > > > Hi Folks,
>>> >> > > >
>>> >> > > > so I've now tested the build with java 1.8, 9, 10 and they
>>> work
>>> >> ...
>>> >> > > > 11 I'm getting errors about unsupported java major versions
>>> >> again
>>> >> > ...
>>> >> > > > guess there's some old library version in there somewhere.
>>> >> > > >
>>> >> > > > But at least I managed to get you out of this 1.7 trap.
>>> >> > > >
>>> >> > > > Chris
>>> >> > > >
>>> >> > > >
>>> >> > > > Am 20.04.20, 09:46 schrieb "Christofer Dutz" <
>>> >> > > christofer.d...@c-ware.de>:
>>> >> > > >
>>> >> > > > Hi folks,
>>> >> > > >
>>> >> > > > so I was now able to build (including all tests) with
>>> Java 8
>>> >> > and
>>> >> > > 9 ...
>>> >> > > > currently trying 10 ...
>>> >> > > >
>>> >> > > > Are there any objection that some maven dependencies
get
>>> >> > updated
>>> >> > > to
>>> >> > > > more recent versions? I mean ... the hbase-client you're
>>> using
>>> >> is
>>> >> > > more than
>>> >> > > > 5 years old ...
>>> >> > > >
>>> >> > > > Chris
>>> >> > > >
>>> >> > > >
>>> >> > > > Am 20.04.20, 00:29 schrieb "Andrew Musselman" <
>>> >> > > > andrew.mussel...@gmail.com>:
>>> >> > > >
>>> >> > > > No problem; would 10:00 a.m. Pacific next Friday
the
>>> >> 24th
>>> >> > > work for
>>> >> > > > you time
>>> >> > > > zone-wise?
>>> >> > > >
>>> >> > > > On Sun, Apr 19, 2020 at 12:15 PM Christofer Dutz <
>>> >> > > > christofer.d...@c-ware.de>
>>> >> > > > wrote:
>>> >> > > >
>>> >> > > > > Sorry ...
>>> >> > > > >
>>> >> > > > > didn't see your response ... into Mahout too deep
>>> ;-)
>>> >> > > > > Guess we have to postpone this to sometime over
>>> the
>>> >> week.
>>> >> > > > >
>>> >> > > > > Chris
>>> >> > > > >
>>> >> > > > >
>>> >> > > > > Am 19.04.20, 19:56 schrieb "Andrew Musselman" <
>>> >> > > > andrew.mussel...@gmail.com
>>> >> > > > > >:
>>> >> > > > >
>>> >> > > > > *what time
>>> >> > > > >
>>> >> > > > > On Sun, Apr 19, 2020 at 10:51 Andrew
>>> Musselman <
>>> >> > > > > andrew.mussel...@gmail.com>
>>> >> > > > > wrote:
>>> >> > > > >
>>> >> > > > > > I think it's safe to move to 1.8; yeah what
>>> >> tune is
>>> >> > > good
>>> >> > > > for you?
>>> >> > > > > I'm in
>>> >> > > > > > Pacific time zone and am flexible this
>>> >> afternoon.
>>> >> > > > > >
>>> >> > > > > > Trevor you free?
>>> >> > > > > >
>>> >> > > > > > On Sun, Apr 19, 2020 at 09:37 Christofer
>>> Dutz <
>>> >> > > > > christofer.d...@c-ware.de>
>>> >> > > > > > wrote:
>>> >> > > > > >
>>> >> > > > > >> Yikes! ... well guess then I can't help
you
>>> >> folks
>>> >> > > as it's
>>> >> > > > almost
>>> >> > > > > >> impossible to get my hands on a 1.7
>>> version.
>>> >> > > > > >>
>>> >> > > > > >> What's preventing you from going to 1.8+?
>>> >> > > > > >>
>>> >> > > > > >> Any your build says 1.8 and above:
>>> >> > > > > >> <requireJavaVersion>
>>> >> > > > > >>
<version>[1.8,)</version>
>>> >> > > > > >> </requireJavaVersion>
>>> >> > > > > >>
>>> >> > > > > >> Regarding the artifacts ... would it be ok
>>> to
>>> >> have
>>> >> > > the
>>> >> > > > maven
>>> >> > > > > artifacts
>>> >> > > > > >> using classifiers and perhaps the files in
>>> the
>>> >> > libs
>>> >> > > and
>>> >> > > > > distribution to
>>> >> > > > > >> follow the typical scala sheme?
>>> >> > > > > >>
>>> >> > > > > >> Chris
>>> >> > > > > >>
>>> >> > > > > >> Am 19.04.20, 17:56 schrieb "Trevor Grant"
<
>>> >> > > > trevor.d.gr...@gmail.com
>>> >> > > > > >:
>>> >> > > > > >>
>>> >> > > > > >> Yea, we have a requirement on 1.7. we
>>> need
>>> >> to
>>> >> > > get it
>>> >> > > > up to 8,
>>> >> > > > > but
>>> >> > > > > >> considered that a different issue.
>>> >> > > > > >>
>>> >> > > > > >> Maven throws warning, sbt breaks down
>>> >> entirely
>>> >> > > (when
>>> >> > > > importing)-
>>> >> > > > > >> hence why
>>> >> > > > > >> we were using a script to replace 2.11
>>> w
>>> >> 2.12
>>> >> > > > > >>
>>> >> > > > > >> On Sun, Apr 19, 2020, 10:33 AM
>>> Christofer
>>> >> > Dutz <
>>> >> > > > > >> christofer.d...@c-ware.de>
>>> >> > > > > >> wrote:
>>> >> > > > > >>
>>> >> > > > > >> > Well I have been compiling with
>>> various
>>> >> jdks
>>> >> > > from 8
>>> >> > > > to 14.
>>> >> > > > > However I
>>> >> > > > > >> > noticed that if I select a jdk and
>>> start
>>> >> the
>>> >> > > build
>>> >> > > > that the
>>> >> > > > > Scala
>>> >> > > > > >> parts
>>> >> > > > > >> > Seefahrt to the version in my
systems
>>> >> path.
>>> >> > > Which
>>> >> > > > then
>>> >> > > > > results in
>>> >> > > > > >> all sorts
>>> >> > > > > >> > of major version problems.
>>> >> > > > > >> >
>>> >> > > > > >> > For the Scalatest plugin I managed
to
>>> >> have
>>> >> > it
>>> >> > > use
>>> >> > > > the maven
>>> >> > > > > >> java.home...
>>> >> > > > > >> > The Scala compiler is being a little
>>> >> > trickyer.
>>> >> > > > > >> >
>>> >> > > > > >> > Will continue this evening. Keep
your
>>> >> > fingers
>>> >> > > > crossed.
>>> >> > > > > >> >
>>> >> > > > > >> > Also does maven totally not like
>>> >> variables
>>> >> > in
>>> >> > > > artifactids.
>>> >> > > > > >> >
>>> >> > > > > >> > Chris
>>> >> > > > > >> > ________________________________
>>> >> > > > > >> > Von: Trevor Grant <
>>> >> trevor.d.gr...@gmail.com
>>> >> > >
>>> >> > > > > >> > Gesendet: Sonntag, 19. April 2020
>>> 15:41
>>> >> > > > > >> > An: Mahout Dev List <
>>> >> dev@mahout.apache.org>
>>> >> > > > > >> > Betreff: Re: Hi ... need some help?
>>> >> > > > > >> >
>>> >> > > > > >> > Hey Chris,
>>> >> > > > > >> >
>>> >> > > > > >> > First of all- thank you so much for
>>> your
>>> >> > work
>>> >> > > so
>>> >> > > > far.
>>> >> > > > > >> >
>>> >> > > > > >> > The build 100% currently works, the
>>> only
>>> >> > > issue is
>>> >> > > > with
>>> >> > > > > releasing
>>> >> > > > > >> binaries.
>>> >> > > > > >> > Are you compiling w 1.7? Not really
>>> sure
>>> >> why
>>> >> > > > artifact IDs are
>>> >> > > > > >> changing?
>>> >> > > > > >> > That's very strange.
>>> >> > > > > >> >
>>> >> > > > > >> > To answer your question regarding
the
>>> >> > > community
>>> >> > > > block- no, it
>>> >> > > > > is
>>> >> > > > > >> not as if
>>> >> > > > > >> > there is a company that pays us to
>>> work
>>> >> on
>>> >> > > Mahout
>>> >> > > > and the
>>> >> > > > > rest is
>>> >> > > > > >> > community. What it means is that
>>> while we
>>> >> > > > appreciate those
>>> >> > > > > code
>>> >> > > > > >> > contributions, no one still actively
>>> >> > involved
>>> >> > > is
>>> >> > > > maintaining
>>> >> > > > > them
>>> >> > > > > >> and we
>>> >> > > > > >> > advise people to use at their own
>>> risk.
>>> >> The
>>> >> > > > refactor to a
>>> >> > > > > >> `community`
>>> >> > > > > >> > folder was meant to reflect the
>>> reality
>>> >> of
>>> >> > the
>>> >> > > > situation.
>>> >> > > > > >> >
>>> >> > > > > >> > The only test issues I was aware of
>>> were
>>> >> > with
>>> >> > > > Javadocs when
>>> >> > > > > trying
>>> >> > > > > >> to do a
>>> >> > > > > >> > release with Java 1.8+ those would
>>> fail
>>> >> due
>>> >> > to
>>> >> > > > formatting.
>>> >> > > > > >> >
>>> >> > > > > >> > I feel like you're hitting some
>>> unique
>>> >> > > issues, and
>>> >> > > > maybe we
>>> >> > > > > could
>>> >> > > > > >> help you
>>> >> > > > > >> > out / there may exist simple
>>> solutions.
>>> >> > > > > >> >
>>> >> > > > > >> > Thank you again for your help!
>>> >> > > > > >> >
>>> >> > > > > >> > tg
>>> >> > > > > >> >
>>> >> > > > > >> >
>>> >> > > > > >> >
>>> >> > > > > >> >
>>> >> > > > > >> > On Sun, Apr 19, 2020 at 2:17 AM
>>> >> Christofer
>>> >> > > Dutz <
>>> >> > > > > >> christofer.d...@c-ware.de
>>> >> > > > > >> > >
>>> >> > > > > >> > wrote:
>>> >> > > > > >> >
>>> >> > > > > >> > > Hi folks,
>>> >> > > > > >> > >
>>> >> > > > > >> > > So yesterday I invested several
>>> hours
>>> >> in
>>> >> > > cleaning
>>> >> > > > up your
>>> >> > > > > build.
>>> >> > > > > >> I got
>>> >> > > > > >> > > quite far, currently trying to get
>>> the
>>> >> > > tests to
>>> >> > > > pass. For
>>> >> > > > > some
>>> >> > > > > >> > > Scala-Java-major-version problems,
>>> but
>>> >> > > working on
>>> >> > > > fixing
>>> >> > > > > them.
>>> >> > > > > >> > >
>>> >> > > > > >> > > However sind things will be
>>> different.
>>> >> I
>>> >> > > hope
>>> >> > > > that's OK.
>>> >> > > > > >> Especially with
>>> >> > > > > >> > > the artifact ids.
>>> >> > > > > >> > >
>>> >> > > > > >> > > Just as a question: does the build
>>> >> > > currently work
>>> >> > > > at all?
>>> >> > > > > >> Especially in
>>> >> > > > > >> > > the community block I had to fix
>>> quite
>>> >> a
>>> >> > > few API
>>> >> > > > changes
>>> >> > > > > where
>>> >> > > > > >> the code
>>> >> > > > > >> > in
>>> >> > > > > >> > > the blocks were for older versions
>>> of
>>> >> > > libraries.
>>> >> > > > > >> > >
>>> >> > > > > >> > > I hope I get some more tests to
>>> pass
>>> >> > today.
>>> >> > > > > >> > >
>>> >> > > > > >> > > Chris
>>> >> > > > > >> > > ________________________________
>>> >> > > > > >> > > Von: Andrew Musselman <
>>> a...@apache.org>
>>> >> > > > > >> > > Gesendet: Donnerstag, 16. April
>>> 2020
>>> >> 20:35
>>> >> > > > > >> > > An: Mahout Dev List <
>>> >> > dev@mahout.apache.org>
>>> >> > > > > >> > > Betreff: Re: Hi ... need some
help?
>>> >> > > > > >> > >
>>> >> > > > > >> > > Looking forward to working on this
>>> with
>>> >> > you;
>>> >> > > > thanks again!
>>> >> > > > > >> > >
>>> >> > > > > >> > > On Thu, Apr 16, 2020 at 11:09 AM
>>> >> > Christofer
>>> >> > > Dutz <
>>> >> > > > > >> > > christofer.d...@c-ware.de>
>>> >> > > > > >> > > wrote:
>>> >> > > > > >> > >
>>> >> > > > > >> > > > Hi Andrew,
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > guess I'll start with the fork
>>> and
>>> >> > > contact you
>>> >> > > > folks on
>>> >> > > > > slack.
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > Chris
>>> >> > > > > >> > > >
>>> >> > > > > >> > > >
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > Am 16.04.20, 19:43 schrieb
>>> "Andrew
>>> >> > > Musselman" <
>>> >> > > > > a...@apache.org>:
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > Chris, thank you for your
>>> help..
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > Yeah if you fork what's in
>>> master
>>> >> > you
>>> >> > > can
>>> >> > > > see what
>>> >> > > > > state
>>> >> > > > > >> it's in;
>>> >> > > > > >> > we
>>> >> > > > > >> > > > are in
>>> >> > > > > >> > > > the #mahout channel in
>>> tge-asf
>>> >> slack
>>> >> > > and
>>> >> > > > this is also
>>> >> > > > > a
>>> >> > > > > >> fine way to
>>> >> > > > > >> > > > keep
>>> >> > > > > >> > > > track of discussion.
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > We could file a JIRA ticket
>>> as
>>> >> well,
>>> >> > > > however you
>>> >> > > > > prefer to
>>> >> > > > > >> work.
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > Best
>>> >> > > > > >> > > > Andrew
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > On Thu, Apr 16, 2020 at
06:59
>>> >> > > Christofer
>>> >> > > > Dutz <
>>> >> > > > > >> > > > christofer.d...@c-ware.de>
>>> >> > > > > >> > > > wrote:
>>> >> > > > > >> > > >
>>> >> > > > > >> > > > > Hi Trevor,
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > ok ... first of all ...
the
>>> >> Mahout
>>> >> > > PMC is
>>> >> > > > defining a
>>> >> > > > > >> "community
>>> >> > > > > >> > > > > maintained" library which
>>> is
>>> >> not
>>> >> > > > maintained by the
>>> >> > > > > mahout
>>> >> > > > > >> PMC?!?!
>>> >> > > > > >> > > > > I thought at Apache
>>> everything
>>> >> is
>>> >> > > about
>>> >> > > > Community
>>> >> > > > > over
>>> >> > > > > >> code. So
>>> >> > > > > >> > is
>>> >> > > > > >> > > a
>>> >> > > > > >> > > > > company driving the
>>> >> non-community
>>> >> > > stuff?
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > But back to your build
>>> issues:
>>> >> > > > > >> > > > > I had a look and I too
>>> >> encountered
>>> >> > > these
>>> >> > > > comments
>>> >> > > > > and
>>> >> > > > > >> remarks and
>>> >> > > > > >> > > > > sometimes patterns I
>>> recognized
>>> >> > and
>>> >> > > could
>>> >> > > > imagine
>>> >> > > > > why
>>> >> > > > > >> they were
>>> >> > > > > >> > > > created.
>>> >> > > > > >> > > > > Yes quite a bit of the
>>> build
>>> >> could
>>> >> > > be
>>> >> > > > cleaned up and
>>> >> > > > > >> simplified a
>>> >> > > > > >> > > > lot.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > So how about I create a
>>> fork
>>> >> and
>>> >> > > try to
>>> >> > > > do a
>>> >> > > > > cleanup of
>>> >> > > > > >> the
>>> >> > > > > >> > build.
>>> >> > > > > >> > > > > Usually I also leave
>>> comments
>>> >> > about
>>> >> > > what
>>> >> > > > I do as I
>>> >> > > > > hope
>>> >> > > > > >> I'll not
>>> >> > > > > >> > be
>>> >> > > > > >> > > > the
>>> >> > > > > >> > > > > only one maintaining a
>>> build
>>> >> and
>>> >> > > > documenting things
>>> >> > > > > helps
>>> >> > > > > >> people
>>> >> > > > > >> > > > feel more
>>> >> > > > > >> > > > > confident.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > However in some cases I
>>> will
>>> >> have
>>> >> > > > questions ... so
>>> >> > > > > would
>>> >> > > > > >> someone
>>> >> > > > > >> > be
>>> >> > > > > >> > > > > available on Slack for
>>> quick
>>> >> > > questions?
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Usually switching to
>>> another
>>> >> build
>>> >> > > system
>>> >> > > > does
>>> >> > > > > solve some
>>> >> > > > > >> > problems
>>> >> > > > > >> > > > ...
>>> >> > > > > >> > > > > mostly the reason to
>>> switch is
>>> >> > that
>>> >> > > it
>>> >> > > > solved the
>>> >> > > > > main
>>> >> > > > > >> problem
>>> >> > > > > >> > that
>>> >> > > > > >> > > > you are
>>> >> > > > > >> > > > > having with the old.
>>> >> > > > > >> > > > > However you usually notice
>>> too
>>> >> > late
>>> >> > > that
>>> >> > > > you get
>>> >> > > > > yourself
>>> >> > > > > >> a lot
>>> >> > > > > >> > of
>>> >> > > > > >> > > > new
>>> >> > > > > >> > > > > problems. I remember doing
>>> some
>>> >> > > contract
>>> >> > > > work for an
>>> >> > > > > >> insurance
>>> >> > > > > >> > > > company and
>>> >> > > > > >> > > > > they were totally down
>>> >> Maven-road
>>> >> > > but
>>> >> > > > then had to
>>> >> > > > > build
>>> >> > > > > >> something
>>> >> > > > > >> > > > with SBT
>>> >> > > > > >> > > > > ... in the end I compiled
>>> the
>>> >> > thing
>>> >> > > on my
>>> >> > > > laptop,
>>> >> > > > > copied
>>> >> > > > > >> it to a
>>> >> > > > > >> > > USB
>>> >> > > > > >> > > > stick
>>> >> > > > > >> > > > > and told the people what
>>> was on
>>> >> > the
>>> >> > > stick
>>> >> > > > and that
>>> >> > > > > I'll be
>>> >> > > > > >> > having a
>>> >> > > > > >> > > > coffee
>>> >> > > > > >> > > > > and will be back in 30
>>> minutes.
>>> >> > > When I
>>> >> > > > came back
>>> >> > > > > the sick
>>> >> > > > > >> wasn't
>>> >> > > > > >> > at
>>> >> > > > > >> > > > the
>>> >> > > > > >> > > > > same place and the build
>>> >> problem
>>> >> > was
>>> >> > > > "solved" ;-)
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > So I think it's quite good
>>> to
>>> >> > stick
>>> >> > > to
>>> >> > > > maven ...
>>> >> > > > > that is
>>> >> > > > > >> very
>>> >> > > > > >> > > > mature, you
>>> >> > > > > >> > > > > can do almost everything
>>> you
>>> >> want
>>> >> > > with it
>>> >> > > > and it
>>> >> > > > > >> integrates
>>> >> > > > > >> > > > perfectly into
>>> >> > > > > >> > > > > the Apache infrastructure.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > But that's just my
opinion.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > So if you want me to help,
>>> >> I'll be
>>> >> > > happy
>>> >> > > > to be of
>>> >> > > > > >> assistance.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Chris
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Am 16.04.20, 15:28 schrieb
>>> >> "Trevor
>>> >> > > Grant"
>>> >> > > > <
>>> >> > > > > >> > > trevor.d.gr...@gmail.com
>>> >> > > > > >> > > > >:
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Hey Christopher,
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > I would agree with
what
>>> >> Stevo
>>> >> > > > outlined but add
>>> >> > > > > some
>>> >> > > > > >> more
>>> >> > > > > >> > > context
>>> >> > > > > >> > > > and a
>>> >> > > > > >> > > > > couple related JIRA
>>> issues.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > For 0.14.0 We did a
big
>>> >> > > refactor and
>>> >> > > > finally
>>> >> > > > > moved the
>>> >> > > > > >> > > MapReduce
>>> >> > > > > >> > > > based
>>> >> > > > > >> > > > > Mahout all into what
we
>>> >> called
>>> >> > > > "community/"
>>> >> > > > > that is
>>> >> > > > > >> community
>>> >> > > > > >> > > > > maintained,
>>> >> > > > > >> > > > > which is to say, we're
>>> not
>>> >> > > > maintaining it
>>> >> > > > > anymore
>>> >> > > > > >> (sunset
>>> >> > > > > >> > > began I
>>> >> > > > > >> > > > > think in
>>> >> > > > > >> > > > > 2015).
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > But all of our POMs
>>> were so
>>> >> > > huge and
>>> >> > > > fat because
>>> >> > > > > >> they'd been
>>> >> > > > > >> > > > layered up
>>> >> > > > > >> > > > > over the years by
>>> people
>>> >> > coming
>>> >> > > and
>>> >> > > > going and
>>> >> > > > > >> dropping in
>>> >> > > > > >> > > code. I
>>> >> > > > > >> > > > > wouldn't
>>> >> > > > > >> > > > > call these drive- bys,
>>> its
>>> >> > just
>>> >> > > been
>>> >> > > > over 10
>>> >> > > > > years
>>> >> > > > > >> and people
>>> >> > > > > >> > > > come and
>>> >> > > > > >> > > > > go.
>>> >> > > > > >> > > > > Such is the life of
>>> Apache
>>> >> > > Projects.
>>> >> > > > So we had a
>>> >> > > > > >> situation
>>> >> > > > > >> > > where
>>> >> > > > > >> > > > a lot
>>> >> > > > > >> > > > > of
>>> >> > > > > >> > > > > the old Map Reduce
>>> stuff
>>> >> and
>>> >> > > the POMs
>>> >> > > > were
>>> >> > > > > considered
>>> >> > > > > >> > > > "old-magic" no
>>> >> > > > > >> > > > > one
>>> >> > > > > >> > > > > really knew how it was
>>> all
>>> >> > tied
>>> >> > > > together, but we
>>> >> > > > > >> didn't want
>>> >> > > > > >> > to
>>> >> > > > > >> > > > mess
>>> >> > > > > >> > > > > with
>>> >> > > > > >> > > > > it for fear of
breaking
>>> >> > > something in
>>> >> > > > the "new"
>>> >> > > > > Mahout
>>> >> > > > > >> (aka
>>> >> > > > > >> > > > Samsar)
>>> >> > > > > >> > > > > which is
>>> >> > > > > >> > > > > the Scala/Spark based
>>> >> library
>>> >> > > that it
>>> >> > > > is now*
>>> >> > > > > (to
>>> >> > > > > >> others in
>>> >> > > > > >> > the
>>> >> > > > > >> > > > > community:
>>> >> > > > > >> > > > > I know it runs on
other
>>> >> > > engines, but
>>> >> > > > for
>>> >> > > > > simplicity,
>>> >> > > > > >> I'm just
>>> >> > > > > >> > > > calling
>>> >> > > > > >> > > > > it
>>> >> > > > > >> > > > > "runs-on-spark").
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > For 0.14.0 We decided
>>> to
>>> >> trim
>>> >> > > out as
>>> >> > > > much of
>>> >> > > > > that
>>> >> > > > > >> which was
>>> >> > > > > >> > > > possible.
>>> >> > > > > >> > > > > We
>>> >> > > > > >> > > > > did some major
>>> liposuction
>>> >> on
>>> >> > > POMs,
>>> >> > > > re organized
>>> >> > > > > >> things, etc.
>>> >> > > > > >> > > > This was
>>> >> > > > > >> > > > > done
>>> >> > > > > >> > > > > by commenting out a
>>> >> section,
>>> >> > > then
>>> >> > > > seeing if it
>>> >> > > > > would
>>> >> > > > > >> still
>>> >> > > > > >> > > > build. So
>>> >> > > > > >> > > > > the
>>> >> > > > > >> > > > > current release
>>> >> > > > > >> > > > > _does_ build. And
>>> aside for
>>> >> > > some CLI
>>> >> > > > driver
>>> >> > > > > issues
>>> >> > > > > >> which are
>>> >> > > > > >> > > > outlined
>>> >> > > > > >> > > > > in
>>> >> > > > > >> > > > > [1], the project runs
>>> >> fairly
>>> >> > > smooth.
>>> >> > > > (An SBT
>>> >> > > > > would
>>> >> > > > > >> probably
>>> >> > > > > >> > > > solve [1],
>>> >> > > > > >> > > > > I
>>> >> > > > > >> > > > > believe Pat Ferrel has
>>> made
>>> >> > his
>>> >> > > own
>>> >> > > > SBT script
>>> >> > > > > to
>>> >> > > > > >> compile
>>> >> > > > > >> > > > Mahout, which
>>> >> > > > > >> > > > > solved that problem
for
>>> >> them).
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > The issue we ran into
>>> with
>>> >> the
>>> >> > > > releases (and the
>>> >> > > > > >> reason I
>>> >> > > > > >> > think
>>> >> > > > > >> > > > you're
>>> >> > > > > >> > > > > here), is that we also
>>> >> > somewhere
>>> >> > > > along the line
>>> >> > > > > >> commented out
>>> >> > > > > >> > > > something
>>> >> > > > > >> > > > > that was important to
>>> the
>>> >> > > release
>>> >> > > > process.
>>> >> > > > > Hence why
>>> >> > > > > >> 0.14.0
>>> >> > > > > >> > > > released
>>> >> > > > > >> > > > > source
>>> >> > > > > >> > > > > only.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Since 2008, there has
>>> been
>>> >> a
>>> >> > > lot of
>>> >> > > > great work
>>> >> > > > > on
>>> >> > > > > >> generating
>>> >> > > > > >> > > > plugins
>>> >> > > > > >> > > > > for
>>> >> > > > > >> > > > > doing Apache releases.
>>> >> Instead
>>> >> > > of the
>>> >> > > > awkward
>>> >> > > > > hacks
>>> >> > > > > >> that made
>>> >> > > > > >> > > up
>>> >> > > > > >> > > > the
>>> >> > > > > >> > > > > old
>>> >> > > > > >> > > > > poms (literally
>>> comments
>>> >> that
>>> >> > > said,
>>> >> > > > "this is a
>>> >> > > > > hack,
>>> >> > > > > >> there's
>>> >> > > > > >> > > > supposedly
>>> >> > > > > >> > > > > something better
coming
>>> >> from
>>> >> > > ..."
>>> >> > > > dated like
>>> >> > > > > 2012),
>>> >> > > > > >> we would
>>> >> > > > > >> > > > like to
>>> >> > > > > >> > > > > do it
>>> >> > > > > >> > > > > the "right way" and
>>> >> > incorporate
>>> >> > > the
>>> >> > > > appropriate
>>> >> > > > > >> plugins.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Refactoring to SBT was
>>> >> _one_
>>> >> > > proposed
>>> >> > > > solution.
>>> >> > > > > We're
>>> >> > > > > >> also OK
>>> >> > > > > >> > > > > continuing to
>>> >> > > > > >> > > > > use Maven, and I agree
>>> with
>>> >> > > what you
>>> >> > > > said about
>>> >> > > > > the
>>> >> > > > > >> cross
>>> >> > > > > >> > > > compiling. We
>>> >> > > > > >> > > > > actually have a script
>>> that
>>> >> > just
>>> >> > > > changes the
>>> >> > > > > scala
>>> >> > > > > >> version.
>>> >> > > > > >> > We
>>> >> > > > > >> > > > tried
>>> >> > > > > >> > > > > using
>>> >> > > > > >> > > > > the classifiers but
>>> there
>>> >> were
>>> >> > > issues
>>> >> > > > in SBT,
>>> >> > > > > but the
>>> >> > > > > >> way
>>> >> > > > > >> > > you're
>>> >> > > > > >> > > > > proposing
>>> >> > > > > >> > > > > sounds a lot more pro
>>> than
>>> >> the
>>> >> > > route
>>> >> > > > we were
>>> >> > > > > trying
>>> >> > > > > >> for.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > That said- we'd be OK
>>> just
>>> >> > > releasing
>>> >> > > > one
>>> >> > > > > scala/spark
>>> >> > > > > >> version
>>> >> > > > > >> > at
>>> >> > > > > >> > > > a time.
>>> >> > > > > >> > > > > But getting the
>>> convenience
>>> >> > > binaries
>>> >> > > > to
>>> >> > > > > >> release/publish would
>>> >> > > > > >> > > be
>>> >> > > > > >> > > > a
>>> >> > > > > >> > > > > major
>>> >> > > > > >> > > > > first step.
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > Also, we really
>>> appreciate
>>> >> the
>>> >> > > help,
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > tg
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > [1]
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > >
>>> >> > > > > >> > >
>>> >> > > > > >> >
>>> >> > > > > >>
>>> >> > > > >
>>> >> > > >
>>> >> > >
>>> >> >
>>> >>
>>>
https://issues.apache.org/jira/projects/MAHOUT/issues/MAHOUT-2093?filter=allopenissues
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > On Thu, Apr 16, 2020
at
>>> >> 4:50
>>> >> > AM
>>> >> > > > Christofer Dutz
>>> >> > > > > <
>>> >> > > > > >> > > > > christofer.d...@c-ware.de>
>>> >> > > > > >> > > > > wrote:
>>> >> > > > > >> > > > >
>>> >> > > > > >> > > > > > Hi Stevo,
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > so let me summarize
>>> what
>>> >> I
>>> >> > > > understood:
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > - There are some
>>> modules
>>> >> in
>>> >> > > mahout
>>> >> > > > that are
>>> >> > > > > built
>>> >> > > > > >> with
>>> >> > > > > >> > Scala,
>>> >> > > > > >> > > > some
>>> >> > > > > >> > > > > with
>>> >> > > > > >> > > > > > java and some with
>>> both
>>> >> (At
>>> >> > > least
>>> >> > > > that's what
>>> >> > > > > I see
>>> >> > > > > >> when
>>> >> > > > > >> > > > checking
>>> >> > > > > >> > > > > out the
>>> >> > > > > >> > > > > > project)
>>> >> > > > > >> > > > > > - The current build
>>> uses
>>> >> > > Scala 2.11
>>> >> > > > to build
>>> >> > > > > the
>>> >> > > > > >> Scala
>>> >> > > > > >> > code.
>>> >> > > > > >> > > > > > - The resulting
>>> libraries
>>> >> > are
>>> >> > > only
>>> >> > > > compatible
>>> >> > > > > with
>>> >> > > > > >> Scala
>>> >> > > > > >> > 2.11
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > Now you want to also
>>> >> publish
>>> >> > > > versions
>>> >> > > > > compatible
>>> >> > > > > >> with Scala
>>> >> > > > > >> > > > 2.12?
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > If that's the case I
>>> >> think
>>> >> > > Maven
>>> >> > > > could easily
>>> >> > > > > add
>>> >> > > > > >> multiple
>>> >> > > > > >> > > > executions
>>> >> > > > > >> > > > > > where each compile
>>> >> compiles
>>> >> > to
>>> >> > > > different
>>> >> > > > > output
>>> >> > > > > >> > directories:
>>> >> > > > > >> > > > > > - Java -->
>>> target/classes
>>> >> > > > > >> > > > > > - Scala 2.11 -->
>>> >> > > target/classes-2.11
>>> >> > > > > >> > > > > > - Scala 2.12 -->
>>> >> > > target/classes-2.12
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > Then the packaging
>>> would
>>> >> > also
>>> >> > > need
>>> >> > > > a second
>>> >> > > > > >> execution ...
>>> >> > > > > >> > > each
>>> >> > > > > >> > > > of the
>>> >> > > > > >> > > > > > executions bundling
>>> the
>>> >> > > classes and
>>> >> > > > the
>>> >> > > > > >> corresponding scala
>>> >> > > > > >> > > > output.
>>> >> > > > > >> > > > > > Ideally I would
>>> probably
>>> >> use
>>> >> > > maven
>>> >> > > > > classifiers to
>>> >> > > > > >> > distinguish
>>> >> > > > > >> > > > the
>>> >> > > > > >> > > > > > artifacts.
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > <dependency>
>>> >> > > > > >> > > > > >
>>> >> > > > <groupId>org.apache.mahout</groupId>
>>> >> > > > > >> > > > > >
>>> >> > > > <artifactId>mahout-spark</artifactId>
>>> >> > > > > >> > > > > >
>>> >> > > <version>14.1-SNAPSHOT</version>
>>> >> > > > > >> > > > > >
>>> >> > > <classifier>2.11</classifier>
>>> >> > > > > >> > > > > > </dependency>
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > Then it should all
>>> work
>>> >> in a
>>> >> > > normal
>>> >> > > > maven
>>> >> > > > > build. In
>>> >> > > > > >> the
>>> >> > > > > >> > > > > distributions you
>>> >> > > > > >> > > > > > could also filter
the
>>> >> > versions
>>> >> > > > according to
>>> >> > > > > their
>>> >> > > > > >> > > classifiers.
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > So if this is the
>>> case, I
>>> >> > > could
>>> >> > > > help you with
>>> >> > > > > this.
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > Chris
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > Am 16.04.20, 09:39
>>> >> schrieb
>>> >> > > "Stevo
>>> >> > > > Slavić" <
>>> >> > > > > >> > ssla...@gmail.com
>>> >> > > > > >> > > >:
>>> >> > > > > >> > > > > >
>>> >> > > > > >> > > > > > Disclaimer: I'm
>>> not
>>> >> > active
>>> >> > > > Mahout
>>> >> > > > > maintainer
>>> >> > > > > >> for quite
>>> >> > > > > >> > a
>>> >> > > > > >> > > > while,
>>> >> > > > > >> > > > > have
>>> >> > > > > >> > > > > > some
>>> >> > > > > >> > > > > > historical
>>> >> perspective,
>>> >> > > take it
>>> >> > > > with a
>>> >> > > > > grain of
>>> >> > > > > >> salt,
>>> >> > > > > >> > > > could be
>>> >> > > > > >> > > > > I'm
>>> >> > > > > >> > > >
>>> >
>>> >
>>>
>>
