My next plan is to just make dockers of java 8/9/10 and try building in there. if it works cool, if it doesn't ill let chris know. What was your build result?
On Fri, May 8, 2020 at 1:19 PM Trevor Grant <trevor.d.gr...@gmail.com> wrote: > No one came :( > > On Fri, May 8, 2020 at 1:08 PM Andrew Musselman < > andrew.mussel...@gmail.com> wrote: > >> Looks like my meeting ran over top of it; any outcomes? >> >> On Fri, May 8, 2020 at 06:57 Andrew Musselman <andrew.mussel...@gmail.com >> > >> wrote: >> >> > I'll be there at quarter after >> > >> > On Fri, May 8, 2020 at 06:51 Trevor Grant <trevor.d.gr...@gmail.com> >> > wrote: >> > >> >> Who can be there for this today? >> >> >> >> On Fri, Apr 24, 2020 at 8:31 AM Andrew Musselman < >> >> andrew.mussel...@gmail.com> >> >> wrote: >> >> >> >> > Alright, great; here's the link to join: >> >> > >> >> > >> >> >> https://hangouts.google.com/hangouts/_/calendar/YW5kcmV3Lm11c3NlbG1hbkBnbWFpbC5jb20.4tg9vg3t51gjlco0ebl5siim1s >> >> > >> >> > On Fri, Apr 24, 2020 at 02:19 Christofer Dutz < >> >> christofer.d...@c-ware.de> >> >> > wrote: >> >> > >> >> > > Hi all, >> >> > > >> >> > > just found the email with the time for the call today ... that's >> >> 19:00 / >> >> > > 7pm here ... perfect. >> >> > > Would just need some information on how to join. >> >> > > >> >> > > Chris >> >> > > >> >> > > >> >> > > Am 20.04.20, 17:31 schrieb "Andrew Musselman" < >> >> > andrew.mussel...@gmail.com >> >> > > >: >> >> > > >> >> > > Thanks Chris, will take a look at your PR. >> >> > > >> >> > > I think we would be fine upgrading anything that is still >> making >> >> > > improvements, probably makes sense to discuss Friday on our >> call >> >> if >> >> > > you can >> >> > > make it. >> >> > > >> >> > > Best >> >> > > Andrew >> >> > > >> >> > > On Mon, Apr 20, 2020 at 1:53 AM Christofer Dutz < >> >> > > christofer.d...@c-ware.de> >> >> > > wrote: >> >> > > >> >> > > > Hi Folks, >> >> > > > >> >> > > > so I've now tested the build with java 1.8, 9, 10 and they >> work >> >> ... >> >> > > > 11 I'm getting errors about unsupported java major versions >> >> again >> >> > ... >> >> > > > guess there's some old library version in there somewhere. >> >> > > > >> >> > > > But at least I managed to get you out of this 1.7 trap. >> >> > > > >> >> > > > Chris >> >> > > > >> >> > > > >> >> > > > Am 20.04.20, 09:46 schrieb "Christofer Dutz" < >> >> > > christofer.d...@c-ware.de>: >> >> > > > >> >> > > > Hi folks, >> >> > > > >> >> > > > so I was now able to build (including all tests) with >> Java 8 >> >> > and >> >> > > 9 ... >> >> > > > currently trying 10 ... >> >> > > > >> >> > > > Are there any objection that some maven dependencies get >> >> > updated >> >> > > to >> >> > > > more recent versions? I mean ... the hbase-client you're >> using >> >> is >> >> > > more than >> >> > > > 5 years old ... >> >> > > > >> >> > > > Chris >> >> > > > >> >> > > > >> >> > > > Am 20.04.20, 00:29 schrieb "Andrew Musselman" < >> >> > > > andrew.mussel...@gmail.com>: >> >> > > > >> >> > > > No problem; would 10:00 a.m. Pacific next Friday the >> >> 24th >> >> > > work for >> >> > > > you time >> >> > > > zone-wise? >> >> > > > >> >> > > > On Sun, Apr 19, 2020 at 12:15 PM Christofer Dutz < >> >> > > > christofer.d...@c-ware.de> >> >> > > > wrote: >> >> > > > >> >> > > > > Sorry ... >> >> > > > > >> >> > > > > didn't see your response ... into Mahout too deep >> ;-) >> >> > > > > Guess we have to postpone this to sometime over the >> >> week. >> >> > > > > >> >> > > > > Chris >> >> > > > > >> >> > > > > >> >> > > > > Am 19.04.20, 19:56 schrieb "Andrew Musselman" < >> >> > > > andrew.mussel...@gmail.com >> >> > > > > >: >> >> > > > > >> >> > > > > *what time >> >> > > > > >> >> > > > > On Sun, Apr 19, 2020 at 10:51 Andrew Musselman >> < >> >> > > > > andrew.mussel...@gmail.com> >> >> > > > > wrote: >> >> > > > > >> >> > > > > > I think it's safe to move to 1.8; yeah what >> >> tune is >> >> > > good >> >> > > > for you? >> >> > > > > I'm in >> >> > > > > > Pacific time zone and am flexible this >> >> afternoon. >> >> > > > > > >> >> > > > > > Trevor you free? >> >> > > > > > >> >> > > > > > On Sun, Apr 19, 2020 at 09:37 Christofer >> Dutz < >> >> > > > > christofer.d...@c-ware.de> >> >> > > > > > wrote: >> >> > > > > > >> >> > > > > >> Yikes! ... well guess then I can't help you >> >> folks >> >> > > as it's >> >> > > > almost >> >> > > > > >> impossible to get my hands on a 1.7 version. >> >> > > > > >> >> >> > > > > >> What's preventing you from going to 1.8+? >> >> > > > > >> >> >> > > > > >> Any your build says 1.8 and above: >> >> > > > > >> <requireJavaVersion> >> >> > > > > >> <version>[1.8,)</version> >> >> > > > > >> </requireJavaVersion> >> >> > > > > >> >> >> > > > > >> Regarding the artifacts ... would it be ok >> to >> >> have >> >> > > the >> >> > > > maven >> >> > > > > artifacts >> >> > > > > >> using classifiers and perhaps the files in >> the >> >> > libs >> >> > > and >> >> > > > > distribution to >> >> > > > > >> follow the typical scala sheme? >> >> > > > > >> >> >> > > > > >> Chris >> >> > > > > >> >> >> > > > > >> Am 19.04.20, 17:56 schrieb "Trevor Grant" < >> >> > > > trevor.d.gr...@gmail.com >> >> > > > > >: >> >> > > > > >> >> >> > > > > >> Yea, we have a requirement on 1.7. we >> need >> >> to >> >> > > get it >> >> > > > up to 8, >> >> > > > > but >> >> > > > > >> considered that a different issue. >> >> > > > > >> >> >> > > > > >> Maven throws warning, sbt breaks down >> >> entirely >> >> > > (when >> >> > > > importing)- >> >> > > > > >> hence why >> >> > > > > >> we were using a script to replace 2.11 w >> >> 2.12 >> >> > > > > >> >> >> > > > > >> On Sun, Apr 19, 2020, 10:33 AM >> Christofer >> >> > Dutz < >> >> > > > > >> christofer.d...@c-ware.de> >> >> > > > > >> wrote: >> >> > > > > >> >> >> > > > > >> > Well I have been compiling with >> various >> >> jdks >> >> > > from 8 >> >> > > > to 14. >> >> > > > > However I >> >> > > > > >> > noticed that if I select a jdk and >> start >> >> the >> >> > > build >> >> > > > that the >> >> > > > > Scala >> >> > > > > >> parts >> >> > > > > >> > Seefahrt to the version in my systems >> >> path. >> >> > > Which >> >> > > > then >> >> > > > > results in >> >> > > > > >> all sorts >> >> > > > > >> > of major version problems. >> >> > > > > >> > >> >> > > > > >> > For the Scalatest plugin I managed to >> >> have >> >> > it >> >> > > use >> >> > > > the maven >> >> > > > > >> java.home... >> >> > > > > >> > The Scala compiler is being a little >> >> > trickyer. >> >> > > > > >> > >> >> > > > > >> > Will continue this evening. Keep your >> >> > fingers >> >> > > > crossed. >> >> > > > > >> > >> >> > > > > >> > Also does maven totally not like >> >> variables >> >> > in >> >> > > > artifactids. >> >> > > > > >> > >> >> > > > > >> > Chris >> >> > > > > >> > ________________________________ >> >> > > > > >> > Von: Trevor Grant < >> >> trevor.d.gr...@gmail.com >> >> > > >> >> > > > > >> > Gesendet: Sonntag, 19. April 2020 >> 15:41 >> >> > > > > >> > An: Mahout Dev List < >> >> dev@mahout.apache.org> >> >> > > > > >> > Betreff: Re: Hi ... need some help? >> >> > > > > >> > >> >> > > > > >> > Hey Chris, >> >> > > > > >> > >> >> > > > > >> > First of all- thank you so much for >> your >> >> > work >> >> > > so >> >> > > > far. >> >> > > > > >> > >> >> > > > > >> > The build 100% currently works, the >> only >> >> > > issue is >> >> > > > with >> >> > > > > releasing >> >> > > > > >> binaries. >> >> > > > > >> > Are you compiling w 1.7? Not really >> sure >> >> why >> >> > > > artifact IDs are >> >> > > > > >> changing? >> >> > > > > >> > That's very strange. >> >> > > > > >> > >> >> > > > > >> > To answer your question regarding the >> >> > > community >> >> > > > block- no, it >> >> > > > > is >> >> > > > > >> not as if >> >> > > > > >> > there is a company that pays us to >> work >> >> on >> >> > > Mahout >> >> > > > and the >> >> > > > > rest is >> >> > > > > >> > community. What it means is that >> while we >> >> > > > appreciate those >> >> > > > > code >> >> > > > > >> > contributions, no one still actively >> >> > involved >> >> > > is >> >> > > > maintaining >> >> > > > > them >> >> > > > > >> and we >> >> > > > > >> > advise people to use at their own >> risk. >> >> The >> >> > > > refactor to a >> >> > > > > >> `community` >> >> > > > > >> > folder was meant to reflect the >> reality >> >> of >> >> > the >> >> > > > situation. >> >> > > > > >> > >> >> > > > > >> > The only test issues I was aware of >> were >> >> > with >> >> > > > Javadocs when >> >> > > > > trying >> >> > > > > >> to do a >> >> > > > > >> > release with Java 1.8+ those would >> fail >> >> due >> >> > to >> >> > > > formatting. >> >> > > > > >> > >> >> > > > > >> > I feel like you're hitting some unique >> >> > > issues, and >> >> > > > maybe we >> >> > > > > could >> >> > > > > >> help you >> >> > > > > >> > out / there may exist simple >> solutions. >> >> > > > > >> > >> >> > > > > >> > Thank you again for your help! >> >> > > > > >> > >> >> > > > > >> > tg >> >> > > > > >> > >> >> > > > > >> > >> >> > > > > >> > >> >> > > > > >> > >> >> > > > > >> > On Sun, Apr 19, 2020 at 2:17 AM >> >> Christofer >> >> > > Dutz < >> >> > > > > >> christofer.d...@c-ware.de >> >> > > > > >> > > >> >> > > > > >> > wrote: >> >> > > > > >> > >> >> > > > > >> > > Hi folks, >> >> > > > > >> > > >> >> > > > > >> > > So yesterday I invested several >> hours >> >> in >> >> > > cleaning >> >> > > > up your >> >> > > > > build. >> >> > > > > >> I got >> >> > > > > >> > > quite far, currently trying to get >> the >> >> > > tests to >> >> > > > pass. For >> >> > > > > some >> >> > > > > >> > > Scala-Java-major-version problems, >> but >> >> > > working on >> >> > > > fixing >> >> > > > > them. >> >> > > > > >> > > >> >> > > > > >> > > However sind things will be >> different. >> >> I >> >> > > hope >> >> > > > that's OK. >> >> > > > > >> Especially with >> >> > > > > >> > > the artifact ids. >> >> > > > > >> > > >> >> > > > > >> > > Just as a question: does the build >> >> > > currently work >> >> > > > at all? >> >> > > > > >> Especially in >> >> > > > > >> > > the community block I had to fix >> quite >> >> a >> >> > > few API >> >> > > > changes >> >> > > > > where >> >> > > > > >> the code >> >> > > > > >> > in >> >> > > > > >> > > the blocks were for older versions >> of >> >> > > libraries. >> >> > > > > >> > > >> >> > > > > >> > > I hope I get some more tests to pass >> >> > today. >> >> > > > > >> > > >> >> > > > > >> > > Chris >> >> > > > > >> > > ________________________________ >> >> > > > > >> > > Von: Andrew Musselman < >> a...@apache.org> >> >> > > > > >> > > Gesendet: Donnerstag, 16. April 2020 >> >> 20:35 >> >> > > > > >> > > An: Mahout Dev List < >> >> > dev@mahout.apache.org> >> >> > > > > >> > > Betreff: Re: Hi ... need some help? >> >> > > > > >> > > >> >> > > > > >> > > Looking forward to working on this >> with >> >> > you; >> >> > > > thanks again! >> >> > > > > >> > > >> >> > > > > >> > > On Thu, Apr 16, 2020 at 11:09 AM >> >> > Christofer >> >> > > Dutz < >> >> > > > > >> > > christofer.d...@c-ware.de> >> >> > > > > >> > > wrote: >> >> > > > > >> > > >> >> > > > > >> > > > Hi Andrew, >> >> > > > > >> > > > >> >> > > > > >> > > > guess I'll start with the fork and >> >> > > contact you >> >> > > > folks on >> >> > > > > slack. >> >> > > > > >> > > > >> >> > > > > >> > > > Chris >> >> > > > > >> > > > >> >> > > > > >> > > > >> >> > > > > >> > > > >> >> > > > > >> > > > Am 16.04.20, 19:43 schrieb "Andrew >> >> > > Musselman" < >> >> > > > > a...@apache.org>: >> >> > > > > >> > > > >> >> > > > > >> > > > Chris, thank you for your >> help.. >> >> > > > > >> > > > >> >> > > > > >> > > > Yeah if you fork what's in >> master >> >> > you >> >> > > can >> >> > > > see what >> >> > > > > state >> >> > > > > >> it's in; >> >> > > > > >> > we >> >> > > > > >> > > > are in >> >> > > > > >> > > > the #mahout channel in tge-asf >> >> slack >> >> > > and >> >> > > > this is also >> >> > > > > a >> >> > > > > >> fine way to >> >> > > > > >> > > > keep >> >> > > > > >> > > > track of discussion. >> >> > > > > >> > > > >> >> > > > > >> > > > We could file a JIRA ticket as >> >> well, >> >> > > > however you >> >> > > > > prefer to >> >> > > > > >> work. >> >> > > > > >> > > > >> >> > > > > >> > > > Best >> >> > > > > >> > > > Andrew >> >> > > > > >> > > > >> >> > > > > >> > > > On Thu, Apr 16, 2020 at 06:59 >> >> > > Christofer >> >> > > > Dutz < >> >> > > > > >> > > > christofer.d...@c-ware.de> >> >> > > > > >> > > > wrote: >> >> > > > > >> > > > >> >> > > > > >> > > > > Hi Trevor, >> >> > > > > >> > > > > >> >> > > > > >> > > > > ok ... first of all ... the >> >> Mahout >> >> > > PMC is >> >> > > > defining a >> >> > > > > >> "community >> >> > > > > >> > > > > maintained" library which is >> >> not >> >> > > > maintained by the >> >> > > > > mahout >> >> > > > > >> PMC?!?! >> >> > > > > >> > > > > I thought at Apache >> everything >> >> is >> >> > > about >> >> > > > Community >> >> > > > > over >> >> > > > > >> code. So >> >> > > > > >> > is >> >> > > > > >> > > a >> >> > > > > >> > > > > company driving the >> >> non-community >> >> > > stuff? >> >> > > > > >> > > > > >> >> > > > > >> > > > > But back to your build >> issues: >> >> > > > > >> > > > > I had a look and I too >> >> encountered >> >> > > these >> >> > > > comments >> >> > > > > and >> >> > > > > >> remarks and >> >> > > > > >> > > > > sometimes patterns I >> recognized >> >> > and >> >> > > could >> >> > > > imagine >> >> > > > > why >> >> > > > > >> they were >> >> > > > > >> > > > created. >> >> > > > > >> > > > > Yes quite a bit of the build >> >> could >> >> > > be >> >> > > > cleaned up and >> >> > > > > >> simplified a >> >> > > > > >> > > > lot. >> >> > > > > >> > > > > >> >> > > > > >> > > > > So how about I create a fork >> >> and >> >> > > try to >> >> > > > do a >> >> > > > > cleanup of >> >> > > > > >> the >> >> > > > > >> > build. >> >> > > > > >> > > > > Usually I also leave >> comments >> >> > about >> >> > > what >> >> > > > I do as I >> >> > > > > hope >> >> > > > > >> I'll not >> >> > > > > >> > be >> >> > > > > >> > > > the >> >> > > > > >> > > > > only one maintaining a build >> >> and >> >> > > > documenting things >> >> > > > > helps >> >> > > > > >> people >> >> > > > > >> > > > feel more >> >> > > > > >> > > > > confident. >> >> > > > > >> > > > > >> >> > > > > >> > > > > However in some cases I will >> >> have >> >> > > > questions ... so >> >> > > > > would >> >> > > > > >> someone >> >> > > > > >> > be >> >> > > > > >> > > > > available on Slack for quick >> >> > > questions? >> >> > > > > >> > > > > >> >> > > > > >> > > > > Usually switching to another >> >> build >> >> > > system >> >> > > > does >> >> > > > > solve some >> >> > > > > >> > problems >> >> > > > > >> > > > ... >> >> > > > > >> > > > > mostly the reason to switch >> is >> >> > that >> >> > > it >> >> > > > solved the >> >> > > > > main >> >> > > > > >> problem >> >> > > > > >> > that >> >> > > > > >> > > > you are >> >> > > > > >> > > > > having with the old. >> >> > > > > >> > > > > However you usually notice >> too >> >> > late >> >> > > that >> >> > > > you get >> >> > > > > yourself >> >> > > > > >> a lot >> >> > > > > >> > of >> >> > > > > >> > > > new >> >> > > > > >> > > > > problems. I remember doing >> some >> >> > > contract >> >> > > > work for an >> >> > > > > >> insurance >> >> > > > > >> > > > company and >> >> > > > > >> > > > > they were totally down >> >> Maven-road >> >> > > but >> >> > > > then had to >> >> > > > > build >> >> > > > > >> something >> >> > > > > >> > > > with SBT >> >> > > > > >> > > > > ... in the end I compiled >> the >> >> > thing >> >> > > on my >> >> > > > laptop, >> >> > > > > copied >> >> > > > > >> it to a >> >> > > > > >> > > USB >> >> > > > > >> > > > stick >> >> > > > > >> > > > > and told the people what >> was on >> >> > the >> >> > > stick >> >> > > > and that >> >> > > > > I'll be >> >> > > > > >> > having a >> >> > > > > >> > > > coffee >> >> > > > > >> > > > > and will be back in 30 >> minutes. >> >> > > When I >> >> > > > came back >> >> > > > > the sick >> >> > > > > >> wasn't >> >> > > > > >> > at >> >> > > > > >> > > > the >> >> > > > > >> > > > > same place and the build >> >> problem >> >> > was >> >> > > > "solved" ;-) >> >> > > > > >> > > > > >> >> > > > > >> > > > > So I think it's quite good >> to >> >> > stick >> >> > > to >> >> > > > maven ... >> >> > > > > that is >> >> > > > > >> very >> >> > > > > >> > > > mature, you >> >> > > > > >> > > > > can do almost everything you >> >> want >> >> > > with it >> >> > > > and it >> >> > > > > >> integrates >> >> > > > > >> > > > perfectly into >> >> > > > > >> > > > > the Apache infrastructure. >> >> > > > > >> > > > > >> >> > > > > >> > > > > But that's just my opinion. >> >> > > > > >> > > > > >> >> > > > > >> > > > > So if you want me to help, >> >> I'll be >> >> > > happy >> >> > > > to be of >> >> > > > > >> assistance. >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > > Chris >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > > Am 16.04.20, 15:28 schrieb >> >> "Trevor >> >> > > Grant" >> >> > > > < >> >> > > > > >> > > trevor.d.gr...@gmail.com >> >> > > > > >> > > > >: >> >> > > > > >> > > > > >> >> > > > > >> > > > > Hey Christopher, >> >> > > > > >> > > > > >> >> > > > > >> > > > > I would agree with what >> >> Stevo >> >> > > > outlined but add >> >> > > > > some >> >> > > > > >> more >> >> > > > > >> > > context >> >> > > > > >> > > > and a >> >> > > > > >> > > > > couple related JIRA >> issues. >> >> > > > > >> > > > > >> >> > > > > >> > > > > For 0.14.0 We did a big >> >> > > refactor and >> >> > > > finally >> >> > > > > moved the >> >> > > > > >> > > MapReduce >> >> > > > > >> > > > based >> >> > > > > >> > > > > Mahout all into what we >> >> called >> >> > > > "community/" >> >> > > > > that is >> >> > > > > >> community >> >> > > > > >> > > > > maintained, >> >> > > > > >> > > > > which is to say, we're >> not >> >> > > > maintaining it >> >> > > > > anymore >> >> > > > > >> (sunset >> >> > > > > >> > > began I >> >> > > > > >> > > > > think in >> >> > > > > >> > > > > 2015). >> >> > > > > >> > > > > >> >> > > > > >> > > > > But all of our POMs >> were so >> >> > > huge and >> >> > > > fat because >> >> > > > > >> they'd been >> >> > > > > >> > > > layered up >> >> > > > > >> > > > > over the years by people >> >> > coming >> >> > > and >> >> > > > going and >> >> > > > > >> dropping in >> >> > > > > >> > > code. I >> >> > > > > >> > > > > wouldn't >> >> > > > > >> > > > > call these drive- bys, >> its >> >> > just >> >> > > been >> >> > > > over 10 >> >> > > > > years >> >> > > > > >> and people >> >> > > > > >> > > > come and >> >> > > > > >> > > > > go. >> >> > > > > >> > > > > Such is the life of >> Apache >> >> > > Projects. >> >> > > > So we had a >> >> > > > > >> situation >> >> > > > > >> > > where >> >> > > > > >> > > > a lot >> >> > > > > >> > > > > of >> >> > > > > >> > > > > the old Map Reduce stuff >> >> and >> >> > > the POMs >> >> > > > were >> >> > > > > considered >> >> > > > > >> > > > "old-magic" no >> >> > > > > >> > > > > one >> >> > > > > >> > > > > really knew how it was >> all >> >> > tied >> >> > > > together, but we >> >> > > > > >> didn't want >> >> > > > > >> > to >> >> > > > > >> > > > mess >> >> > > > > >> > > > > with >> >> > > > > >> > > > > it for fear of breaking >> >> > > something in >> >> > > > the "new" >> >> > > > > Mahout >> >> > > > > >> (aka >> >> > > > > >> > > > Samsar) >> >> > > > > >> > > > > which is >> >> > > > > >> > > > > the Scala/Spark based >> >> library >> >> > > that it >> >> > > > is now* >> >> > > > > (to >> >> > > > > >> others in >> >> > > > > >> > the >> >> > > > > >> > > > > community: >> >> > > > > >> > > > > I know it runs on other >> >> > > engines, but >> >> > > > for >> >> > > > > simplicity, >> >> > > > > >> I'm just >> >> > > > > >> > > > calling >> >> > > > > >> > > > > it >> >> > > > > >> > > > > "runs-on-spark"). >> >> > > > > >> > > > > >> >> > > > > >> > > > > For 0.14.0 We decided to >> >> trim >> >> > > out as >> >> > > > much of >> >> > > > > that >> >> > > > > >> which was >> >> > > > > >> > > > possible. >> >> > > > > >> > > > > We >> >> > > > > >> > > > > did some major >> liposuction >> >> on >> >> > > POMs, >> >> > > > re organized >> >> > > > > >> things, etc. >> >> > > > > >> > > > This was >> >> > > > > >> > > > > done >> >> > > > > >> > > > > by commenting out a >> >> section, >> >> > > then >> >> > > > seeing if it >> >> > > > > would >> >> > > > > >> still >> >> > > > > >> > > > build. So >> >> > > > > >> > > > > the >> >> > > > > >> > > > > current release >> >> > > > > >> > > > > _does_ build. And aside >> for >> >> > > some CLI >> >> > > > driver >> >> > > > > issues >> >> > > > > >> which are >> >> > > > > >> > > > outlined >> >> > > > > >> > > > > in >> >> > > > > >> > > > > [1], the project runs >> >> fairly >> >> > > smooth. >> >> > > > (An SBT >> >> > > > > would >> >> > > > > >> probably >> >> > > > > >> > > > solve [1], >> >> > > > > >> > > > > I >> >> > > > > >> > > > > believe Pat Ferrel has >> made >> >> > his >> >> > > own >> >> > > > SBT script >> >> > > > > to >> >> > > > > >> compile >> >> > > > > >> > > > Mahout, which >> >> > > > > >> > > > > solved that problem for >> >> them). >> >> > > > > >> > > > > >> >> > > > > >> > > > > The issue we ran into >> with >> >> the >> >> > > > releases (and the >> >> > > > > >> reason I >> >> > > > > >> > think >> >> > > > > >> > > > you're >> >> > > > > >> > > > > here), is that we also >> >> > somewhere >> >> > > > along the line >> >> > > > > >> commented out >> >> > > > > >> > > > something >> >> > > > > >> > > > > that was important to >> the >> >> > > release >> >> > > > process. >> >> > > > > Hence why >> >> > > > > >> 0.14.0 >> >> > > > > >> > > > released >> >> > > > > >> > > > > source >> >> > > > > >> > > > > only. >> >> > > > > >> > > > > >> >> > > > > >> > > > > Since 2008, there has >> been >> >> a >> >> > > lot of >> >> > > > great work >> >> > > > > on >> >> > > > > >> generating >> >> > > > > >> > > > plugins >> >> > > > > >> > > > > for >> >> > > > > >> > > > > doing Apache releases. >> >> Instead >> >> > > of the >> >> > > > awkward >> >> > > > > hacks >> >> > > > > >> that made >> >> > > > > >> > > up >> >> > > > > >> > > > the >> >> > > > > >> > > > > old >> >> > > > > >> > > > > poms (literally comments >> >> that >> >> > > said, >> >> > > > "this is a >> >> > > > > hack, >> >> > > > > >> there's >> >> > > > > >> > > > supposedly >> >> > > > > >> > > > > something better coming >> >> from >> >> > > ..." >> >> > > > dated like >> >> > > > > 2012), >> >> > > > > >> we would >> >> > > > > >> > > > like to >> >> > > > > >> > > > > do it >> >> > > > > >> > > > > the "right way" and >> >> > incorporate >> >> > > the >> >> > > > appropriate >> >> > > > > >> plugins. >> >> > > > > >> > > > > >> >> > > > > >> > > > > Refactoring to SBT was >> >> _one_ >> >> > > proposed >> >> > > > solution. >> >> > > > > We're >> >> > > > > >> also OK >> >> > > > > >> > > > > continuing to >> >> > > > > >> > > > > use Maven, and I agree >> with >> >> > > what you >> >> > > > said about >> >> > > > > the >> >> > > > > >> cross >> >> > > > > >> > > > compiling. We >> >> > > > > >> > > > > actually have a script >> that >> >> > just >> >> > > > changes the >> >> > > > > scala >> >> > > > > >> version. >> >> > > > > >> > We >> >> > > > > >> > > > tried >> >> > > > > >> > > > > using >> >> > > > > >> > > > > the classifiers but >> there >> >> were >> >> > > issues >> >> > > > in SBT, >> >> > > > > but the >> >> > > > > >> way >> >> > > > > >> > > you're >> >> > > > > >> > > > > proposing >> >> > > > > >> > > > > sounds a lot more pro >> than >> >> the >> >> > > route >> >> > > > we were >> >> > > > > trying >> >> > > > > >> for. >> >> > > > > >> > > > > >> >> > > > > >> > > > > That said- we'd be OK >> just >> >> > > releasing >> >> > > > one >> >> > > > > scala/spark >> >> > > > > >> version >> >> > > > > >> > at >> >> > > > > >> > > > a time. >> >> > > > > >> > > > > But getting the >> convenience >> >> > > binaries >> >> > > > to >> >> > > > > >> release/publish would >> >> > > > > >> > > be >> >> > > > > >> > > > a >> >> > > > > >> > > > > major >> >> > > > > >> > > > > first step. >> >> > > > > >> > > > > >> >> > > > > >> > > > > Also, we really >> appreciate >> >> the >> >> > > help, >> >> > > > > >> > > > > >> >> > > > > >> > > > > tg >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > > [1] >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > >> >> > > > > >> > > >> >> > > > > >> > >> >> > > > > >> >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> https://issues.apache.org/jira/projects/MAHOUT/issues/MAHOUT-2093?filter=allopenissues >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > > >> >> > > > > >> > > > > On Thu, Apr 16, 2020 at >> >> 4:50 >> >> > AM >> >> > > > Christofer Dutz >> >> > > > > < >> >> > > > > >> > > > > christofer.d...@c-ware.de> >> >> > > > > >> > > > > wrote: >> >> > > > > >> > > > > >> >> > > > > >> > > > > > Hi Stevo, >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > so let me summarize >> what >> >> I >> >> > > > understood: >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > - There are some >> modules >> >> in >> >> > > mahout >> >> > > > that are >> >> > > > > built >> >> > > > > >> with >> >> > > > > >> > Scala, >> >> > > > > >> > > > some >> >> > > > > >> > > > > with >> >> > > > > >> > > > > > java and some with >> both >> >> (At >> >> > > least >> >> > > > that's what >> >> > > > > I see >> >> > > > > >> when >> >> > > > > >> > > > checking >> >> > > > > >> > > > > out the >> >> > > > > >> > > > > > project) >> >> > > > > >> > > > > > - The current build >> uses >> >> > > Scala 2.11 >> >> > > > to build >> >> > > > > the >> >> > > > > >> Scala >> >> > > > > >> > code. >> >> > > > > >> > > > > > - The resulting >> libraries >> >> > are >> >> > > only >> >> > > > compatible >> >> > > > > with >> >> > > > > >> Scala >> >> > > > > >> > 2.11 >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > Now you want to also >> >> publish >> >> > > > versions >> >> > > > > compatible >> >> > > > > >> with Scala >> >> > > > > >> > > > 2.12? >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > If that's the case I >> >> think >> >> > > Maven >> >> > > > could easily >> >> > > > > add >> >> > > > > >> multiple >> >> > > > > >> > > > executions >> >> > > > > >> > > > > > where each compile >> >> compiles >> >> > to >> >> > > > different >> >> > > > > output >> >> > > > > >> > directories: >> >> > > > > >> > > > > > - Java --> >> target/classes >> >> > > > > >> > > > > > - Scala 2.11 --> >> >> > > target/classes-2.11 >> >> > > > > >> > > > > > - Scala 2.12 --> >> >> > > target/classes-2.12 >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > Then the packaging >> would >> >> > also >> >> > > need >> >> > > > a second >> >> > > > > >> execution ... >> >> > > > > >> > > each >> >> > > > > >> > > > of the >> >> > > > > >> > > > > > executions bundling >> the >> >> > > classes and >> >> > > > the >> >> > > > > >> corresponding scala >> >> > > > > >> > > > output. >> >> > > > > >> > > > > > Ideally I would >> probably >> >> use >> >> > > maven >> >> > > > > classifiers to >> >> > > > > >> > distinguish >> >> > > > > >> > > > the >> >> > > > > >> > > > > > artifacts. >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > <dependency> >> >> > > > > >> > > > > > >> >> > > > <groupId>org.apache.mahout</groupId> >> >> > > > > >> > > > > > >> >> > > > <artifactId>mahout-spark</artifactId> >> >> > > > > >> > > > > > >> >> > > <version>14.1-SNAPSHOT</version> >> >> > > > > >> > > > > > >> >> > > <classifier>2.11</classifier> >> >> > > > > >> > > > > > </dependency> >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > Then it should all >> work >> >> in a >> >> > > normal >> >> > > > maven >> >> > > > > build. In >> >> > > > > >> the >> >> > > > > >> > > > > distributions you >> >> > > > > >> > > > > > could also filter the >> >> > versions >> >> > > > according to >> >> > > > > their >> >> > > > > >> > > classifiers. >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > So if this is the >> case, I >> >> > > could >> >> > > > help you with >> >> > > > > this. >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > Chris >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > Am 16.04.20, 09:39 >> >> schrieb >> >> > > "Stevo >> >> > > > Slavić" < >> >> > > > > >> > ssla...@gmail.com >> >> > > > > >> > > >: >> >> > > > > >> > > > > > >> >> > > > > >> > > > > > Disclaimer: I'm >> not >> >> > active >> >> > > > Mahout >> >> > > > > maintainer >> >> > > > > >> for quite >> >> > > > > >> > a >> >> > > > > >> > > > while, >> >> > > > > >> > > > > have >> >> > > > > >> > > > > > some >> >> > > > > >> > > > > > historical >> >> perspective, >> >> > > take it >> >> > > > with a >> >> > > > > grain of >> >> > > > > >> salt, >> >> > > > > >> > > > could be >> >> > > > > >> > > > > I'm >> >> > > > > >> > > > >> > >> > >> >
