Again, not having a failure- it just always hangs in that one place- either on that test or on the next one I'm not sure.
On Mon, May 4, 2020 at 8:57 AM Christofer Dutz <christofer.d...@c-ware.de> wrote: > I just had a failure in core which was a timing issue that doesn't always > happen. > So right now if I get failures and simply-re running gets rid of them, I > add them to the flaky tests txt file ... > > You did notice, that on failure maven tells you how to resume from the > failed module (So you don't have to run all the modules before)? > It's in one of the last lines maven outputs > > > Chris > > > Am 04.05.20, 15:06 schrieb "Trevor Grant" <trevor.d.gr...@gmail.com>: > > I misspoke- it was in the Scala bindings, this is the last line to > print > off: > > > https://github.com/apache/mahout/blob/758cfada62556d679c445416dff9d9fb2a3c4e59/core/src/test/scala/org/apache/mahout/math/scalabindings/MatrixOpsSuite.scala#L222 > > Hope akm or someone else can test to help me figure out if its my > machine > or a real issue. > > On Mon, May 4, 2020 at 8:01 AM Christofer Dutz < > christofer.d...@c-ware.de> > wrote: > > > Hi Trevor, > > > > core sort of always passed for me ... it was some of the community > modules > > I had to run multiple times because of flaky unit tests. > > > > Will re-try on my machines. > > > > Chris > > > > > > Am 04.05.20, 14:51 schrieb "Trevor Grant" <trevor.d.gr...@gmail.com > >: > > > > On Java 8 when I build with tests it always hangs on > > ``` > > Average assignment seqSparse2seqSparse time: 25.776 ms > > Average assignment seqSparse2seqSparse via Random Access Sparse > time: > > 224.714 ms > > ``` > > > > It seems like that's in the Mahout Core section. What is our new > > "official > > target" java? I have 8,11,13 on this machine, but can install > 9,10 if > > one > > of them is the new official that we are using. > > > > tg > > > > > > On Mon, May 4, 2020 at 5:49 AM Christofer Dutz < > > christofer.d...@c-ware.de> > > wrote: > > > > > No ... I think I was able to go up till 10 ... above that I > think I > > > remember I had errors. > > > > > > 13 is also quite intense when it comes to changes in what > you're > > allowed > > > to do with reflection. > > > > > > Chris > > > > > > > > > Am 03.05.20, 20:39 schrieb "Trevor Grant" < > trevor.d.gr...@gmail.com > > >: > > > > > > Is JDK 13 supposed to work now? I was able to get archives > if I > > skipped > > > tests, but w Java 8 the tests hung, and Java 13 tests had > errors. > > > > > > > > > > > > On Fri, May 1, 2020 at 6:27 PM Andrew Palumbo < > > andrew_palu...@msn.com> > > > wrote: > > > > > > > > > > > Hey All, been very sick again, I may be offline for a > couple > > of > > > weeks, > > > > I am probably not going to be able to commit to times in > the > > next > > > couple of > > > > weeks, I'll be back and forth to SD and sleeping alot. > Thank > > you > > > again, > > > > Christofer, for the help. If anyone needs me for > anything, > > please > > > use my > > > > apalu...@apache.org address, (i am not subscribed to > mahout > > with > > > that) or > > > > give a shout on slack, so that i dont miss it. > > > > > > > > Thanks. > > > > > > > > Andy > > > > > > > > ---------- Forwarded message ---------- > > > > From: Christofer Dutz <christofer.d...@c-ware.de> > > > > Date: Apr 24, 2020 2:18 AM > > > > Subject: Re: Hi ... need some help? > > > > To: dev@mahout.apache.org > > > > Cc: > > > > > > > > > > > > Hi all, > > > > > > > > just found the email with the time for the call today ... > > that's > > > 19:00 / > > > > 7pm here ... perfect. > > > > Would just need some information on how to join. > > > > > > > > Chris > > > > > > > > > > > > Am 20.04.20, 17:31 schrieb "Andrew Musselman" < > > > andrew.mussel...@gmail.com > > > > >: > > > > > > > > Thanks Chris, will take a look at your PR. > > > > > > > > I think we would be fine upgrading anything that is > still > > making > > > > improvements, probably makes sense to discuss Friday > on > > our call > > > if > > > > you can > > > > make it. > > > > > > > > Best > > > > Andrew > > > > > > > > On Mon, Apr 20, 2020 at 1:53 AM Christofer Dutz < > > > > christofer.d...@c-ware.de> > > > > wrote: > > > > > > > > > Hi Folks, > > > > > > > > > > so I've now tested the build with java 1.8, 9, 10 > and > > they > > > work ... > > > > > 11 I'm getting errors about unsupported java major > > versions > > > again ... > > > > > guess there's some old library version in there > > somewhere. > > > > > > > > > > But at least I managed to get you out of this 1.7 > trap. > > > > > > > > > > Chris > > > > > > > > > > > > > > > Am 20.04.20, 09:46 schrieb "Christofer Dutz" < > > > > christofer.d...@c-ware.de>: > > > > > > > > > > Hi folks, > > > > > > > > > > so I was now able to build (including all > tests) > > with Java > > > 8 and > > > > 9 ... > > > > > currently trying 10 ... > > > > > > > > > > Are there any objection that some maven > dependencies > > get > > > updated > > > > to > > > > > more recent versions? I mean ... the hbase-client > you're > > using > > > is > > > > more than > > > > > 5 years old ... > > > > > > > > > > Chris > > > > > > > > > > > > > > > Am 20.04.20, 00:29 schrieb "Andrew Musselman" < > > > > > andrew.mussel...@gmail.com>: > > > > > > > > > > No problem; would 10:00 a.m. Pacific next > Friday > > the > > > 24th > > > > work for > > > > > you time > > > > > zone-wise? > > > > > > > > > > On Sun, Apr 19, 2020 at 12:15 PM > Christofer Dutz > > < > > > > > christofer.d...@c-ware.de> > > > > > wrote: > > > > > > > > > > > Sorry ... > > > > > > > > > > > > didn't see your response ... into Mahout > too > > deep ;-) > > > > > > Guess we have to postpone this to > sometime > > over the > > > week. > > > > > > > > > > > > Chris > > > > > > > > > > > > > > > > > > Am 19.04.20, 19:56 schrieb "Andrew > Musselman" < > > > > > andrew.mussel...@gmail.com > > > > > > >: > > > > > > > > > > > > *what time > > > > > > > > > > > > On Sun, Apr 19, 2020 at 10:51 Andrew > > Musselman < > > > > > > andrew.mussel...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > I think it's safe to move to 1.8; > yeah > > what > > > tune is > > > > good > > > > > for you? > > > > > > I'm in > > > > > > > Pacific time zone and am flexible > this > > > afternoon. > > > > > > > > > > > > > > Trevor you free? > > > > > > > > > > > > > > On Sun, Apr 19, 2020 at 09:37 > Christofer > > Dutz < > > > > > > christofer.d...@c-ware.de> > > > > > > > wrote: > > > > > > > > > > > > > >> Yikes! ... well guess then I > can't help > > you > > > folks > > > > as it's > > > > > almost > > > > > > >> impossible to get my hands on a > 1.7 > > version. > > > > > > >> > > > > > > >> What's preventing you from going > to > > 1.8+? > > > > > > >> > > > > > > >> Any your build says 1.8 and above: > > > > > > >> <requireJavaVersion> > > > > > > >> > > <version>[1.8,)</version> > > > > > > >> > </requireJavaVersion> > > > > > > >> > > > > > > >> Regarding the artifacts ... would > it be > > ok to > > > have > > > > the > > > > > maven > > > > > > artifacts > > > > > > >> using classifiers and perhaps the > files > > in > > > the libs > > > > and > > > > > > distribution to > > > > > > >> follow the typical scala sheme? > > > > > > >> > > > > > > >> Chris > > > > > > >> > > > > > > >> Am 19.04.20, 17:56 schrieb "Trevor > > Grant" < > > > > > trevor.d.gr...@gmail.com > > > > > > >: > > > > > > >> > > > > > > >> Yea, we have a requirement on > 1.7. > > we > > > need to > > > > get it > > > > > up to 8, > > > > > > but > > > > > > >> considered that a different > issue. > > > > > > >> > > > > > > >> Maven throws warning, sbt > breaks > > down > > > entirely > > > > (when > > > > > importing)- > > > > > > >> hence why > > > > > > >> we were using a script to > replace > > 2.11 w > > > 2.12 > > > > > > >> > > > > > > >> On Sun, Apr 19, 2020, 10:33 AM > > Christofer > > > Dutz < > > > > > > >> christofer.d...@c-ware.de> > > > > > > >> wrote: > > > > > > >> > > > > > > >> > Well I have been compiling > with > > various > > > jdks > > > > from 8 > > > > > to 14. > > > > > > However I > > > > > > >> > noticed that if I select a > jdk and > > > start the > > > > build > > > > > that the > > > > > > Scala > > > > > > >> parts > > > > > > >> > Seefahrt to the version in > my > > systems > > > path. > > > > Which > > > > > then > > > > > > results in > > > > > > >> all sorts > > > > > > >> > of major version problems. > > > > > > >> > > > > > > > >> > For the Scalatest plugin I > > managed to > > > have it > > > > use > > > > > the maven > > > > > > >> java.home... > > > > > > >> > The Scala compiler is being > a > > little > > > trickyer. > > > > > > >> > > > > > > > >> > Will continue this evening. > Keep > > your > > > fingers > > > > > crossed. > > > > > > >> > > > > > > > >> > Also does maven totally not > like > > > variables in > > > > > artifactids. > > > > > > >> > > > > > > > >> > Chris > > > > > > >> > > ________________________________ > > > > > > >> > Von: Trevor Grant < > > > trevor.d.gr...@gmail.com> > > > > > > >> > Gesendet: Sonntag, 19. > April 2020 > > 15:41 > > > > > > >> > An: Mahout Dev List < > > > dev@mahout.apache.org> > > > > > > >> > Betreff: Re: Hi ... need > some > > help? > > > > > > >> > > > > > > > >> > Hey Chris, > > > > > > >> > > > > > > > >> > First of all- thank you so > much > > for > > > your work > > > > so > > > > > far. > > > > > > >> > > > > > > > >> > The build 100% currently > works, > > the only > > > > issue is > > > > > with > > > > > > releasing > > > > > > >> binaries. > > > > > > >> > Are you compiling w 1.7? Not > > really > > > sure why > > > > > artifact IDs are > > > > > > >> changing? > > > > > > >> > That's very strange. > > > > > > >> > > > > > > > >> > To answer your question > regarding > > the > > > > community > > > > > block- no, it > > > > > > is > > > > > > >> not as if > > > > > > >> > there is a company that > pays us > > to work > > > on > > > > Mahout > > > > > and the > > > > > > rest is > > > > > > >> > community. What it means is > that > > while > > > we > > > > > appreciate those > > > > > > code > > > > > > >> > contributions, no one still > > actively > > > involved > > > > is > > > > > maintaining > > > > > > them > > > > > > >> and we > > > > > > >> > advise people to use at > their own > > risk. > > > The > > > > > refactor to a > > > > > > >> `community` > > > > > > >> > folder was meant to reflect > the > > reality > > > of the > > > > > situation. > > > > > > >> > > > > > > > >> > The only test issues I was > aware > > of > > > were with > > > > > Javadocs when > > > > > > trying > > > > > > >> to do a > > > > > > >> > release with Java 1.8+ those > > would fail > > > due to > > > > > formatting. > > > > > > >> > > > > > > > >> > I feel like you're hitting > some > > unique > > > > issues, and > > > > > maybe we > > > > > > could > > > > > > >> help you > > > > > > >> > out / there may exist simple > > solutions. > > > > > > >> > > > > > > > >> > Thank you again for your > help! > > > > > > >> > > > > > > > >> > tg > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > > > > > > > >> > On Sun, Apr 19, 2020 at > 2:17 AM > > > Christofer > > > > Dutz < > > > > > > >> christofer.d...@c-ware.de > > > > > > >> > > > > > > > > >> > wrote: > > > > > > >> > > > > > > > >> > > Hi folks, > > > > > > >> > > > > > > > > >> > > So yesterday I invested > several > > hours > > > in > > > > cleaning > > > > > up your > > > > > > build. > > > > > > >> I got > > > > > > >> > > quite far, currently > trying to > > get the > > > > tests to > > > > > pass. For > > > > > > some > > > > > > >> > > Scala-Java-major-version > > problems, but > > > > working on > > > > > fixing > > > > > > them. > > > > > > >> > > > > > > > > >> > > However sind things will > be > > > different. I > > > > hope > > > > > that's OK. > > > > > > >> Especially with > > > > > > >> > > the artifact ids. > > > > > > >> > > > > > > > > >> > > Just as a question: does > the > > build > > > > currently work > > > > > at all? > > > > > > >> Especially in > > > > > > >> > > the community block I had > to fix > > > quite a > > > > few API > > > > > changes > > > > > > where > > > > > > >> the code > > > > > > >> > in > > > > > > >> > > the blocks were for older > > versions of > > > > libraries. > > > > > > >> > > > > > > > > >> > > I hope I get some more > tests to > > pass > > > today. > > > > > > >> > > > > > > > > >> > > Chris > > > > > > >> > > > ________________________________ > > > > > > >> > > Von: Andrew Musselman < > > a...@apache.org > > > > > > > > > > >> > > Gesendet: Donnerstag, 16. > April > > 2020 > > > 20:35 > > > > > > >> > > An: Mahout Dev List < > > > dev@mahout.apache.org> > > > > > > >> > > Betreff: Re: Hi ... need > some > > help? > > > > > > >> > > > > > > > > >> > > Looking forward to > working on > > this > > > with you; > > > > > thanks again! > > > > > > >> > > > > > > > > >> > > On Thu, Apr 16, 2020 at > 11:09 AM > > > Christofer > > > > Dutz < > > > > > > >> > > christofer.d...@c-ware.de > > > > > > > > >> > > wrote: > > > > > > >> > > > > > > > > >> > > > Hi Andrew, > > > > > > >> > > > > > > > > > >> > > > guess I'll start with > the > > fork and > > > > contact you > > > > > folks on > > > > > > slack. > > > > > > >> > > > > > > > > > >> > > > Chris > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > Am 16.04.20, 19:43 > schrieb > > "Andrew > > > > Musselman" < > > > > > > a...@apache.org>: > > > > > > >> > > > > > > > > > >> > > > Chris, thank you > for your > > help.. > > > > > > >> > > > > > > > > > >> > > > Yeah if you fork > what's in > > > master you > > > > can > > > > > see what > > > > > > state > > > > > > >> it's in; > > > > > > >> > we > > > > > > >> > > > are in > > > > > > >> > > > the #mahout channel > in > > tge-asf > > > slack > > > > and > > > > > this is also > > > > > > a > > > > > > >> fine way to > > > > > > >> > > > keep > > > > > > >> > > > track of discussion. > > > > > > >> > > > > > > > > > >> > > > We could file a JIRA > > ticket as > > > well, > > > > > however you > > > > > > prefer to > > > > > > >> work. > > > > > > >> > > > > > > > > > >> > > > Best > > > > > > >> > > > Andrew > > > > > > >> > > > > > > > > > >> > > > On Thu, Apr 16, > 2020 at > > 06:59 > > > > Christofer > > > > > Dutz < > > > > > > >> > > > > christofer.d...@c-ware.de> > > > > > > >> > > > wrote: > > > > > > >> > > > > > > > > > >> > > > > Hi Trevor, > > > > > > >> > > > > > > > > > > >> > > > > ok ... first of > all ... > > the > > > Mahout > > > > PMC is > > > > > defining a > > > > > > >> "community > > > > > > >> > > > > maintained" > library > > which is > > > not > > > > > maintained by the > > > > > > mahout > > > > > > >> PMC?!?! > > > > > > >> > > > > I thought at > Apache > > > everything is > > > > about > > > > > Community > > > > > > over > > > > > > >> code. So > > > > > > >> > is > > > > > > >> > > a > > > > > > >> > > > > company driving > the > > > non-community > > > > stuff? > > > > > > >> > > > > > > > > > > >> > > > > But back to your > build > > issues: > > > > > > >> > > > > I had a look and > I too > > > encountered > > > > these > > > > > comments > > > > > > and > > > > > > >> remarks and > > > > > > >> > > > > sometimes > patterns I > > > recognized and > > > > could > > > > > imagine > > > > > > why > > > > > > >> they were > > > > > > >> > > > created. > > > > > > >> > > > > Yes quite a bit > of the > > build > > > could > > > > be > > > > > cleaned up and > > > > > > >> simplified a > > > > > > >> > > > lot. > > > > > > >> > > > > > > > > > > >> > > > > So how about I > create a > > fork > > > and > > > > try to > > > > > do a > > > > > > cleanup of > > > > > > >> the > > > > > > >> > build. > > > > > > >> > > > > Usually I also > leave > > comments > > > about > > > > what > > > > > I do as I > > > > > > hope > > > > > > >> I'll not > > > > > > >> > be > > > > > > >> > > > the > > > > > > >> > > > > only one > maintaining a > > build > > > and > > > > > documenting things > > > > > > helps > > > > > > >> people > > > > > > >> > > > feel more > > > > > > >> > > > > confident. > > > > > > >> > > > > > > > > > > >> > > > > However in some > cases I > > will > > > have > > > > > questions ... so > > > > > > would > > > > > > >> someone > > > > > > >> > be > > > > > > >> > > > > available on > Slack for > > quick > > > > questions? > > > > > > >> > > > > > > > > > > >> > > > > Usually switching > to > > another > > > build > > > > system > > > > > does > > > > > > solve some > > > > > > >> > problems > > > > > > >> > > > ... > > > > > > >> > > > > mostly the reason > to > > switch > > > is that > > > > it > > > > > solved the > > > > > > main > > > > > > >> problem > > > > > > >> > that > > > > > > >> > > > you are > > > > > > >> > > > > having with the > old. > > > > > > >> > > > > However you > usually > > notice > > > too late > > > > that > > > > > you get > > > > > > yourself > > > > > > >> a lot > > > > > > >> > of > > > > > > >> > > > new > > > > > > >> > > > > problems. I > remember > > doing > > > some > > > > contract > > > > > work for an > > > > > > >> insurance > > > > > > >> > > > company and > > > > > > >> > > > > they were totally > down > > > Maven-road > > > > but > > > > > then had to > > > > > > build > > > > > > >> something > > > > > > >> > > > with SBT > > > > > > >> > > > > ... in the end I > > compiled the > > > thing > > > > on my > > > > > laptop, > > > > > > copied > > > > > > >> it to a > > > > > > >> > > USB > > > > > > >> > > > stick > > > > > > >> > > > > and told the > people > > what was > > > on the > > > > stick > > > > > and that > > > > > > I'll be > > > > > > >> > having a > > > > > > >> > > > coffee > > > > > > >> > > > > and will be back > in 30 > > > minutes. > > > > When I > > > > > came back > > > > > > the sick > > > > > > >> wasn't > > > > > > >> > at > > > > > > >> > > > the > > > > > > >> > > > > same place and > the build > > > problem was > > > > > "solved" ;-) > > > > > > >> > > > > > > > > > > >> > > > > So I think it's > quite > > good to > > > stick > > > > to > > > > > maven ... > > > > > > that is > > > > > > >> very > > > > > > >> > > > mature, you > > > > > > >> > > > > can do almost > > everything you > > > want > > > > with it > > > > > and it > > > > > > >> integrates > > > > > > >> > > > perfectly into > > > > > > >> > > > > the Apache > > infrastructure. > > > > > > >> > > > > > > > > > > >> > > > > But that's just my > > opinion. > > > > > > >> > > > > > > > > > > >> > > > > So if you want me > to > > help, > > > I'll be > > > > happy > > > > > to be of > > > > > > >> assistance. > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > Chris > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > Am 16.04.20, 15:28 > > schrieb > > > "Trevor > > > > Grant" > > > > > < > > > > > > >> > > trevor.d.gr...@gmail.com > > > > > > >> > > > >: > > > > > > >> > > > > > > > > > > >> > > > > Hey > Christopher, > > > > > > >> > > > > > > > > > > >> > > > > I would agree > with > > what > > > Stevo > > > > > outlined but add > > > > > > some > > > > > > >> more > > > > > > >> > > context > > > > > > >> > > > and a > > > > > > >> > > > > couple > related JIRA > > > issues. > > > > > > >> > > > > > > > > > > >> > > > > For 0.14.0 We > did a > > big > > > > refactor and > > > > > finally > > > > > > moved the > > > > > > >> > > MapReduce > > > > > > >> > > > based > > > > > > >> > > > > Mahout all > into > > what we > > > called > > > > > "community/" > > > > > > that is > > > > > > >> community > > > > > > >> > > > > maintained, > > > > > > >> > > > > which is to > say, > > we're not > > > > > maintaining it > > > > > > anymore > > > > > > >> (sunset > > > > > > >> > > began I > > > > > > >> > > > > think in > > > > > > >> > > > > 2015). > > > > > > >> > > > > > > > > > > >> > > > > But all of > our POMs > > were > > > so > > > > huge and > > > > > fat because > > > > > > >> they'd been > > > > > > >> > > > layered up > > > > > > >> > > > > over the > years by > > people > > > coming > > > > and > > > > > going and > > > > > > >> dropping in > > > > > > >> > > code. I > > > > > > >> > > > > wouldn't > > > > > > >> > > > > call these > drive- > > bys, > > > its just > > > > been > > > > > over 10 > > > > > > years > > > > > > >> and people > > > > > > >> > > > come and > > > > > > >> > > > > go. > > > > > > >> > > > > Such is the > life of > > Apache > > > > Projects. > > > > > So we had a > > > > > > >> situation > > > > > > >> > > where > > > > > > >> > > > a lot > > > > > > >> > > > > of > > > > > > >> > > > > the old Map > Reduce > > stuff > > > and > > > > the POMs > > > > > were > > > > > > considered > > > > > > >> > > > "old-magic" no > > > > > > >> > > > > one > > > > > > >> > > > > really knew > how it > > was > > > all tied > > > > > together, but we > > > > > > >> didn't want > > > > > > >> > to > > > > > > >> > > > mess > > > > > > >> > > > > with > > > > > > >> > > > > it for fear of > > breaking > > > > something in > > > > > the "new" > > > > > > Mahout > > > > > > >> (aka > > > > > > >> > > > Samsar) > > > > > > >> > > > > which is > > > > > > >> > > > > the > Scala/Spark > > based > > > library > > > > that it > > > > > is now* > > > > > > (to > > > > > > >> others in > > > > > > >> > the > > > > > > >> > > > > community: > > > > > > >> > > > > I know it > runs on > > other > > > > engines, but > > > > > for > > > > > > simplicity, > > > > > > >> I'm just > > > > > > >> > > > calling > > > > > > >> > > > > it > > > > > > >> > > > > > "runs-on-spark"). > > > > > > >> > > > > > > > > > > >> > > > > For 0.14.0 We > > decided to > > > trim > > > > out as > > > > > much of > > > > > > that > > > > > > >> which was > > > > > > >> > > > possible. > > > > > > >> > > > > We > > > > > > >> > > > > did some major > > > liposuction on > > > > POMs, > > > > > re organized > > > > > > >> things, etc. > > > > > > >> > > > This was > > > > > > >> > > > > done > > > > > > >> > > > > by commenting > out a > > > section, > > > > then > > > > > seeing if it > > > > > > would > > > > > > >> still > > > > > > >> > > > build. So > > > > > > >> > > > > the > > > > > > >> > > > > current > release > > > > > > >> > > > > _does_ build. > And > > aside > > > for > > > > some CLI > > > > > driver > > > > > > issues > > > > > > >> which are > > > > > > >> > > > outlined > > > > > > >> > > > > in > > > > > > >> > > > > [1], the > project > > runs > > > fairly > > > > smooth. > > > > > (An SBT > > > > > > would > > > > > > >> probably > > > > > > >> > > > solve [1], > > > > > > >> > > > > I > > > > > > >> > > > > believe Pat > Ferrel > > has > > > made his > > > > own > > > > > SBT script > > > > > > to > > > > > > >> compile > > > > > > >> > > > Mahout, which > > > > > > >> > > > > solved that > problem > > for > > > them). > > > > > > >> > > > > > > > > > > >> > > > > The issue we > ran > > into > > > with the > > > > > releases (and the > > > > > > >> reason I > > > > > > >> > think > > > > > > >> > > > you're > > > > > > >> > > > > here), is > that we > > also > > > somewhere > > > > > along the line > > > > > > >> commented out > > > > > > >> > > > something > > > > > > >> > > > > that was > important > > to the > > > > release > > > > > process. > > > > > > Hence why > > > > > > >> 0.14.0 > > > > > > >> > > > released > > > > > > >> > > > > source > > > > > > >> > > > > only. > > > > > > >> > > > > > > > > > > >> > > > > Since 2008, > there > > has > > > been a > > > > lot of > > > > > great work > > > > > > on > > > > > > >> generating > > > > > > >> > > > plugins > > > > > > >> > > > > for > > > > > > >> > > > > doing Apache > > releases. > > > Instead > > > > of the > > > > > awkward > > > > > > hacks > > > > > > >> that made > > > > > > >> > > up > > > > > > >> > > > the > > > > > > >> > > > > old > > > > > > >> > > > > poms > (literally > > comments > > > that > > > > said, > > > > > "this is a > > > > > > hack, > > > > > > >> there's > > > > > > >> > > > supposedly > > > > > > >> > > > > something > better > > coming > > > from > > > > ..." > > > > > dated like > > > > > > 2012), > > > > > > >> we would > > > > > > >> > > > like to > > > > > > >> > > > > do it > > > > > > >> > > > > the "right > way" and > > > incorporate > > > > the > > > > > appropriate > > > > > > >> plugins. > > > > > > >> > > > > > > > > > > >> > > > > Refactoring > to SBT > > was > > > _one_ > > > > proposed > > > > > solution. > > > > > > We're > > > > > > >> also OK > > > > > > >> > > > > continuing to > > > > > > >> > > > > use Maven, > and I > > agree > > > with > > > > what you > > > > > said about > > > > > > the > > > > > > >> cross > > > > > > >> > > > compiling. We > > > > > > >> > > > > actually have > a > > script > > > that just > > > > > changes the > > > > > > scala > > > > > > >> version. > > > > > > >> > We > > > > > > >> > > > tried > > > > > > >> > > > > using > > > > > > >> > > > > the > classifiers but > > there > > > were > > > > issues > > > > > in SBT, > > > > > > but the > > > > > > >> way > > > > > > >> > > you're > > > > > > >> > > > > proposing > > > > > > >> > > > > sounds a lot > more > > pro > > > than the > > > > route > > > > > we were > > > > > > trying > > > > > > >> for. > > > > > > >> > > > > > > > > > > >> > > > > That said- > we'd be > > OK just > > > > releasing > > > > > one > > > > > > scala/spark > > > > > > >> version > > > > > > >> > at > > > > > > >> > > > a time. > > > > > > >> > > > > But getting > the > > > convenience > > > > binaries > > > > > to > > > > > > >> release/publish would > > > > > > >> > > be > > > > > > >> > > > a > > > > > > >> > > > > major > > > > > > >> > > > > first step. > > > > > > >> > > > > > > > > > > >> > > > > Also, we > really > > > appreciate the > > > > help, > > > > > > >> > > > > > > > > > > >> > > > > tg > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > [1] > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/projects/MAHOUT/issues/MAHOUT-2093?filter=allopenissues > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > On Thu, Apr > 16, > > 2020 at > > > 4:50 AM > > > > > Christofer Dutz > > > > > > < > > > > > > >> > > > > > > christofer.d...@c-ware.de> > > > > > > >> > > > > wrote: > > > > > > >> > > > > > > > > > > >> > > > > > Hi Stevo, > > > > > > >> > > > > > > > > > > > >> > > > > > so let me > > summarize > > > what I > > > > > understood: > > > > > > >> > > > > > > > > > > > >> > > > > > - There are > some > > > modules in > > > > mahout > > > > > that are > > > > > > built > > > > > > >> with > > > > > > >> > Scala, > > > > > > >> > > > some > > > > > > >> > > > > with > > > > > > >> > > > > > java and > some > > with both > > > (At > > > > least > > > > > that's what > > > > > > I see > > > > > > >> when > > > > > > >> > > > checking > > > > > > >> > > > > out the > > > > > > >> > > > > > project) > > > > > > >> > > > > > - The > current > > build uses > > > > Scala 2.11 > > > > > to build > > > > > > the > > > > > > >> Scala > > > > > > >> > code. > > > > > > >> > > > > > - The > resulting > > > libraries are > > > > only > > > > > compatible > > > > > > with > > > > > > >> Scala > > > > > > >> > 2.11 > > > > > > >> > > > > > > > > > > > >> > > > > > Now you > want to > > also > > > publish > > > > > versions > > > > > > compatible > > > > > > >> with Scala > > > > > > >> > > > 2.12? > > > > > > >> > > > > > > > > > > > >> > > > > > If that's > the > > case I > > > think > > > > Maven > > > > > could easily > > > > > > add > > > > > > >> multiple > > > > > > >> > > > executions > > > > > > >> > > > > > where each > compile > > > compiles to > > > > > different > > > > > > output > > > > > > >> > directories: > > > > > > >> > > > > > - Java --> > > > target/classes > > > > > > >> > > > > > - Scala > 2.11 --> > > > > target/classes-2.11 > > > > > > >> > > > > > - Scala > 2.12 --> > > > > target/classes-2.12 > > > > > > >> > > > > > > > > > > > >> > > > > > Then the > packaging > > > would also > > > > need > > > > > a second > > > > > > >> execution ... > > > > > > >> > > each > > > > > > >> > > > of the > > > > > > >> > > > > > executions > > bundling the > > > > classes and > > > > > the > > > > > > >> corresponding scala > > > > > > >> > > > output. > > > > > > >> > > > > > Ideally I > would > > > probably use > > > > maven > > > > > > classifiers to > > > > > > >> > distinguish > > > > > > >> > > > the > > > > > > >> > > > > > artifacts. > > > > > > >> > > > > > > > > > > > >> > > > > > <dependency> > > > > > > >> > > > > > > > > > > <groupId>org.apache.mahout</groupId> > > > > > > >> > > > > > > > > > > <artifactId>mahout-spark</artifactId> > > > > > > >> > > > > > > > > > <version>14.1-SNAPSHOT</version> > > > > > > >> > > > > > > > > > <classifier>2.11</classifier> > > > > > > >> > > > > > > </dependency> > > > > > > >> > > > > > > > > > > > >> > > > > > Then it > should > > all work > > > in a > > > > normal > > > > > maven > > > > > > build. In > > > > > > >> the > > > > > > >> > > > > distributions you > > > > > > >> > > > > > could also > filter > > the > > > versions > > > > > according to > > > > > > their > > > > > > >> > > classifiers. > > > > > > >> > > > > > > > > > > > >> > > > > > So if this > is the > > case, > > > I > > > > could > > > > > help you with > > > > > > this. > > > > > > >> > > > > > > > > > > > >> > > > > > Chris > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > Am > 16.04.20, 09:39 > > > schrieb > > > > "Stevo > > > > > Slavić" < > > > > > > >> > ssla...@gmail.com > > > > > > >> > > >: > > > > > > >> > > > > > > > > > > > >> > > > > > > Disclaimer: > > I'm not > > > active > > > > > Mahout > > > > > > maintainer > > > > > > >> for quite > > > > > > >> > a > > > > > > >> > > > while, > > > > > > >> > > > > have > > > > > > >> > > > > > some > > > > > > >> > > > > > > historical > > > perspective, > > > > take it > > > > > with a > > > > > > grain of > > > > > > >> salt, > > > > > > >> > > > could be > > > > > > >> > > > > I'm > > > > > > >> > > > > > missing > > > > > > >> > > > > > the > whole > > point you > > > were > > > > > approached for > > > > > > by a > > > > > > >> wide > > > > > > >> > margin > > > > > > >> > > of > > > > > > >> > > > > error. > > > > > > >> > > > > > > > > > > > >> > > > > > At a > point > > Mahout, > > > some > > > > of its > > > > > modules, > > > > > > have > > > > > > >> turned > > > > > > >> > into > > > > > > >> > > a > > > > > > >> > > > scala > > > > > > >> > > > > > > library, and > > there > > > was > > > > need to > > > > > cross > > > > > > publish > > > > > > >> those > > > > > > >> > > modules, > > > > > > >> > > > > across > > > > > > >> > > > > > > different > > scala > > > versions. > > > > Back > > > > > than Maven > > > > > > scala > > > > > > >> plugin > > > > > > >> > > > didn't > > > > > > >> > > > > support > > > > > > >> > > > > > cross > > > > > > >> > > > > > > publishing, it > > > doesn't > > > > fit well > > > > > with > > > > > > Maven's > > > > > > >> build > > > > > > >> > > > lifecycle > > > > > > >> > > > > concept > > > > > > >> > > > > > > (multiple > > compile > > > phases > > > > - one > > > > > for each > > > > > > scala > > > > > > >> version, > > > > > > >> > > and > > > > > > >> > > > what > > > > > > >> > > > > not > > > > > > >> > > > > > would > > > > > > >> > > > > > be > needed). > > > Switching to > > > > sbt > > > > > could have > > > > > > solved > > > > > > >> the > > > > > > >> > > problem. > > > > > > >> > > > > Switch was > > > > > > >> > > > > > deemed > to be > > too big > > > > task, even > > > > > though > > > > > > ages > > > > > > >> have been > > > > > > >> > > > spent on > > > > > > >> > > > > trying > > > > > > >> > > > > > to > > > > > > >> > > > > > apply > Maven > > > (profiles) + > > > > bash > > > > > scripts and > > > > > > what > > > > > > >> not to > > > > > > >> > > > solve the > > > > > > >> > > > > > problem. > > > > > > >> > > > > > Trying > to > > apply same > > > > approach > > > > > over and > > > > > > over > > > > > > >> again and > > > > > > >> > > > expecting > > > > > > >> > > > > > different > > > > > > >> > > > > > results > is not > > > smart, no > > > > expert > > > > > can help > > > > > > there. > > > > > > >> Mahout > > > > > > >> > > > > maintainers and > > > > > > >> > > > > > > contributors, > > should > > > > consider > > > > > alternative > > > > > > >> approach, one > > > > > > >> > > of > > > > > > >> > > > them > > > > > > >> > > > > being > > > > > > >> > > > > > > switching to > > sbt - > > > it's > > > > scala > > > > > native, > > > > > > supports > > > > > > >> scala > > > > > > >> > > cross > > > > > > >> > > > > publishing, > > > > > > >> > > > > > supports > > publishing > > > Maven > > > > > compatible > > > > > > release > > > > > > >> metadata > > > > > > >> > and > > > > > > >> > > > > binaries. > > > > > > >> > > > > > > > > > > > >> > > > > > Kind > regards, > > > > > > >> > > > > > Stevo > Slavic. > > > > > > >> > > > > > > > > > > > >> > > > > > On Thu, > Apr > > 16, > > > 2020 at > > > > 9:15 AM > > > > > > Christofer Dutz > > > > > > >> < > > > > > > >> > > > > > > > > christofer.d...@c-ware.de> > > > > > > >> > > > > > wrote: > > > > > > >> > > > > > > > > > > > >> > > > > > > Hi > folks, > > > > > > >> > > > > > > > > > > > > >> > > > > > > my > name is > > Chris > > > and I’m > > > > > involved in > > > > > > quite a > > > > > > >> lot of > > > > > > >> > > > Apache > > > > > > >> > > > > projects. > > > > > > >> > > > > > > Justin > > approached > > > me > > > > this > > > > > morning, > > > > > > asking me > > > > > > >> if I > > > > > > >> > could > > > > > > >> > > > > perhaps help > > > > > > >> > > > > > you. > > > > > > >> > > > > > > He > told me > > you > > > were > > > > having > > > > > trouble with > > > > > > doing > > > > > > >> Maven > > > > > > >> > > > releases. > > > > > > >> > > > > > > > > > > > > >> > > > > > > As > Maven > > releases > > > are my > > > > > specialty, > > > > > > could you > > > > > > >> please > > > > > > >> > > > summarize > > > > > > >> > > > > the > > > > > > >> > > > > > issues > > > > > > >> > > > > > > you > are > > having? > > > > > > >> > > > > > > > > > > > > >> > > > > > > Chris > > > > > > >> > > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
