RE: [Discuss--A proposal for building an application in mahout to measure runtime performance of algorithms in mahout]

2016-06-06 Thread Saikat Kanjilal
Perfect, thank you, that helps scope the effort a bit more accurately. > From: trevor.d.gr...@gmail.com > Date: Mon, 6 Jun 2016 11:33:32 -0500 > Subject: Re: [Discuss--A proposal for building an application in mahout to > measure runtime performance of algorithms in mahout] > To: dev@mahout.apach

Re: [Discuss--A proposal for building an application in mahout to measure runtime performance of algorithms in mahout]

2016-06-06 Thread Trevor Grant
I can only chime in to the visualization part, If you output to a csv- it can be easily consumed and visualized via Zeppelin. Specifically, there should be an exposed function where a csv (or even better a tsv) string is generated, which can then be used by a 'write to disk' method. The tsv str

RE: [Discuss--A proposal for building an application in mahout to measure runtime performance of algorithms in mahout]

2016-06-06 Thread Saikat Kanjilal
Andrew,Thanks for the input, I will shift gears a bit and just get some lightweight code going that calls into mahout algorithms and does a csv dump out. Note that I think akka could be a good use for this as you could make an async call and get back a notification when the csv dump is finished

Re: [Discuss--A proposal for building an application in mahout to measure runtime performance of algorithms in mahout]

2016-06-06 Thread Andrew Palumbo
Saikat, If you're going to pursue this there is a few things that I would suggest. First, keep it light weight. We don't want to bring a a lot of extra dependencies or data into the distribution. I'm not sure what this means as far as spray/akka, but those seem like overkill in my opinion. T