Re: Dense matricies in FlinkML

2016-02-19 Thread Theodore Vasiloudis
Yes, what I meant by BLAS calls is to have bindings to the relevant Breeze or netlib-java implementation . -- Sent from a mobile device. May contain autocorrect errors. On Feb 19, 2016 3:06 PM, "Trevor Grant" wrote: > That makes sense, a more accurate question would be, why does Vector.scala >

Re: Dense matricies in FlinkML

2016-02-19 Thread Trevor Grant
Agree. Since the current matrices will support what I'm trying to do, I'm going to drive on with the Neural nets. I think the BLAS should speed up matrix computations ( someone more familiar with Java math things can correct me) so I'll make that its own issue. Trevor Grant Data Scientist https://

Re: Dense matricies in FlinkML

2016-02-19 Thread Trevor Grant
That makes sense, a more accurate question would be, why does Vector.scala provide BLAS methods (functions, routines, whatever you call them), and Matrix doesn't? I assume they are there for speed (?) so does Matrix need them? Trevor Grant Data Scientist https://github.com/rawkintrevo http://st

Re: Dense matricies in FlinkML

2016-02-19 Thread Till Rohrmann
The idea was actually to leverage existing linear algebra libraries such as breeze instead of building another blas implementation which will never be as good as the ones out there. Cheers, Till On Fri, Feb 19, 2016 at 9:48 AM, Theodore Vasiloudis < theodoros.vasilou...@gmail.com> wrote: > Just

Re: Dense matricies in FlinkML

2016-02-19 Thread Theodore Vasiloudis
Just to note: This should be a separate PR if you plan on contributing this. On Thu, Feb 18, 2016 at 7:54 PM, Márton Balassi wrote: > Hi guys, > > They are at least already registered for serialization [1], so there should > be no intentional conflict as Theo has suggested. > > [1] > > https://g

Re: Dense matricies in FlinkML

2016-02-18 Thread Márton Balassi
Hi guys, They are at least already registered for serialization [1], so there should be no intentional conflict as Theo has suggested. [1] https://github.com/apache/flink/blob/master/flink-libraries/flink-ml/src/main/scala/org/apache/flink/ml/common/FlinkMLTools.scala#L67-L73 Best, Marton On T

Re: Dense matricies in FlinkML

2016-02-18 Thread Theodore Vasiloudis
Hello Trevor, IIRC it was mostly that they weren't needed at the time. Feel free to add, along with BLAS ops. Cheers, Theo On Thu, Feb 18, 2016 at 5:14 PM, Trevor Grant wrote: > Is there a specific reason vectors are imported from Breeze and matrices > aren't? > > Specifically I need to take t

Dense matricies in FlinkML

2016-02-18 Thread Trevor Grant
Is there a specific reason vectors are imported from Breeze and matrices aren't? Specifically I need to take the dot product of a matrix and a vector and a matrix and a matrix. Was wondering if there is a theoretical reason or it just wasn't needed at the time. Looks like some of this got lifted