The other take-away was that threading looks plausible for SGD, but full on map-reduce except on somewhat randomized shards of features probably isn't that useful. Even shard may not be very useful since different mappers (or reducers) may just mostly redo the same work.
On Sun, Jan 24, 2010 at 5:37 AM, Olivier Grisel <olivier.gri...@ensta.org>wrote: > The main takeway point is that averaging for linear models is possible > but not as interesting as horizontal feature sharding that > experimentally works for both linear and non linear models. > > The second takeway point is that vowpal wabbit looks more and more > unbeatable :) > Unbeatable perhaps. But that also makes it pretty important to have in Mahout. -- Ted Dunning, CTO DeepDyve
