One very nice thing that Cascading allows in the logical flow is that it allows groups and joins to be expressed which it then translates and schedules reasonably well into MR programs in which the appropriate functions are all collected as you suggest.
On Wed, Mar 25, 2009 at 1:23 PM, David Hall <d...@cs.stanford.edu> wrote: > > Secondly, Cascading provides a relatively open representation of > map-reduce > > flows that it will optimize. ... > > interesting... SMR already chains together multiple maps (and filters > and flatmaps) if you use them before calling a reduce. I'll look into > the magic that Cascading does. > -- Ted Dunning, CTO DeepDyve 111 West Evelyn Ave. Ste. 202 Sunnyvale, CA 94086 www.deepdyve.com 408-773-0110 ext. 738 858-414-0013 (m) 408-773-0220 (fax)
