On Thu, Feb 23, 2012 at 12:52:38PM -0800, akm wrote: > > I'm interested. But in the practical application I've in mind, the data > > isn't > > there it is generated on the fly by sage itself. The problem it to gather > > information (eg: the size) on huge sets from combinatorics. Those sets are > > generated by a choice tree. The exploration of the various branches can > > obviously be made in parallel. > > This would be a great use case, where you could shove the generated > data off to a distributed file system and do your calculations on it > via whatever parallelized work you wanted. > > In this way the distributed fs becomes "just a disk" that is of > arbitrary size.
Interesting ! I've never think of those as a filesystem and even less as a file... I've to think about it.... I my usual use case, I simply forget about the data after having done the map/reduce on it. However, this is only because I don't have the necessary architecture only for storing them after they are computed. Note that the computation isn't usually very long (say around the range 1 micro sec - 1 milli sec)... Cheers, Florent -- To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/sage-devel URL: http://www.sagemath.org
