On Mar 10, 2013, at 17:40, Paul Butcher wrote: > As things currently stand, fold can be used on a sequence- > based reducible collection, but won't be parallel. > > I'm currently working on code that processes XML generated by > clojure.data.xml/parse, and would love to do so in parallel. > I can't immediately see any reason why it wouldn't be possible > to create a version of CollFold that takes a sequence and > "chunks" it so that it can be folded in parallel. Has anyone > tried this yet? Is there some gotcha lurking to catch me out?
I love the idea; dunno if there are any gremlins lurking. BTW, if you haven't already done so, be sure to watch Guy Steele's talk: How to Think about Parallel Programming: Not! http://www.infoq.com/presentations/Thinking-Parallel-Programming The first third of the talk (~20 minutes) is a wonderful discussion of extreme hacking (eg, a single-card dump program for an IBM 1130). Guy then segues into a discussion of giving up control of details in order to let "the system" take care of things (eg, memory use). The last part of the talk is about the conceptual basis for order- independent folding of calculations. So, required viewing (IMHO) if you're thinking about extending reducers, etc. -r -- http://www.cfcl.com/rdm Rich Morin http://www.cfcl.com/rdm/resume r...@cfcl.com http://www.cfcl.com/rdm/weblog +1 650-873-7841 Software system design, development, and documentation -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
