Re: [Bioc-devel] BiocParallel

2012-11-15 Thread Martin Morgan
On 11/15/2012 6:21 AM, Kasper Daniel Hansen wrote: I'll second Ryan's patch (at least in principle). When I parallelize across multiple cores, I have always found mc.preschedule to be an important option to expose (that, and the number of cores, is all I use routinely). Yes, Ryan provided a

Re: [Bioc-devel] BiocParallel

2012-11-15 Thread Tim Triche, Jr.
Personally, having used memcached in the past for distributed shared memory caching, I am most interested in 3) and doRedis. Many cluster/batch processing systems are a colossal PITA, and a worker queue would go a long way towards fixing that. Less checkpointing, more results... I hope. As an

Re: [Bioc-devel] BiocParallel

2012-11-15 Thread Vincent Carey
should approaches to fault-tolerance/recovery/debugging be a topic here? On Thu, Nov 15, 2012 at 1:53 PM, Henrik Bengtsson h...@biostat.ucsf.eduwrote: Is there any write up/discussion/plans on the various types of parallel computations out there: (1) one machine / multi-core/multi-threaded

Re: [Bioc-devel] BiocParallel

2012-11-15 Thread Michael Lawrence
On Thu, Nov 15, 2012 at 11:00 AM, Martin Morgan mtmor...@fhcrc.org wrote: On 11/15/2012 10:53 AM, Henrik Bengtsson wrote: Is there any write up/discussion/plans on the various types of parallel computations out there: (1) one machine / multi-core/multi-threaded (2) multiple machines /