You might try increasing the number of map and reduce tasks so that you can overlap cpu and I/O. It is common in parallel applications that you need to do something like this.
On 8/18/07 8:36 AM, "Thorsten Schuett" <[EMAIL PROTECTED]> wrote: >> If my assumptions are correct, would it be possible to >>> read/access the files directly in the "one-node mode"? >> >> Please take a look at LocalJobRunner in src/org/apache/hadoop/mapred ... >> set the jobtracker in your config to 'local' and this happens automatically. >> (http://wiki.apache.org/lucene-hadoop/HowToDebugMapReducePrograms) > > > When I use "local", I loose the web interface and the multi-threading. I can > live with the former, but the latter is not an option. > > Thorsten
