Re: failed map tasks

2008-07-03 Thread jerrro
I am actually more interested in _theoretically_ what could happen to a map tasks to fail or to take longer... Don't have a specific case. Thanks, Jerr Amar Kamat wrote: > > jerrro wrote: >> Hello, >> >> I was wondering - could someone tell me what are the reason

failed map tasks

2008-07-02 Thread jerrro
Hello, I was wondering - could someone tell me what are the reasons that I could get failure with certain map tasks on a node? Any idea that comes to mind would work (it does not happen because my program aborts). Also, what could cause with hadoop for a map task to take longer (although data is

distributed cache

2008-01-28 Thread jerrro
Hello, Is there a way to use Distributed Cache with a pipes (C++ code) job? I want to be able to access a file on the local disk all over the data nodes, so hadoop would copy it to all data nodes before a map reduce job. Thanks. -- View this message in context: http://www.nabble.com/distribute

hadoop and local files

2008-01-24 Thread jerrro
Hello, When launching a map-reduce job, I am interested in copying a certain file to the datanodes, but not HDFS - the local file system, so I can access that file from my job on the datanode. (The file is around 500KB, so I don't think there will be much overhead). Is there a way to tell hadoop