Re: running map tasks in remote node

2013-08-25 Thread rab ra
-- Date: Fri, 23 Aug 2013 15:43:38 +0530 Subject: Re: running map tasks in remote node From: rab...@gmail.com To: user@hadoop.apache.org Thanks for the reply. I am basically exploring possible ways to work with hadoop framework for one of my use case. I have my limitations

Re: running map tasks in remote node

2013-08-25 Thread Harsh J
makes sense if your MR job is CPU intensive. You simple want to use the Mapper/Reducer tasks to process your data, instead of any scalability of IO. Make sense? Yong Date: Fri, 23 Aug 2013 15:43:38 +0530 Subject: Re: running map tasks in remote node From

Re: running map tasks in remote node

2013-08-23 Thread rab ra
some file system URL, each file will be processed in each mapper. Yong -- Date: Wed, 21 Aug 2013 17:39:10 +0530 Subject: running map tasks in remote node From: rab...@gmail.com To: user@hadoop.apache.org Hello, Here is the new bie question of the day

Re: running map tasks in remote node

2013-08-23 Thread Shahab Yunus
-- Date: Wed, 21 Aug 2013 17:39:10 +0530 Subject: running map tasks in remote node From: rab...@gmail.com To: user@hadoop.apache.org Hello, Here is the new bie question of the day. For one of my use cases, I want to use hadoop map reduce without HDFS. Here, I will have

RE: running map tasks in remote node

2013-08-23 Thread java8964 java8964
Locality etc, that's why I said it ONLY makes sense if your MR job is CPU intensive. You simple want to use the Mapper/Reducer tasks to process your data, instead of any scalability of IO. Make sense? Yong Date: Fri, 23 Aug 2013 15:43:38 +0530 Subject: Re: running map tasks in remote node From

running map tasks in remote node

2013-08-22 Thread rab ra
Hello, Here is the new bie question of the day. For one of my use cases, I want to use hadoop map reduce without HDFS. Here, I will have a text file containing a list of file names to process. Assume that I have 10 lines (10 files to process) in the input text file and I wish to generate 10 map

RE: running map tasks in remote node

2013-08-22 Thread java8964 java8964
as each node can access it through some file system URL, each file will be processed in each mapper. Yong Date: Wed, 21 Aug 2013 17:39:10 +0530 Subject: running map tasks in remote node From: rab...@gmail.com To: user@hadoop.apache.org Hello, Here is the new bie question of the day. For one of my use