Re: set number of map tasks in GridMix2

2011-03-18 Thread Denny Ye
hi Pedro, You are right, the number of map tasks is defined by the number of input splits. In default, one DFS block one split. In your first example. Each file is sole block in DFS, so it have 10 map tasks for ten blocks. The second example, default block size is 64m in DFS, each

Re: set number of map tasks in GridMix2

2011-03-18 Thread Pedro Costa
I've another question. The number of map tasks is defined by the number of input splits? For example, if I run an example that read 10 txt files with 1kb each, does it means that 10 map tasks will run? And if I've 10 txt files with 1GB each, how many map tasks I will run? Thanks, On Fri, Mar 18,

set number of map tasks in GridMix2

2011-03-18 Thread Pedro Costa
Hi, I would like define the number of map tasks to use in the GridMix2. For example, I would like to run the GridMixMonsterQuery at GridMix2 with 5 maps, another with 10 and another with 20 maps. How can I do that? Thanks, -- Pedro