Hi,I wrote a custom InputFormat. When I ran the pig script Load function using this InputFormat, the number of InputSplit = 16, but there was only 2 map tasks handling these splits. Apparently the no. of map tasks = the no. of input files.
Does the number of Map task not correspond to the number of splits? I think the job will be done quicker if there are more Map tasks? Patcharee