t;
> On Tue, Dec 14, 2010 at 8:10 PM, Charles W wrote:
> > Hi,
> >
> > I have a question about map parallelism in Pig.
> >
> > I am using Pig to stream a file through a Python script that performs
> some
> > computationally expensive transforms. This pr
Try
set mapred.max.split.size $desired_split_size
-D
On Tue, Dec 14, 2010 at 8:10 PM, Charles W wrote:
> Hi,
>
> I have a question about map parallelism in Pig.
>
> I am using Pig to stream a file through a Python script that performs some
> computationally expensive transf
Hi,
I have a question about map parallelism in Pig.
I am using Pig to stream a file through a Python script that performs some
computationally expensive transforms. This process is assigned to a single
map task that can take a very long time if it happens to execute on one of
the weaker nodes in
