I'm glad it helped Aniket. I would recommend that you start working on
performance improvement with your network infrastructure and the balance of
data across your logical racks.Cliff
On Fri, Sep 24, 2010 at 12:12 AM, aniket ray wrote:
> Hi Cliff,
>
> Thanks it did turn out to be speculative ex
Hi Cliff,
Thanks it did turn out to be speculative execution. When I turned it off, no
more tasks were killed and the performance degraded.
So my initial assumptions were incorrect after all. I guess I'll have to
look at other ways to improve performance.
Thanks for the help.
-aniket
On Thu, Se
Aniket, I wonder if these tasks were run as Speculative Execution. Have you
been able to determine whether the job runs successfully?
HTH
Cliff
On Thu, Sep 23, 2010 at 12:52 AM, aniket ray wrote:
> Hi,
>
> I continuously run a series of batch job using Hadoop Map Reduce. I also
> have a managin
Hi,
I continuously run a series of batch job using Hadoop Map Reduce. I also
have a managing daemon that moves data around on the hdfs making way for
more jobs to be run.
I use capacity scheduler to schedule many jobs in parallel.
I see an issue on the Hadoop web monitoring UI at port 50030 which
