Hi,
We have a 200 node hadoop cluster (0.20.0) and have tweaked namenode and
datanode handler to 40 and 10. The xcievers also had to be changed to 8192.
But during the mapred jobs, we are seeing lot of task attempt failures saying
"connection reset by peer". Following exception are there in th
andlers is not enough for your load, it would only slowdown the cluster (as
long as clients can handle it).
How many clients do you have?
Raghu.
On Thu, Oct 1, 2009 at 8:28 PM, Murali Krishna. P wrote:
> Hi,
> We have a 200 node hadoop cluster (0.20.0) and have tweaked namenode and
>
Hi,
Is it safe to run the jobs during the datanode decommissioning? Around 10% of
the total datanodes are being decommissioned and i want to run a job mean
while. Wanted to confirm whether it is safe to do this.
Thanks,
Murali Krishna
Hi,
After running few jobs sequentially, I get the following error in the
tasktracker log and the job fails. The new jvm is started and it exists
immediately. Because of this, no userlogs gets created for that particalar
task.
The job also eventually fails. When I restart the workflow again, i
Hi,
I have attached the relevant part of jobtracker log. The job1 had 3 splits,
but it started 5 map tasks, m_0 through m_4. ( I have the speculative
execution turned off). The job some how succededs, the log files for 4th and
5th
task didnt get any records. Hovewer the next job aga
run.
Looks like job-setup task failed for your second job even after retries, so no
maps are scheduled. But you should see tasklogs for the failed tasks.
Thanks
Amareshwari
On 10/15/10 5:11 PM, "Murali Krishna. P" wrote:
Hi,
I have attached the relevant part of jobtracker log.
ailed tasks.
Thanks
Amareshwari
On 10/15/10 5:11 PM, "Murali Krishna. P" wrote:
Hi,
I have attached the relevant part of jobtracker log. The job1 had 3 splits,
but it started 5 map tasks, m_0 through m_4. ( I have the speculative
execution turned off). The job some how succededs,
