Hadoop communication protocol

2008-07-19 Thread Naama Kraus
Hi, As far as I know, Hadoop works over TCP/IP. Is that correct ? Or does it use UDP as well ? Thanks, Naama -- oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo "If you want your children to be intelligent, read them fairy tales. If you want them to be more

Re: Too many fetch failures AND Shuffle error

2008-07-19 Thread brainstorm
Got this problem too, and fixed it just 5 minutes ago... there were wrong IP entries on the nodes referring to the frontend, it was slowing down the reduce process *a lot*... in numbers: Wrong hosts file using wordcount example: 3hrs, 45mins, 41sec (4 minutes map, the rest, reduce) Right hosts fil