RE: topology.script.file.name

Reduce program will immediately fail because some "topology initialization error" (I could find the exact text any more). Thanks Yunhong On Thu, 3 Jul 2008, Devaraj Das wrote: This is strange. If you don't mind, pls send the script to me. -Original Message- From: Yunh

topology.script.file.name

Hello, I have been trying to figure out how to configure rack awareness. I have written a script that reads a list of IPs or host names and return a list of rack IDs of the same number. This is my script running: $./mydns 192.168.1.1 192.168.2.1 /rack0 /rack1 I specified the path of this s

RE: Hadoop topology.script.file.name Form

I guess what we need is an example of the "script", where do we put it, and what exactly to fill in the value of the "topology.script.file.name" entry. So, I wrote a program called "mydns". I can run the program ./mydns node1.rack1.yahoo.com It prints "/rack1" to the screen. Is this correc

Different hadoop root directory on different node

Hi, I have two clusters. On Cluster A, Hadoop is installed under /home/userA; On Cluster B, Hadoop is installed under /home/userB. How do I configure the master node so that it can find Hadoop slaves on both clusters? If the master is on A, by default it looks for /home/userA/hadoop... on B

questions about the configuration file

Hi, I have some questions on the network settings. What is the different between the following two entries? The first one is obvious, but what does the second one mean? How is it related to DNS? dfs.datanode.bindAddress 0.0.0.0 the address where the datanode will listen to.

Re: reduce > copy ?? (was Reduce hangs)

rg.apache.hadoop.mapred.TaskTracker: task_200801221827_0001_r_00_0 0.1667% reduce > copy (1 of 2 at 0.00 MB/s) > On Tue, 22 Jan 2008, Yunhong Gu1 wrote: Thanks, I tried but this probably not the reason. I checked the network connection using "netstat" and the client is

reduce > copy ?? (was Reduce hangs)

adoop.mapred.TaskTracker: task_200801221827_0001_r_00_0 0.1667% reduce > copy (1 of 2 at 0.00 MB/s) > On Tue, 22 Jan 2008, Yunhong Gu1 wrote: Thanks, I tried but this probably not the reason. I checked the network connection using "netstat" and the client is actually c

Re: Reduce hangs

twork interface to pick up. /Taeho On Jan 22, 2008 7:34 AM, Yunhong Gu1 <[EMAIL PROTECTED]> wrote: Hi, all Just to keep this topic updated :) I am still tring to figure what happened. I found that in my 2-node configuration (namenode and jobtracker on node-1, while both are data

RE: Reduce hangs

from. The servers I use have 2 network interfaces and I am using another one. I explicitly fill the IP addresses 10.0.0.x in all the configuration files. Might this be the reason of Reduce failure? But the Map phase does work. Thanks Yunhong On Sat, 19 Jan 2008, Yunhong Gu1 wrote: Oh, so