" Why do you want to do this perverse thing?" -agreed.
It sounds like even in your testing that you'll not really get the full effect of what you're wanting to test. When you have two installations on the same machine it's likely that the network latency and other issues that occur when transferring between nodes wont really be tested. On Tue, Apr 15, 2008 at 4:12 PM, Cagdas Gerede <[EMAIL PROTECTED]> wrote: > I am working on Distributed File System part. I do not use MR part, > and I need to run multiple processes to test some scenarios on the file > system. > > On Tue, Apr 15, 2008 at 1:37 PM, Ted Dunning <[EMAIL PROTECTED]> wrote: > > > > > I have had no issues in scaling the number of datanodes. The location > of > > the data is almost invisible to MR programs. > > > > I have had issues in going from local to distributed mode, but that has > > entirely been due to class path like issues. Since MR naturally > restricts > > your focus, it is pretty much the rule that programs scale without much > > thought. > > > > If you test with two tasktrackers and one data node, you should have a > > pretty solid test environment. > > > > > > On 4/15/08 1:12 PM, "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> > > wrote: > > > > > Testing when I do not have 10 machines. > > > > > > > > > On 4/15/08, Ted Dunning <[EMAIL PROTECTED]> wrote: > > >> > > >> Why do you want to do this perverse thing? > > >> > > >> How does it help to have more than one datanode per machine? And > what > > in > > >> the world is better when you have 10? > > >> > > >> > > >> On 4/15/08 12:53 PM, "Cagdas Gerede" <[EMAIL PROTECTED]> wrote: > > >> > > >>> I have a follow-up question, > > >>> Is there a way to programatically configure datanode parameters and > > start > > >>> the datanode process? > > >>> If I want to create 10 datanodes on the same host, do I have to > create > > 10 > > >>> config files? > > >>> > > >>> > > >>> On Tue, Apr 15, 2008 at 12:29 PM, dhruba Borthakur < > > [EMAIL PROTECTED]> > > >>> wrote: > > >>> > > >>>> Yes, just point the Datanodes to different config files, different > > sets > > >>>> of ports, different data directories. Etc.etc. > > >>>> > > >>>> Thanks, > > >>>> dhruba > > >>>> > > >>>> -----Original Message----- > > >>>> From: Cagdas Gerede [mailto:[EMAIL PROTECTED] > > >>>> Sent: Tuesday, April 15, 2008 11:21 AM > > >>>> To: core-user@hadoop.apache.org > > >>>> Subject: multiple datanodes in the same machine > > >>>> > > >>>> Is there a way to run multiple datanodes in the same machine? > > >>>> > > >>>> > > >>>> -- > > >>>> ------------ > > >>>> Best Regards, Cagdas Evren Gerede > > >>>> Home Page: http://cagdasgerede.info > > >>>> > > >>> > > >>> > > >> > > >> > > > > > > > > > > -- > ------------ > Best Regards, Cagdas Evren Gerede > Home Page: http://cagdasgerede.info > -- Theodore Van Rooy http://greentheo.scroggles.com
