Re: Hadoop eclipse plugin

2008-08-25 Thread Christophe Taton
Hi Arijit, On Tue, Aug 26, 2008 at 7:06 AM, Arijit Mukherjee < [EMAIL PROTECTED]> wrote: > Hi All > > Have anyone tried the Eclipse plugin for Hadoop? I've been able to add > the plugin to Eclipse, however, I can see couple of problems there - > probably I did something wrong. > > (1) When I try

Re: running hadoop remotely from inside a java program

2008-07-09 Thread Christophe Taton
On Wed, Jul 9, 2008 at 11:27 AM, Steve Loughran <[EMAIL PROTECTED]> wrote: > Deyaa Adranale wrote: > >> >> thanks for your help >> >> please i need more explanations on these: >> >> * it is not too far away, network-wise >> what do u mean network-wise?? what are the requirements of the connection

Re: Task failing, cause FileSystem close?

2008-06-18 Thread Christophe Taton
se() since it will be closed automatically. > > Nicholas > > > - Original Message > > From: Christophe Taton <[EMAIL PROTECTED]> > > To: [EMAIL PROTECTED] > > Sent: Tuesday, June 17, 2008 4:18:45 AM > > Subject: Task failing, cause FileSystem close?

Task failing, cause FileSystem close?

2008-06-17 Thread Christophe Taton
Hi all, I am experiencing (through my students) the following error on a 28 nodes cluster running Hadoop 0.16.4. Some jobs fail with many map tasks aborting with this error message: 2008-06-17 12:25:01,512 WARN org.apache.hadoop.mapred.TaskTracker: Error running child java.io.IOException: Filesys

Re: how to execute two consecutive map-reduce pairs?

2008-06-03 Thread Christophe Taton
Maybe you can check org.apache.hadoop.mapred.jobcontrol.* I did not try it myself but it looks like this is what you need. Cheers, Christophe On Tue, Jun 3, 2008 at 5:55 PM, Ted Dunning <[EMAIL PROTECTED]> wrote: > No. > > At least you need to call runJob twice. Typically, it is safer to create

Re: Realtime Map Reduce = Supercomputing for the Masses?

2008-06-02 Thread Christophe Taton
Hi Steve, On Mon, Jun 2, 2008 at 12:23 PM, Steve Loughran <[EMAIL PROTECTED]> wrote: > Christophe Taton wrote: > >> Actually Hadoop could be made more friendly to such realtime Map/Reduce >> jobs. >> For instance, we could consider running all tasks inside the t

Re: Realtime Map Reduce = Supercomputing for the Masses?

2008-06-01 Thread Christophe Taton
Actually Hadoop could be made more friendly to such realtime Map/Reduce jobs. For instance, we could consider running all tasks inside the task tracker jvm as separate threads, which could be implemented as another personality of the TaskRunner. I have been looking into this a couple of weeks ago..

Re: external jar using eclipse-plugin?

2008-02-18 Thread Christophe Taton
Hi Tamer, Can you tell which version of the plug-in do you use? Unfortunately, I did not try this kind of configuration yet, but I'll work having it work... Thanks, Christophe On Feb 18, 2008 10:39 PM, Tamer Elsayed <[EMAIL PROTECTED]> wrote: > Hi, > > This is a question about using external ja