Re: Several TT in hadoop MR in clustering?

Actually, the TT should run on every datanode. On Thu, Dec 30, 2010 at 7:32 AM, Pedro Costa wrote: > Hi, > > 1 - When Hadoop MR is running in cluster mode, is it possible to have > several TT, a TT per machine, running simultaneously and the JT is > communicating to every TT? > For example, runn

Several TT in hadoop MR in clustering?

Hi, 1 - When Hadoop MR is running in cluster mode, is it possible to have several TT, a TT per machine, running simultaneously and the JT is communicating to every TT? For example, running hadoop MR in 5 machines, each machine (slave node) has a TT communicating with the JT in the master node? Th

RE: External jar dependency of map reduce jobs

Hi, In out build.xml we have a target that creates a standalone.jar that contains the class files belonging to the project and also includes the jars for all transitive dependencies. We use this jar to launch our jobs and in the jobConf if you set your mapred.jar to this jar things should work

RE: External jar dependency of map reduce jobs

Google DistributedCache hadoop...I think there is a method for DistributedCache.addResource though not sure if adding just text files or jars, but maybe that will help you in looking. Sorry, I am a newb as well. Dean From: praveen.pe...@nokia.com [mailto:praveen.pe...@nokia.com] Sent: Wednes

How do hadoop work in details

Hi all, I am trying to figure out how exactly happens inside the job. 1) When the jobtracker launches a task to be run, how does it impact the currently running jobs if the the current running job have higher, same, or lower priories using the default queue. 2) What if a low priority job is runn

Re: External jar dependency of map reduce jobs

Add them to the distributed cache, as must be done with any local file that needs distribution to Task JVMs. DistributedCache.addFileToClassPath(...) should help. -- Harsh J www.harshj.com

External jar dependency of map reduce jobs

Hello all, I have few map reduce jobs that I am invoking from a glasfish container. I am not using "hadoop" command line tool but calling the jobs directly from glassfish programatically. I have a driver that runs on glassfish and calls these jobs sequentially. I was able to run the jobs as long

Creating Solr index from map/reduce

Hi, I'm trying generate Solr index from hadoop (map/reduce) so I'm using this patch SOLR-301 , however I don't get it. When I try to run CSVIndexer with some arguments: -solr I'm runnig CSVIndexer: /bin/hadoop jar my.jar CSVIndexer -solr /