Error executing job in YARN. Exception Shell$ExitCodeException

2014-10-15 Thread gortiz
I'm trying to execute a work in YARN but I get an error. I have checked the yarn-site.xml, the classpath seems to be alright. I read https://issues.apache.org/jira/browse/YARN-1473 as well, but it didn't work to me either. Container for appattempt_1413373500815_0001_02 exited with

Trying MapReduce with MRUnit and MultipleOutput.

2014-10-14 Thread gortiz
I'm trying to test some MapReduces with MRUnit 1.1.0, but I didn't get results. The code that I execute is: mapTextDriver.withInput(new LongWritable(1), new Text(content)); ListPairNullWritable, Text outputs = mapTextDriver.run(); But, I never got an output, the list always has

How to know the number of nodes?

2014-10-08 Thread gortiz
I would like to know the number of nodes my cluster has. Is it possible in YARN and MapReduce from Java? I suppose that you have installed a TaskTracker in any node. AVISO CONFIDENCIAL\nEste correo y la informaciĆ³n contenida o adjunta al mismo es privada y confidencial y va dirigida

How to get the max number of reducers in Yarn

2014-10-03 Thread gortiz
I have been working with MapReduce1, (JobTracker and TaskTrakers). Some of my jobs I want to define the number of reduces to the maximum capacity of my cluster. I did it with this: int max = new JobClient(new JobConf(jConf)).getClusterStatus().getMaxReduceTasks(); Job job = new Job(jConf,