Selecting NodeManager to execute a particular Mapper

Hey Guy I am writing a MR to read data from Kafka brokers. These are brokers are collocated on same machine as that of my NodeManagers. I want to run my mappers such that task for one broker runs on same node. I am not able to figure out how to ask for resources from resource manager. Thanks

Re: Running multiple copies of each task

Thanks Namikaze! Another question: New tasks in hadoop always have higher priority than speculative tasks. Does anyone know how and where I can change this priority? Thanks, Sultan On Thu, Dec 3, 2015 at 7:46 AM, Namikaze Minato wrote: > I think you are looking for

Repeated localized resource in filecache

Hi, I'm new to hadoop and I'm running the same map reduce job multiple times with some unexpected behaviour. In the mapreduce i'm adding a tmpjar dependency using the hbase utility: TableMapReduceUtil.addDependencyJar(Redisson.class) - which finds the jar based on the class and adds it to the

nodemanager process crash for array index out of bound

Hi guys, Nodemanager process error log: Could you give me some tips for this , why happened? 2015-12-16 17:24:38,605 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.Container sMonitorImpl: Uncaught exception in ContainerMemoryManager while managing memory of

Issue while running sqoop script parallel

Hi, Need your expert guidance to resolve a sqoop script Error. We are using sqoop & invoking TDCH(Teradata Hadoop Connector) to archive data from Teradata to HADOOP Hive Tables . We have created a generic Sqoop script which accepts source DB, View Name,target name as input parameter & loads into