Finding the time it took for a mapreduce job to get executed

2010-07-08 Thread Denim Live
Hi folks, I want to determine the exact time it took for my mapreduce job to get executed for some anaylsis purpose. How can I calculate it? Thanks

jni files

2010-07-08 Thread amit kumar verma
Hi, I developed a project which is using some native jni files (liblemur_jni.so), earlier i use to run application jar by using -Djava.library.path=/PATH_TO_JNI_FILES, but am not able to the same with ./hadoop jar command. I followed

getting the partition number in a reducer to which a key-value pair belongs

2010-07-08 Thread abc xyz
Hello everyone, when i am processing a given key-{set of values} pair in reducer function, how can I get the partition number to which this key-{set of values} belong to? How is it possible to get this partition number without adding extra information about the partition number with each

naming the output fle of reduce to the partition number

2010-07-08 Thread abc xyz
Hi Everyone, I am having some problem with naming the output file of each reduce task with the partition number. First of all, how can I get the partition number within each reduce? Second, How am I going to name the output file with that partition number? I have looked to the

Re: getting the partition number in a reducer to which a key-value pair belongs

2010-07-08 Thread abc xyz
This has worked for me: jobconf.getInt( mapred.task.partition, 0); in the reducer. From: abc xyz fabc_xyz...@yahoo.com To: common-u...@hadoop.apache.org Cc: general@hadoop.apache.org Sent: Thu, July 8, 2010 9:56:20 AM Subject: getting the partition number in

Re: jni files

2010-07-08 Thread Allen Wittenauer
On Jul 8, 2010, at 1:08 AM, amit kumar verma wrote: DistributedCache.addCacheFile(hdfs://* /192.168.0.153:50075*/libraries/mylib.so.1#mylib.so, conf); Do you actually have asterisks in this? If so, that's the problem.

Re: jni files

2010-07-08 Thread amit kumar verma
Hi, No there is no asterisks sign there, it came as i tried to make this *bold*. Thanks, Amit Kumar Verma Verchaska Infotech Pvt. Ltd. On 07/08/2010 10:57 PM, Allen Wittenauer wrote: On Jul 8, 2010, at 1:08 AM, amit kumar verma wrote: DistributedCache.addCacheFile(hdfs://*

Distributed Cache file issue

2010-07-08 Thread Denim Live
Hello all, As a new user of hadoop, I am having some problems with understanding some things. I am writing a program to load a file to the distributed cache and read this file in each mapper. In my driver program, I have added the file to my distributed cache using: Path p=new