Re: Simple Hadoop program build with Maven

2011-10-08 Thread Bochun Bai
To make a jar bundled big jar file using maven I suggest this plugin: http://anydoby.com/fatjar/usage.html But I prefer not doing so, because the classpath order is different with different environment. I guess your old myHadoopProgram.jar should contains Main-Class meta info. So the

performance normal?

2011-10-08 Thread tom uno
release 0.21.0 Production System 20 nodes read 100 megabits per second write 10 megabits per second performance normal?

Re: performance normal?

2011-10-08 Thread Bochun Bai
Yes, for single thread HDFS client. No, for well designed map-reduce jobs. On Sat, Oct 8, 2011 at 3:12 PM, tom uno ltom...@gmail.com wrote: release 0.21.0 Production System 20 nodes read 100 megabits per second write 10 megabits per second performance normal?

Re: DFSClient: Could not complete file

2011-10-08 Thread Todd Lipcon
On Fri, Oct 7, 2011 at 12:40 PM, Chris Curtin curtin.ch...@gmail.com wrote: hi Todd, Thanks for the reply. Yes I'm seeing 30,000 ms a couple of times a day, though it looks like 4000 ms is average. Also see 150,000+ and lots of 50,000. Is there anything I can do about this? The bug is

nmap scripts

2011-10-08 Thread John Bond
Hello, I have just posted a few nmap scripts to the nmap-dev list[1] also available on github[2]. Would be usefull if i some people would be willing to test them out and let me know of any errors or false reports to use copy the hadoop-* and hbase-* scripts into ~/.nmap/scripts and run a

Re: performance normal?

2011-10-08 Thread Brian Bockelman
Normal operation is a function of hardware. Giving the version without the underlying hardware means I get to make up any answer I feel like. I can't imagine a rational set of hardware where 10 megabits (as in, one megabyte) a second is normal. Brian On Oct 8, 2011, at 3:04 AM, Bochun Bai

Re: Simple Hadoop program build with Maven

2011-10-08 Thread Periya.Data
Fantastic ! Worked like a charm. Thanks much Bochun. For those who are facing similar issues, here is the command and output: $ hadoop jar ../MyHadoopProgram.jar com.ABC.MyHadoopProgram -libjars ~/CDH3/extJars/json-rpc-1.0.jar /usr/PD/input/sample22.json /usr/PD/output 11/10/08 17:51:45 INFO

Re: performance normal?

2011-10-08 Thread Raj Vishwanathan
Really horriblr performance Sent from my iPad Please excuse the typos. On Oct 8, 2011, at 12:12 AM, tom uno ltom...@gmail.com wrote: release 0.21.0 Production System 20 nodes read 100 megabits per second write 10 megabits per second performance normal?