MapTask$MapOutputBuffer.compare( ) method

2011-09-20 Thread Shrinivas Joshi
With JVM inlining enabled, profiles of Terasort run show more than 3% time spent in MapTask$MapOutputBuffer.compare( ) method in each of the Map JVMs. In this particular configuration there are 8 Map JVMs. So a big chunk of time is spent in this particular method. With JVM inlining disabled,

Re: Developer meetup after the Hadoop Summit

2011-06-07 Thread Shrinivas Joshi
Hi Owen, If possible, could you please send the list of events surrounding Hadoop Summit that might be interesting to summit attendees? The two I know of are BigDataCamp http://bigdatacamp-santaclara-2011.eventbrite.com/ happening the day before and HBase Contributor day at Y! happening the day

Re: JIT debug symbols and OProfile under Hadoop

2010-06-21 Thread Shrinivas Joshi
Hi All, I just wanted to check if anybody had a comment on this query. Thanks, -Shrinivas On Wed, Jun 16, 2010 at 9:50 PM, Shrinivas Joshi jshrini...@gmail.comwrote: Sorry if this is repeat email for you, I did send this to common-dev list as well. Hello, I am trying to get profiles

JIT debug symbols and OProfile under Hadoop

2010-06-16 Thread Shrinivas Joshi
Hello, I am trying to get profiles for a workload running on top of Hadoop 0.20.2 framework. The workload jars and Hadoop jars have been compiled with debug symbols enabled. I could see local variable tables and line number tables in the jar class files using javap. I am passing the right value