Re: Inconsistent times in Hadoop web interface

2010-12-27 Thread yipeng
Ahh... I don't manage my cluster but you were spot on. Now I know who to follow up with. Thanks!! Yipeng On Mon, Dec 27, 2010 at 3:55 PM, Harsh J wrote: > Hey, > > On Mon, Dec 27, 2010 at 10:44 AM, yipeng wrote: > > Hi guys, > > > > I am having some inconsistent timing in the web interface. T

Re: Hadoop/Elastic MR on AWS

2010-12-27 Thread Sudhir Vallamkondu
We recently crossed this bridge and here are some insights. We did an extensive study comparing costs and benchmarking local vs EMR for our current needs and future trend. - Scalability you get with EMR is unmatched although you need to look at your requirement and decide this is something you nee

Re: Hadoop/Elastic MR on AWS

2010-12-27 Thread Dave Viner
Hi Sudhir, Can you publish your findings around pricing, and how you calculated the various aspects? This is great information. Thanks Dave Viner On Mon, Dec 27, 2010 at 10:17 AM, Sudhir Vallamkondu < sudhir.vallamko...@icrossing.com> wrote: > We recently crossed this bridge and here are some

Re: Hadoop/Elastic MR on AWS

2010-12-27 Thread James Seigel
Thank you for sharing. Sent from my mobile. Please excuse the typos. On 2010-12-27, at 11:18 AM, Sudhir Vallamkondu wrote: > We recently crossed this bridge and here are some insights. We did an > extensive study comparing costs and benchmarking local vs EMR for our > current needs and future t

UI doesn't work

2010-12-27 Thread maha
Hi, I get Error 404 when I try to use hadoop UI to monitor my job execution. I'm using Hadoop-0.20.2 and the following are parts of my configuration files. in Core-site.xml: fs.default.name hdfs://speed.cs.ucsb.edu:9000 in mapred-site.xml: mapred.job.tracker speed.cs.ucsb.edu

Re: UI doesn't work

2010-12-27 Thread James Seigel
Two quick questions first. Is the job tracker running on that machine? Is there a firewall in the way? James Sent from my mobile. Please excuse the typos. On 2010-12-27, at 4:46 PM, maha wrote: > Hi, > > I get Error 404 when I try to use hadoop UI to monitor my job execution. I'm > using Ha

Hadoop RPC call response post processing

2010-12-27 Thread Stefan Groschupf
Hi All, I'm browsing the RPC code since quite a while now trying to find any entry point / interceptor slot that allows me to handle a RPC call response writable after it was send over the wire. Does anybody has an idea how break into the RPC code from outside. All the interesting methods are p

Re: UI doesn't work

2010-12-27 Thread Harsh J
I remember facing such an issue with the JT (50030) once. None of the jsp pages would load, 'cept the index. It was some odd issue with the webapps not getting loaded right while startup. Don't quite remember how it got solved. Did you do any ant operation on your release copy of Hadoop prior to s

Re: Hadoop RPC call response post processing

2010-12-27 Thread Todd Lipcon
Hi Stefan, Sounds interesting. Maybe you're looking for o.a.h.ipc.Server$Responder? -Todd On Mon, Dec 27, 2010 at 8:07 PM, Stefan Groschupf wrote: > Hi All, > I'm browsing the RPC code since quite a while now trying to find any entry > point / interceptor slot that allows me to handle a RPC c

Re: UI doesn't work

2010-12-27 Thread Adarsh Sharma
maha wrote: Hi, I get Error 404 when I try to use hadoop UI to monitor my job execution. I'm using Hadoop-0.20.2 and the following are parts of my configuration files. in Core-site.xml: fs.default.name hdfs://speed.cs.ucsb.edu:9000 in mapred-site.xml: mapred.job.tracker spe

Re: Hadoop RPC call response post processing

2010-12-27 Thread Ted Dunning
I would be very surprised if allocation itself is the problem as opposed to good old fashioned excess copying. It is very hard to write an allocator faster than the java generational gc, especially if you are talking about objects that are ephemeral. Have you looked at the tenuring distribution?