RE: Release 1.0.0 RC3 - Ant Build Fails with JSP-Compile Error

Fixed our own problem - this may help others: We needed Tomcat 6 jars to be in $ANT_HOME/lib Pretty obvious with hindsight, but hindsight is a wonderful thing... Royston -Original Message- From: Royston Sellman [mailto:royston.sell...@googlemail.com] Sent: 20 December 2011 18:19 To: co

Hadoop 1.0.0-RC3 - JSP error for DFSHealth.jsp

I am using the tomcat 6 jars with Ant to build Hadoop 1.0.0-rc3 and I am getting the following error when hadoop is running and we try to load the namenode dfshealth.jsp page (note that we can successfully view the jobtracker.jsp page and hbase's UI): HTTP ERROR 500 Problem accessing /dfshealt

RE: Hadoop 1.0.0-RC3 - JSP error for DFSHealth.jsp

This problem was caused by my use of Tomcat 6. It appears that the version of jasper being used in the Hadoop 1 RC3 code is 5.5.12. Therefore, by replacing the relevant $ANT_HOME/lib jars with Tomcat 5 jars and rebuilding hadoop I have solved all my problems! -Original Message- From: To

Re: Configure hadoop scheduler

Hi Merto, > a) is LATE scheduler a standalone scheduler or is integrated in > fairscheduler? If is standalone where to find it and which hadoop version > does it support? LATE is actually part of the common scheduling code that all of the schedulers in Hadoop use, implemented in the JobInProgres

one question about hadoop

Hi, jack I also encounter this problem, so I would like to know how you deal with it. Thanks Fuzhen Zheng, from China

Re: How to create Output files of about fixed size

Hi JJ If you use the default TextInputFormat, it wont do the job as it would generate at least one split for each file. So in your case there would be a min of 78 splits as there are that many input files and 78 mappers and hence same 78 output files. You need to use CombineFileInputFormat

Re: How to create Output files of about fixed size

Hi Bejoy, This is what I tried initially but in this case, just to run job over 5 GB input takes more than an hour as RecordReader in LineRecordReader and offset is around 64 MB. It's is making performance really bad. Thanks, Anurag Tangri On Wed, Dec 21, 2011 at 12:13 PM, Bejoy Ks wrote: > H

Re: network configuration (etc/hosts) ?

Can you run the hostname command on both servers and send their output? -Joey On Tue, Dec 20, 2011 at 8:21 PM, MirrorX wrote: > > dear all > > i am trying for many days to get a simple hadoop cluster (with 2 nodes) to > work but i have trouble configuring the network parameters. i have properly

run hadoop as job under Lava job scheduler?

Hi, Any one here has any idea about running hadoop as a job using Lava job scheduler? University cluster don't have Hadoop yet so I just want to know if it's possible to run Hadoop as a job under Lava job scheduler. Welcome to any hint. Best --Yue

Re: network configuration (etc/hosts) ?

MirrorX, Try out adding hostname of your master and slave system also to /etc/hosts/ That fixed same error for me. master-> 127.0.0.1 localhost6.localdomain6 localhost 127.0.1.1 localhost4.localdomain4 master-pc 192.168.7.110 master master-pc 192.168.7.157 slave lab-pc slave-> 127.0.1.1

Can reduce phase be CPU/IO bound ?

Hi guys ! If we neglect the shuffle part, can reduce phase be CPU/IO bound ? Can anyone suggest some benchmark or example where we can see this ? Arun -- View this message in context: http://lucene.472066.n3.nabble.com/Can-reduce-phase-be-CPU-IO-bound-tp3605913p3605913.html Sent from the Ha