Re: Starting Datanode

2011-05-20 Thread Anh Nguyen
On 05/20/2011 02:33 PM, Marcos Ortiz wrote: On 05/20/2011 04:08 PM, Anh Nguyen wrote: On 05/20/2011 02:06 PM, Marcos Ortiz wrote: On 05/20/2011 04:27 PM, Marcos Ortiz wrote: On 05/20/2011 03:46 PM, Anh Nguyen wrote: On 05/20/2011 01:15 PM, Marcos Ortiz wrote: On 05/20/2011 01:02 PM, Anh Nguy

Re: Starting Datanode

2011-05-20 Thread Anh Nguyen
On 05/20/2011 02:47 PM, Kumar Kandasami wrote: What is the error in the datanode log file ? Unrecognized option: -jvm Could not create the Java virtual machine. Kumar_/|\_ www.saisk.com ku...@saisk.com "making a profound difference with knowled

Re: Starting Datanode

2011-05-20 Thread Kumar Kandasami
What is the error in the datanode log file ? Kumar_/|\_ www.saisk.com ku...@saisk.com "making a profound difference with knowledge and creativity..." On Fri, May 20, 2011 at 4:33 PM, Marcos Ortiz wrote: > On 05/20/2011 04:08 PM, Anh Nguyen wrote: > >> On 05/20/2011 02:06 PM, Marcos Ortiz

Re: Starting Datanode

2011-05-20 Thread Marcos Ortiz
On 05/20/2011 04:08 PM, Anh Nguyen wrote: On 05/20/2011 02:06 PM, Marcos Ortiz wrote: On 05/20/2011 04:27 PM, Marcos Ortiz wrote: On 05/20/2011 03:46 PM, Anh Nguyen wrote: On 05/20/2011 01:15 PM, Marcos Ortiz wrote: On 05/20/2011 01:02 PM, Anh Nguyen wrote: Hi, I just upgraded to hadoop-0.2

Re: Starting Datanode

2011-05-20 Thread Anh Nguyen
On 05/20/2011 01:57 PM, Marcos Ortiz wrote: On 05/20/2011 03:46 PM, Anh Nguyen wrote: On 05/20/2011 01:15 PM, Marcos Ortiz wrote: On 05/20/2011 01:02 PM, Anh Nguyen wrote: Hi, I just upgraded to hadoop-0.20.203.0, and am having problem starting the datanode: # hadoop datanode Unrecognized o

Re: Starting Datanode

2011-05-20 Thread Marcos Ortiz
On 05/20/2011 03:46 PM, Anh Nguyen wrote: On 05/20/2011 01:15 PM, Marcos Ortiz wrote: On 05/20/2011 01:02 PM, Anh Nguyen wrote: Hi, I just upgraded to hadoop-0.20.203.0, and am having problem starting the datanode: # hadoop datanode Unrecognized option: -jvm Could not create the Java virtual

Re: Starting Datanode

2011-05-20 Thread Anh Nguyen
On 05/20/2011 01:15 PM, Marcos Ortiz wrote: On 05/20/2011 01:02 PM, Anh Nguyen wrote: Hi, I just upgraded to hadoop-0.20.203.0, and am having problem starting the datanode: # hadoop datanode Unrecognized option: -jvm Could not create the Java virtual machine. It looks like it has something to

Re: Starting Datanode

2011-05-20 Thread Marcos Ortiz
On 05/20/2011 01:02 PM, Anh Nguyen wrote: Hi, I just upgraded to hadoop-0.20.203.0, and am having problem starting the datanode: # hadoop datanode Unrecognized option: -jvm Could not create the Java virtual machine. It looks like it has something to do with daemon.sh, particularly the setting o

Setting Config Property in OutputFormat.checkOutputSpecs().

2011-05-20 Thread Jane Chen
I need to save some data in the job config as part of OutputFormat.checkOutputSpecs(), and have it propagated to map tasks. It seems that the property is saved correctly when OutputFormat.checkOutputSpecs() is run, but it can't be found in the map tasks. Any idea why that's the case? Thanks,

Starting Datanode

2011-05-20 Thread Anh Nguyen
Hi, I just upgraded to hadoop-0.20.203.0, and am having problem starting the datanode: # hadoop datanode Unrecognized option: -jvm Could not create the Java virtual machine. It looks like it has something to do with daemon.sh, particularly the setting of HADOOP_OPTS: if [[ $EUID -eq 0 ]]; the

Question About Using a Single Reducer

2011-05-20 Thread Geoffry Roberts
All, I have a job where there I need to have but a single reducer. i.e. job.setNumReduceTasks(1); When I do this, I get no log file for the reducer; mappers yes, but reducer no. If I remove the aforementioned statement, hadoop will spawn the appropriate number of reducers as per my configuratio

Re: run hadoop pseudo-distribute examples failed

2011-05-20 Thread Kumar Kandasami
http://knowledgedonor.blogspot.com/2011/05/installing-cloudera-hadoop-hadoop-0202.html Kumar_/|\_ www.saisk.com ku...@saisk.com "making a profound difference with knowledge and creativity..." 2011/5/20 Kumar Kandasami > I have been setting up pseudo cluster on MAC - and the solution to the

Re: run hadoop pseudo-distribute examples failed

2011-05-20 Thread Kumar Kandasami
I have been setting up pseudo cluster on MAC - and the solution to the problem - you can try deleting all the data in the directory, and formating the namenode. see my blog outling - some of the issues/solutions that I have encountered in setting up a pseudo-distribute cluster on my MAC that might

Re: run hadoop pseudo-distribute examples failed

2011-05-20 Thread Marcos Ortiz
On 05/19/2011 10:35 PM, 李�S wrote: > Hi Marcos, > Thanks for your reply. > The temporary directory '/tmp/hadoop-xxx' is defined in hadoop core > jar's configuration file "*core-default.xml*". Do u think this may > cause the failure? Bellow is the detail config: > > > hadoop.tmp.dir > /

Re: TableSplit not implementing "hashCode" problem

2011-05-20 Thread Lucian Iordache
Hello, Thanks, you are right, I will do that. Regards, Lucian On Fri, May 20, 2011 at 4:08 PM, Harsh J wrote: > Hello Lucian, > > TableSplit appears to be a HBase component. Bugs/Patches against HBase > ought to go to the HBASE Jira project. > > On Fri, May 20, 2011 at 4:08 PM, Lucian Iordache

Re: TableSplit not implementing "hashCode" problem

2011-05-20 Thread Harsh J
Hello Lucian, TableSplit appears to be a HBase component. Bugs/Patches against HBase ought to go to the HBASE Jira project. On Fri, May 20, 2011 at 4:08 PM, Lucian Iordache wrote: > Hi guys, > > I've just found a problem with the class TableSplit. It implements "equals", > but it does not implem

TableSplit not implementing "hashCode" problem

2011-05-20 Thread Lucian Iordache
Hi guys, I've just found a problem with the class TableSplit. It implements "equals", but it does not implement hashCode also, as it should have. I've discovered it by trying to use a HashSet of TableSplit's, and I've noticed that some duplicate splits are added to the set. The only option I have