Re:How to skip bad records in .19.1

2009-03-13 Thread
Thanks for your answer. I've found the problem that I fogot to implement the writable interface in my input values' class. Best wishes Song Liu from Suzhou University 在2009-03-13?17:19:35,"Sharad?Agarwal"??写道: >???comments?are?inline: > >柳松?wrote: > > >

How to skip bad records in .19.1

2009-03-12 Thread
Dear all: I have set the value "SkipBadRecords.setMapperMaxSkipRecords(conf, 1)", and also the "SkipBadRecords.setAttemptsToStartSkipping(conf, 2)". However, after 3 failed attempts, it gave me this exception message: java.lang.NullPointerException at org.apache.hadoop.io.seriali

The cpu preemption between MPI and Hadoop programs on Same Cluster

2009-03-05 Thread
Dear all:     I run my hadoop program with another MPI program on the same cluster. here is the result of "top".  PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 11750 qianglv 25 0 233m 99m 6100 R 99.7 2.5 116:05.59 rosetta.mpich 18094 cip 17 0

Re:Re: the question about the common pc?

2009-02-18 Thread
Actually, there's a widely misunderstanding of this "Common PC" . Common PC doesn't means PCs which are daily used, It means the performance of each node, can be measured by common pc's computing power. In the matter of fact, we dont use Gb enthernet for daily pcs' communication, we dont use li

Sogou Corpus Decoder/Codec for Hadoop

2009-02-18 Thread
Dear all! Can any one provide me a decoder or cdoec for Sogou Corpus? I'm analyzing Sogou Corpus using hadoop, but I cannot decode the .7z files. I have tried LZMA, but Idont know why it is not able to uncompress and decode the Sogou Corpus. If there are some one who like me are analysing this l

7Zip compression in Hadoop

2009-02-18 Thread
Hi all! I'm working on the Sogou Corpus Mining with hadoop mapreduce. However, the files are compressed as 7zip format. Does Hadoop has a built-in support for 7zip files? or I need to write a codec? Regards Song Liu in Suzhou Universtiy, China.

Re:How to integrate hadoop framework with web application

2008-11-23 Thread
Dear 晋光峰: Glad to see another Chinese name here. It sounds possible, but could you give us a little more detail? Best Regards. 在2008-11-24?09:41:15,"晋光峰"?<[EMAIL PROTECTED]>?写道: >Dear?all, > >Does?anyone?knows?how?to?integrate?hadoop?to?web?applications??I?want?to >startup?a?hadoop?job?by

Re:alternate

2008-11-19 Thread
啥? 在2008-11-20?12:44:55,"朱韬"?<[EMAIL PROTECTED]>?写道: ><[EMAIL PROTECTED]>

Re:A QQ group for Chinese Hadoop learners

2008-11-18 Thread
So glad to see so many Chinese guys here! I'm a undergraduate student in Soochow University and interested in this area. Wish I could attend the Beijing Meeting...however...I'm looking for a job now...so... Anyway, Glad to see you all! 在2008-11-18?13:30:31,bacoo_zh?<[EMAIL PROTECTED]>?写道: >

Re:0.18.2 release compiled with java 6 ?

2008-11-18 Thread
You can also rebuild the jar by compiling all the sources in the 'src' folder with your working jdk. 在2008-11-18?21:38:30,"Johannes?Zillmann"?<[EMAIL PROTECTED]>?写道: >Dear?Hadoop?Developers, > >i?work?on?a?java?5?project?and?during?upgrade?from?0.18.1?to?0.18.2?? >this?error?appears: > >...