Re: Question about Hadoop

Hi You need to check your resourcemanager log and the container log which container allocate by your RM. 发自我的 iPhone 在 2013-8-6，15:30，manish dunani manishd...@gmail.com 写道： After checking ur error code. I think u entered wrong map and reduce class. can u pls show me code?? Then

Re: datanode error Cannot append to a non-existent replica BP-1099828917-192.168.10.22-1373361366827:blk_7796221171187533460_

Hi I think it is important to make Clare how does the replica is missing. Here is an scenario: the disk of your datanode was broken down or the replic was just deleted, so that the append failed. Can you get similar log of your cluster? 发自我的 iPhone 在 2013-7-31，15:01，Jitendra Yadav

Re: hprof profiler output location

Hi Rahul I even search the files using find / - name attemp*.profile.but still nothing was found. Can you indicate the format of the file name. Thanks 发自我的 iPhone 在 2013-6-18，20:27，Rahul Bhattacharjee rahul.rec@gmail.com 写道： In the same directory from which the job has

Re: Need help about task slots

Hi The concept of task slots is used in MRv1. In the new version of Hadoop ,MRv2 uses yarn instead of slots. You can read it from Hadoop definitive 3rd. 发自我的 iPhone 在 2013-5-12，20:11，Mohammad Tariq donta...@gmail.com 写道： Sorry for the blunder guys. Warm Regards,

Re: issues with decrease the default.block.size

Hi harsh Yep. Regards 发自我的 iPhone 在 2013-5-10，13:27，Harsh J ha...@cloudera.com 写道： Are you looking to decrease it to get more parallel map tasks out of the small files? Are you currently CPU bound on processing these small files? On Thu, May 9, 2013 at 9:12 PM, YouPeng Yang

Re: Uber Job!

Hi Suppose that your input file are 10 with total size 64mb , I think you will get the 10 maps. By the ways,the uber mode is only for yarn . Suppose you have actually 1 map ,yarn will at least create two containers , one for app master and the other for the map , if uber mode is

Re: Multiple ways to write Hadoop program driver - Which one to choose?

Hi sheikhar The deprecated job constructor is actually deprecated according to the job source code . There is another constructor witch is not deprecated ,you can find in the hint raised by eclipse . 发自我的 iPhone 在 2013-4-24，13:53，Chandrashekhar Kotekar shekhar.kote...@gmail.com

Re: ganglia net URL unavailable

Hi Haha, I see . I will let my Japanese workmates download it for my Thanks a lot for your advises. Regards 发自我的 iPhone 在 2013-4-22，17:03，kevenking kevenk...@gmail.com 写道： you should use freegate to bypass the GFW, you'll find it by search engines. 在 2013-4-22，16:55，YouPeng

Re: Configuration clone constructor not cloning classloader

Hi Tom I'm curious about that are you the author of the Hadoop definitive . Sorry to ask the uncorrelated question . Regards 发自我的 iPhone 在 2013-4-19，20:51，Tom White t...@cloudera.com 写道： Hi Amit, It is a bug, fixed by https://issues.apache.org/jira/browse/HADOOP-6103, although the

Re: Map‘s number with NLineInputFormat

, Apr 20, 2013 at 6:48 AM, yypvsxf19870706 yypvsxf19870...@gmail.com wrote: Hi I thought it would be different when adopt the NLineInputFormat So here is my conclusion the maps distribution has nothing with the NLineInputFormat . The NLineInputFormat could decide the number of row to each map

Re: Map‘s number with NLineInputFormat

Hi I thought it would be different when adopt the NLineInputFormat So here is my conclusion the maps distribution has nothing with the NLineInputFormat . The NLineInputFormat could decide the number of row to each map, which map has been generated according to the split.size . An I

Re: No bulid.xml when to build FUSE

Hi Jay I only get to know the way to build the fuse through the doc Readme.txt in the fuse-dfs directory . The readme file indicate to use the ant ,but no information about using the maven. Also I want to integrate the hdfs with fuse right now. Is there any docs about building

Re: MAP_INPUT_BYTES missing from counters

Hi Is your input file compressed or named with the suffix gz ,or like that? It is interesting . Map_input_bytes is the number of bytes of uncompressed input consumed by all the maps in the job.incremented every time a record is read from a RecordReader and passed to the map's

Re: Error while running MapR program on multinode configuration

Hi all However,I do think the export jar contains external libraries is too huge to be submitted to the MP by the client. So It comes to the conclusion that the jar without the external jars could be suited the situation ,however the runnable jar brings the errors. How to solve the

Re: Error while running MapR program on multinode configuration

, yypvsxf19870706 yypvsxf19870...@gmail.com wrote: Hi all However,I do think the export jar contains external libraries is too huge to be submitted to the MP by the client. So It comes to the conclusion that the jar without the external jars could be suited the situation ,however

Re: MultipleInputs.addInputPath compile error in eclipse(indigo)

hi wow，thank you liang 发自我的 iPhone 在 2013-4-2，17:25，Yanbo Liang yanboha...@gmail.com 写道： You set the wrong parameter NodeReducer.class which should be subclass of Mapper rather than Reducer. 2013/4/2 YouPeng Yang yypvsxf19870...@gmail.com HI GUYS I want to use the the

Re: Increase the number of mappers in PM mode

hi： i think i have got it . Thank you. 发自我的 iPhone 在 2013-3-15，18:32，Zheyi RONG rongzh...@gmail.com 写道： Indeed you cannot explicitly set the number of mappers, but still you can gain some control over it, by setting mapred.max.split.size, or mapred.min.split.size. For example, if you

Re: 答复: Why hadoop is spawing two map over file size 1.5 KB ?

Hi We just have discussed about the similar problem(the title is Increase the number of mappers in PM mode),as I thought. First of all you can not setup the the number of mappers.however you change the mapred.max.split.size, or mapred.min.split.size ,the number of the mapper will change