Re: Adding extra commands to MR AM

2014-11-13 Thread Arun Murthy
You mean to the JVM of the MRAppMaster? property nameyarn.app.mapreduce.am.command-opts/name value-Xmx1024m/value descriptionJava opts for the MR App Master processes. The following symbol, if present, will be interpolated: @taskid@ is replaced by current TaskID. Any other occurrences

Re: Sr.Technical Architect/Technical Architect/Sr. Hadoop /Big Data Developer for CA, GA, NJ, NY, AZ Locations_(FTE)Full Time Employment

2014-11-13 Thread Johnny Johnson
Nice work Mark! I too am hopeful to land a big data position some day but have very little experience and knowledge. Good luck sir! Johnny On Wed, Nov 12, 2014 at 7:17 PM, mark charts mcha...@yahoo.com wrote: Hello. I am interested. Attached are my cover letter and my resume. Mark

Re: Adding extra commands to MR AM

2014-11-13 Thread Yehia Elshater
Yes Arun, that is what I need. Thanks a lot. Yehia On 13 November 2014 08:55, Arun Murthy a...@hortonworks.com wrote: You mean to the JVM of the MRAppMaster? property nameyarn.app.mapreduce.am.command-opts/name value-Xmx1024m/value descriptionJava opts for the MR App Master

Re: Both hadoop fsck and dfsadmin can not detect missing replica in time?

2014-11-13 Thread sam liu
Is that a bug of hadoop fsck or dfsadmin? As they really did not defect the missing replica data on a datanode. 2014-11-13 13:43 GMT+08:00 sam liu samliuhad...@gmail.com: Hi Experts, In my hdfs, there is a file named /tmp/test.txt belonging to 1 block with 2 replica. The block id is

Re: Both hadoop fsck and dfsadmin can not detect missing replica in time?

2014-11-13 Thread daemeon reiydelle
Exactly HOW did you manually remove the block? sent from my mobile Daemeon C.M. Reiydelle USA 415.501.0198 London +44.0.20.8144.9872 On Nov 12, 2014 9:45 PM, sam liu samliuhad...@gmail.com wrote: Hi Experts, In my hdfs, there is a file named /tmp/test.txt belonging to 1 block with 2 replica.

Re: Both hadoop fsck and dfsadmin can not detect missing replica in time?

2014-11-13 Thread sam liu
I manually removed the block replica file on datanode and the removed file path is '${dfs.datanode.data.dir}/current/BP-1640683473-9.181. 64.230-1415757100604/current/finalized/subdir52/blk_1073742304'. 2014-11-14 11:15 GMT+08:00 daemeon reiydelle daeme...@gmail.com: Exactly HOW did you

Upgrade Snappy jar

2014-11-13 Thread Naveen Kumar Pokala
Hi, I want to upgrade snappy java jar version. How to do that? -Naveen

FW: Upgrade Snappy jar

2014-11-13 Thread Naveen Kumar Pokala
Hi, I am using hadoop 2.4.0. I am receiving snappy error( FAILED TO LOAD NATIVE LIBRARY). In recent versions of snappy they resolved the issue. So I want to keep the latest jar in my hadoop 2.4.0. Where should I keep the latest jar in hadoop installation. -Naveen From: Naveen Kumar Pokala