Re: HadoopV2 and HDFS-fuse

2013-06-09 Thread Azuryy Yu
hi Harsh, yes, I‘ve build native -Pnative successfully. I also used -Drequire.fuse=true. but I just found contrib/fuse directory is empty. so I asked this question, Thanks Harsh. --Send from my Sony mobile. On Jun 9, 2013 9:09 PM, "Harsh J" wrote: > Hi Azuryy, > > Are you not finding it compil

Re: Management API

2013-06-09 Thread Rita
Are there any specs for the JSON schema? On Thu, Jun 6, 2013 at 9:49 AM, MARCOS MEDRADO RUBINELLI < marc...@buscapecompany.com> wrote: > Brian, > > If you have access to the web UI, you can get those metrics in JSON from > the JMXJsonServlet. Try hitting > http://namenode_hostname:50070/jmx?qry

Re: Management API

2013-06-09 Thread MARCOS MEDRADO RUBINELLI
Brian, If you have access to the web UI, you can get those metrics in JSON from the JMXJsonServlet. Try hitting http://namenode_hostname:50070/jmx?qry=Hadoop:* and http://jobtracker_v1_hostname:50030/jmx?qry=hadoop:* It isn't as extensive as other options, but if you just need a snapshot of nod

Re: HadoopV2 and HDFS-fuse

2013-06-09 Thread Harsh J
Hi Azuryy, Are you not finding it compiled with the global native compile option? Do you face a specific error? Per the pom.xml of hadoop-hdfs, it will build fuse-dfs if native profile is turned on, and you can assert for fuse-requirement with -Drequire.fuse=true. On Sun, Jun 9, 2013 at 11:03 AM

Re: Why my tests shows Yarn is worse than MRv1 for terasort?

2013-06-09 Thread Harsh J
Hi Sam, > - How to know the container number? Why you say it will be 22 containers due > to a 22 GB memory? The MR2's default configuration requests 1 GB resource each for Map and Reduce containers. It requests 1.5 GB for the AM container that runs the job, additionally. This is tunable using th

Re: Why my tests shows Yarn is worse than MRv1 for terasort?

2013-06-09 Thread sam liu
Hi Harsh, According to above suggestions, I removed the duplication of setting, and reduce the value of 'yarn.nodemanager.resource.cpu-cores', ' yarn.nodemanager.vcores-pcores-ratio' and ' yarn.nodemanager.resource.memory-mb' to 16, 8 and 12000. Ant then, the efficiency improved about 18%. I have