Re: HDFS multi-tenancy and federation

Hi, Any help on this please? On Mon, Feb 3, 2014 at 12:14 PM, Shani Ranasinghe wrote: > > Hi, > I would like to know the following. > > 1) Can there be multiple namespaces in a single namenode? is it > recommended? (I'm having a multi-tenant environment in mind) > > 2) Let's say I have a feder

Re: HDFS multi-tenancy and federation

Hi Shani, I haven't done any implementation on HDFS federation, but as far as I know, 1 namenode can handle only 1 namespace at this time. I hope that helps. Regards Prav On Wed, Feb 5, 2014 at 8:05 AM, Shani Ranasinghe wrote: > Hi, > > Any help on this please? > > > > On Mon, Feb 3, 2014 at 1

Where to find a list of most Hadoop2 config file parameters?

Hello Folks, Is there a fairly complete list somewhere, giving most of the parameters from the configuration files for Apache Hadoop2 and MapReduce? (Including Yarn) I am especially interested in parameters that affect the activities of the ResouceManager and Application Masters, such as the pa

Re: Where to find a list of most Hadoop2 config file parameters?

Hey Bill, Most of the documented parameters can be found under the yarn-default.xml and mapred-default.xml with their descriptions: http://hadoop.apache.org/docs/stable2/hadoop-yarn/hadoop-yarn-common/yarn-default.xml and http://hadoop.apache.org/docs/stable2/hadoop-mapreduce-client/hadoop-mapred

hadoop 2.2.0 - test failure in released src pack

Hi, I am trying to run the src downloaded from http://archive.apache.org/dist/hadoop/core/hadoop-2.2.0/ for hadoop 2.2.0. I encounter the following test failure when a maven build is triggered with tests. However, builds fine without tests. Any idea on how to resolve this? Failed tests: testLoc

Re: hadoop 2.2.0 - test failure in released src pack

Hi, I got it working after modifying the pom file as explained in https://issues.apache.org/jira/secure/attachment/12614482/HADOOP-10110.patch . On Wed, Feb 5, 2014 at 4:18 PM, Shani Ranasinghe wrote: > Hi, > > I am trying to run the src downloaded from > http://archive.apache.org/dist/hadoop/

Re: hadoop 2.2.0 - test failure in released src pack

Hi, However I encountered the following issue. Appreciate any help. Results : Failed tests: testLocalHostNameForNullOrWild(org.apache.hadoop.security.TestSecurityUtil): expected: but was: Tests run: 2015, Failures: 1, Errors: 0, Skipped: 64 [INFO] --

Re: what happens to a client attempting to get a new app when the resource manager is already down

Is this on trunk or a released version? I think the default behavior (when RM HA is not enabled) shouldn't have client loop forever. Let me know and we can see if this needs fixing. Thanks, +vinod On Jan 31, 2014, at 7:52 AM, REYANE OUKPEDJO wrote: > Hi there, > > I am trying to solve a pr

Re: kerberos principals per node necessary?

For helping manage this, Hadoop lets you specify principles of the format hdfs/_HOST@SOME-REALM. Here _HOST is a special string that Hadoop interprets and replaces it with the local hostname. You need to create principles per host though. +Vinod On Feb 2, 2014, at 3:14 PM, Koert Kuipers wrote

Re: hadoop 2.2.0 - test failure in released src pack

you might have looked at it, but some how your hostname is returning uppercase and lowercase. Can you look in config files and see if it is in two different cases? On Wed, Feb 5, 2014 at 3:27 AM, Shani Ranasinghe wrote: > Hi, > > However I encountered the following issue. Appreciate any help

RE: what happens to a client attempting to get a new app when the resource manager is already down

Default Retry time period is 15 minutes. Setting configuration "yarn.resourcemanager.connect.max-wait.ms" to lesser value, retry period can be reduced in client side. Thanks & Regards Rohith Sharma K S From: Vinod Kumar Vavilapalli [mailto:vino...@hortonworks.com] On Behalf Of Vinod