Re: Fairscheduler - disable "default" pool

2012-03-13 Thread Merto Mertek
Hm, I would like to achieve that if I call poolManager.getPools() I get just pools that I defined in my allocation file.. Harsh I tried your option too but it still shows on the servlet page which means it is present and still persist in poolManager.. Meanwhile I have found that probably I will ha

Re: Fairscheduler - disable "default" pool

2012-03-13 Thread Harsh J
Merto, Are you looking to disable all undefined pools completely, preventing submissions to it? For that, "mapred.fairscheduler.allow.undeclared.pools" needs to be set to false. On Wed, Mar 14, 2012 at 1:36 AM, Merto Mertek wrote: > Thanks for your workaround, but I think that with this you just

Re: Starting a Hadoop cluster.

2012-03-13 Thread Harsh J
Targino, Why are you looking to run Postgres off of HDFS? If you instead want a way to move data between your Hadoop cluster and your existing, external Postgres DB, take a look at Apache Sqoop at http://incubator.apache.org/sqoop/ which is built for exactly data-in/data-out purposes, catering to

Re: Fairscheduler - disable "default" pool

2012-03-13 Thread Merto Mertek
Thanks for your workaround, but I think that with this you just put a constraint on the pool that it will not accept any job. I am doing some calculation with weights and do not want the default pool weight to be included in the computation.. On 13 March 2012 18:52, Jean-Daniel Cryans wrote: >

Re: Starting a Hadoop cluster.

2012-03-13 Thread Targino Silveira
Hi Harsh, Another doubt is, HBase is like other database, it's Right ? If yes I can't use it, because I need to use PostgreSQL. When I spoken about tablespace, I sponken about a directory mounted where postgres will record data, it's should possible with FuseDFS, I don't know about speed, do you

Re: Fairscheduler - disable "default" pool

2012-03-13 Thread Jean-Daniel Cryans
We do it here by setting this: 0 So that you _must_ have a pool (that's configured with a different maxRunningJobs) in order to run jobs. Hope this helps, J-D On Tue, Mar 13, 2012 at 10:49 AM, Merto Mertek wrote: > I know that by design all unmarked jobs goes to that pool, however I am > doin

Fairscheduler - disable "default" pool

2012-03-13 Thread Merto Mertek
I know that by design all unmarked jobs goes to that pool, however I am doing some testing and I am interested if is possible to disable it.. Thanks

Permission Request for 'HDFS Users Guide...'

2012-03-13 Thread John Obri
Hello, I've known you website for ages! And I found interesting your publication "HDFS Users Guide" which I googled on http://hadoop.apache.org/common/docs/stable/hdfs_user_guide.html ! I'd love to use it in a project I'm involved with called "Geek Science", so I'm seeking your permission

SAML based Authentication

2012-03-13 Thread Benoy Antony
Hi All, I have a requirement to integrate a SAML Token based authentication module instead of Kerberos Authentication for authenticating users to Hadoop Servers (NN and JT) . This is for the CLI users and not for the web ui. The server Authentication can still be kerberos based. Does anyone e