Re: [gentoo-user] Re: Clusters on Gentoo ?

2014-08-08 Thread Alec Ten Harmsel
On Fri 08 Aug 2014 02:29:55 AM EDT, J. Roeleveld wrote:

> If you already make custom RPMs, why not build binary packages for a Gentoo 
> based cluster?

I was mistaken last night (probably a little tired, been driving all
day) - we use RedHat for the support and because the software we run
usually only officially supports RHEL and maybe Debian.

My bad.

Alec



Re: [gentoo-user] Re: Clusters on Gentoo ?

2014-08-07 Thread J. Roeleveld
On Thursday, August 07, 2014 10:36:35 PM Alec Ten Harmsel wrote:
> > Which operating systems does you Hadoop systems run on top of?
> 
> We use RedHat, although we make a fair amount of custom RPMs. It's just
> too much having to deal with Gentoo while maintaining high performance
> filesystems and schedulers, which are apparently a real pain.

If you already make custom RPMs, why not build binary packages for a Gentoo 
based cluster?

> > Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop
> 
> expertise (California) : "Extremely competitive pay: 150-175K base
> salary, large bonus plan, and a generous equity stake"

I'm wondering what "Unlimited vacation policy" actually means.

> Lolz, a few of the full time staff regularly get headhunted for similar
> positions. I'm still a student and would like to finish the degree,
> though, so no high paying jobs for me yet.

Good decision.

--
Joost



Re: [gentoo-user] Re: Clusters on Gentoo ?

2014-08-07 Thread Alec Ten Harmsel
> Which operating systems does you Hadoop systems run on top of?

We use RedHat, although we make a fair amount of custom RPMs. It's just
too much having to deal with Gentoo while maintaining high performance
filesystems and schedulers, which are apparently a real pain.

> Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop
expertise (California) : "Extremely competitive pay: 150-175K base
salary, large bonus plan, and a generous equity stake"

Lolz, a few of the full time staff regularly get headhunted for similar
positions. I'm still a student and would like to finish the degree,
though, so no high paying jobs for me yet.

Alec



[gentoo-user] Re: Clusters on Gentoo ?

2014-08-07 Thread James
Alec Ten Harmsel  alectenharmsel.com> writes:


> I'm a Hadoop and related software sysadmin at the University of 
> Michigan. I'm a student still, so it's only a part-time position. I 
> have some documentation at http://caen.github.io/hadoop - if something 
> is not clear, I will gladly take feedback and make appropriate changes.

>  I'll try to chime in on any questions about scheduling/clusters in the 
> future as we have a pretty large installation (~20,000 cores) running a 
> traditional HPC stack, and a small Hadoop cluster.

> > [2] http://hadoop.apache.org/docs/r1.2.1/cluster_setup.html
 
> Hadoop is currently "stable" on 2.x (specifically 2.4), so relevant 
> documentation is at http://hadoop.apache.org/docs/stable.


Which operating systems does you Hadoop systems run on top of?


Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop
expertise (California)  :

"Extremely competitive pay: 150-175K base salary, large bonus plan, and a
generous equity stake"


http://www.cybercoders.com/principal-software-engineer-backend-technology-agnostic-job-157829?jobId=EON-1157039&ad=recruiticsindeed&rx_job=19411798&rx_source=Indeed&rx_campaign=Indeed15&rx_medium=CPC


enjoy!
James