Re: [gentoo-user] Re: Clusters on Gentoo ?
On Fri 08 Aug 2014 02:29:55 AM EDT, J. Roeleveld wrote: > If you already make custom RPMs, why not build binary packages for a Gentoo > based cluster? I was mistaken last night (probably a little tired, been driving all day) - we use RedHat for the support and because the software we run usually only officially supports RHEL and maybe Debian. My bad. Alec
Re: [gentoo-user] Re: Clusters on Gentoo ?
On Thursday, August 07, 2014 10:36:35 PM Alec Ten Harmsel wrote: > > Which operating systems does you Hadoop systems run on top of? > > We use RedHat, although we make a fair amount of custom RPMs. It's just > too much having to deal with Gentoo while maintaining high performance > filesystems and schedulers, which are apparently a real pain. If you already make custom RPMs, why not build binary packages for a Gentoo based cluster? > > Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop > > expertise (California) : "Extremely competitive pay: 150-175K base > salary, large bonus plan, and a generous equity stake" I'm wondering what "Unlimited vacation policy" actually means. > Lolz, a few of the full time staff regularly get headhunted for similar > positions. I'm still a student and would like to finish the degree, > though, so no high paying jobs for me yet. Good decision. -- Joost
Re: [gentoo-user] Re: Clusters on Gentoo ?
> Which operating systems does you Hadoop systems run on top of? We use RedHat, although we make a fair amount of custom RPMs. It's just too much having to deal with Gentoo while maintaining high performance filesystems and schedulers, which are apparently a real pain. > Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop expertise (California) : "Extremely competitive pay: 150-175K base salary, large bonus plan, and a generous equity stake" Lolz, a few of the full time staff regularly get headhunted for similar positions. I'm still a student and would like to finish the degree, though, so no high paying jobs for me yet. Alec
[gentoo-user] Re: Clusters on Gentoo ?
Alec Ten Harmsel alectenharmsel.com> writes: > I'm a Hadoop and related software sysadmin at the University of > Michigan. I'm a student still, so it's only a part-time position. I > have some documentation at http://caen.github.io/hadoop - if something > is not clear, I will gladly take feedback and make appropriate changes. > I'll try to chime in on any questions about scheduling/clusters in the > future as we have a pretty large installation (~20,000 cores) running a > traditional HPC stack, and a small Hadoop cluster. > > [2] http://hadoop.apache.org/docs/r1.2.1/cluster_setup.html > Hadoop is currently "stable" on 2.x (specifically 2.4), so relevant > documentation is at http://hadoop.apache.org/docs/stable. Which operating systems does you Hadoop systems run on top of? Whilst research, I ran across a FAT PAYCHECK at a startup for Hadoop expertise (California) : "Extremely competitive pay: 150-175K base salary, large bonus plan, and a generous equity stake" http://www.cybercoders.com/principal-software-engineer-backend-technology-agnostic-job-157829?jobId=EON-1157039&ad=recruiticsindeed&rx_job=19411798&rx_source=Indeed&rx_campaign=Indeed15&rx_medium=CPC enjoy! James