Hardware requirements for simple node hadoop cluster

Hello, We are trying to do a proof of concept at our Data center with two node hadoop cluster. We have two (dual socket quad core ) HP proliant DL 380G6 servers we want to utilize for this test. Can any one please recommend the minimum HDD and RAM requirements for both servers ? Thanks

Re: Hardware requirements for simple node hadoop cluster

for balanced conf you need (per core) 1-1.5 2 GB 7200 SATA hdd for hdfs (in JBOD mode, not RAID) 3-4 GB RAM ECC reserve 4GB RAM for OS better to use separate hdd or usb stick for OS e.g. for 16 cores you can use 16-24 2GB hdds 64 GB RAM (if planing to use Apache Spark put 128 GB) On Sun, D

compiling individual modules

Hi, I am trying to compile individual modules and getting enforcer error with depcheck. is there a way I can disable this ? I just want to build one jar and replace it in my cluster. I don't want to build whole hadoop for this single jar. Appreciate any inputs. [INFO] ---

Re: compiling individual modules

Can you pastebin the error preceding the lines you posted ? What command did you use ? Cheers On Sun, Dec 7, 2014 at 7:53 AM, Srinivas Chamarthi < srinivas.chamar...@gmail.com> wrote: > Hi, > > I am trying to compile individual modules and getting enforcer error with > depcheck. is there a way

Hadoop 2.5.2 and Hadoop 2.6.0 - 64bit Version uploaded

Hi I have uploaded the 64 bit versions of hadoop-2.5.2 and hadoop-2.6.0. Please feel free to download. hadoop-2.5.2 https://drive.google.com/file/d/0B_T5OOp6-LCeUng3TDNxUHYxbFE/view?usp=sharing hadoop-2.6.0 https://drive.google.com/file/d/0B_T5OOp6-LCeSFFwb2VmU3Y2ZkE/view?usp=sharing Thank

Re: UNSUBSCRIBE

Not again. The sky must indeed be falling. On Saturday, December 6, 2014 2:36 PM, DB Bee wrote: Please unsubscribe. Thanks Thanks

Re: compiling individual modules

mvn -DskipTests package in already built project for modified changes (TaskImpl.java) On Sun, Dec 7, 2014 at 8:01 AM, Ted Yu wrote: > Can you pastebin the error preceding the lines you posted ? > > What command did you use ? > > Cheers > > On Sun, Dec 7, 2014 at 7:53 AM, Srinivas Chamarthi < >

Re: compiling individual modules

I used the following command under these directories: hadoop-mapreduce-project/hadoop-mapreduce-client/ hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app mvn -am -DskipTests package Both completed successfully. On Sun, Dec 7, 2014 at 2:04 PM, Srinivas Chamarthi < srini