Re: Hadoop virtual machine

2014-07-06 Thread Manar Elkady
Thanks, for your help. On 7/6/2014 5:38 AM, Gavin Yue wrote: http://hortonworks.com/products/hortonworks-sandbox/ or CDH5 http://www.cloudera.com/content/cloudera-content/cloudera-docs/DemoVMs/Cloudera-QuickStart-VM/cloudera_quickstart_vm.html On Sat, Jul 5, 2014 at 11:27 PM, Manar Elkady

Re: Hadoop virtual machine

2014-07-06 Thread Marco Shaw
Note that the CDH link is for Cloudera which only provides Hadoop for Linux. HDP has "pre-built VMs" for both Linux and Windows hosts. You can also search for "HDInsight emulator" which runs on Windows and is based on HDP. Marco > On Jul 6, 2014, at 12:38 AM, Gavin Yue wrote: > > http://h

Re: Bugs while installing apache hadoop 2.4.0

2014-07-06 Thread Ritesh Kumar Singh
My hadoop is still giving the above mentioned error. Please help. On Thu, Jul 3, 2014 at 12:50 PM, Akira AJISAKA wrote: > You can download the source code and generate your own native library by > > $ mvn package -Pdist,native -Dtar -DskipTests > > You should see the library in 'hadoop-dist/t

Re: Hadoop virtual machine

2014-07-06 Thread MrAsanjar .
For my hadoop development and testing I use LXC (linux container) instead of VM, mainly due to its light weight resource consumption. As mater of fact as I am typing, my ubuntu system is automatically building a 6 nodes hadoop cluster on my 16G labtop. If you have an Ubuntu system you could install

Re: Significance of PID files

2014-07-06 Thread Giridhar Addepalli
At Daemon level. Thanks, Giridhar. On Fri, Jul 4, 2014 at 11:03 AM, Vijaya Narayana Reddy Bhoomi Reddy < vijay.bhoomire...@gmail.com> wrote: > Vikas, > > "Its main use is to keep one process at a time...like one one datanode at > a any host" - Can you please elaborate in a more detail? > > What

Re: Hadoop virtual machine

2014-07-06 Thread Andre Kelpe
We have a multi-vm or single-vm setup with apache hadoop, if you want to give that a spin: https://github.com/Cascading/vagrant-cascading-hadoop-cluster - André On Sun, Jul 6, 2014 at 9:05 AM, MrAsanjar . wrote: > For my hadoop development and testing I use LXC (linux container) instead > of V

Re: Hadoop virtual machine

2014-07-06 Thread jay vyas
I really like the Cascading recipes above, thanks for sharing that ! Also we have *apache bigtop vagrant recipes* which we curate for this kind of thing, which are really useful. You can spin up a 1 or multi node cluster, just by running the startup.sh script. Which are probably the most configu

java.net.SocketTimeoutException: read(2) error: Resource temporarily unavailable

2014-07-06 Thread lei liu
I use hbase-0.94 and hadoop-2.2, there is below exception: 2014-07-04 12:43:49,700 WARN org.apache.hadoop.hdfs.DFSClient: failed to connect to DomainSocket(fd=322,path=/home/hadoop/hadoop-current/cdh4-dn-socket/dn_socket) java.net.SocketTimeoutException: read(2) error: Resource temporarily unavai

Re: java.net.SocketTimeoutException: read(2) error: Resource temporarily unavailable

2014-07-06 Thread Jungi Jeong
Not sure exactly, but I had similar issues with Hadoop 1.2.1. If your machines do not have any network related issues (DNS, ping, etc), it can be disk-related (heavy disk usages). When the machine goes under heavy disk I/O, things get slow and expire the socketTimeOut, thus, this error can happen.

Re: Bugs while installing apache hadoop 2.4.0

2014-07-06 Thread Akira AJISAKA
Did you move your native library to /usr/local/hadoop/lib/native ? Thanks, Akira (2014/07/07 0:59), Ritesh Kumar Singh wrote: My hadoop is still giving the above mentioned error. Please help. On Thu, Jul 3, 2014 at 12:50 PM, Akira AJISAKA mailto:ajisa...@oss.nttdata.co.jp>> wrote: You ca

define "node"

2014-07-06 Thread Adaryl "Bob" Wakefield, MBA
If you have a server with more than one hard drive is that one node or n nodes where n = the number of hard drives? B.

Re: Bugs while installing apache hadoop 2.4.0

2014-07-06 Thread Vikas Srivastava
you need to remove 127.0.0.1 localhost and provide ip of hduser On Jul 6, 2014, at 8:59 AM, Ritesh Kumar Singh wrote: > My hadoop is still giving the above mentioned error. Please help. > > > On Thu, Jul 3, 2014 at 12:50 PM, Akira AJISAKA > wrote: > You can download the source code and gene

hadoop-lzo rpm build

2014-07-06 Thread oc tsdb
Hi, We were able to build rpms for hadoop and hbase from bigtop packages.But we didn't find anything hadoop-lzo related stuff in bigtop utils. Can some one please points us from where we can download working hadoop-lzo source including spec file to build rpm for hadoop 2.4.0? Thanks oct.sdb

What's the meaning of MemoryReserved and ContainersReserved

2014-07-06 Thread huozhanf...@gmail.com
Hi, I found the memory reserved exceed memory total in cluster metrics. And I'm very confused what's the meaning of memory reserved and how this metric is calculated? What I use is Fair Scheduler. Zhanfeng Huo