RE: Hadoop 2.6.0 Error

2015-03-25 Thread hadoop.support
Hello Anand, Set your Java home in hadoop-env.sh - /usr/local/hadoop/etc/hadoop/hadoop-env.sh export JAVA_HOME='/usr/lib/jvm/java-7-openjdk-amd64' It would resolve your error. Thanks, S.RagavendraGanesh ViSolve Hadoop Support Team ViSolve Inc. | San Jose, California Website:

RE: Intermittent BindException during long MR jobs

2015-02-26 Thread hadoop.support
Hello Krishna, Exception seems to be IP specific. It might be occurred due to unavailability of IP address in the system to assign. Double check the IP address availability and run the job. Thanks, S.RagavendraGanesh ViSolve Hadoop Support Team ViSolve Inc. | San Jose, California

RE: Hadoop - HTTPS communication between nodes - How to Confirm ?

2015-02-22 Thread hadoop.support
Thanks for the help Ulul/Daemeon, Problem has sorted using lsof –p datanode pid command. Thanks, S.RagavendraGanesh ViSolve Hadoop Support Team ViSolve Inc. | San Jose, California Website: www.visolve.com http://www.visolve.com Email: servi...@visolve.com mailto:servi...@visolve.com

RE: Copy data between clusters during the job execution.

2015-02-02 Thread hadoop.support
It seems in your first error message, you have missed the source directory argument by a bit. One common usage of distcp is : Distcp (solution to your problem) hadoop distcp hdfs://hadoop-coc-1:50070/input1 hdfs://hadoop-coc-2:50070/some1 It is also wise to use latest tool: distcp2

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread hadoop.support
Hello Harun, Your question is very interesting and will be useful for future Hadoop setups for startup/individuals too. Normally for testing purposes, we prefer you to use pseudo-distributed environments (i.e. installation of all cluster files in single node). You can refer few links

RE: About HDFS's single-writer, multiple-reader model, any use case?

2015-02-01 Thread hadoop.support
Hello Dongzhe Ma, Yes HDFS employs Single writer, multiple reader model. This means : WRITE • HDFS client maintains a lease on files it opened for write (for entire file not for block) • Only one client can hold a lease on a single file • For each block of data, setup

RE: Enable symlinks

2015-01-22 Thread hadoop.support
Hello Tang, There are few resolved issues which might help you with this https://issues.apache.org/jira/browse/HDFS-6629 https://issues.apache.org/jira/browse/HDFS-245 Hope it helps!!! Thanks and Regards, S.RagavendraGanesh Hadoop Support Team ViSolve Inc.|

Re: Hadoop testing with 72GB HDD?

2015-01-04 Thread hadoop.support
Yes Amjad, Virtualization is nothing but a layer where you can different instances of Operating systems running on same machine. I don’t see any difference in using real Hardware with Virtualization. One advantage with Virtualization is you can have multiple instances of OS on Same machine