Re: Standby Namenode and Datanode coexistence

2014-10-10 Thread oc tsdb
One more query we have - Standby namenode should be running with all the services that are running on active name node? or hadoop-hdfs-namenode is alone sufficient initially? Thanks oc.tsdb On Fri, Oct 10, 2014 at 10:06 AM, oc tsdb oc.t...@gmail.com wrote: Thank you.We understood. Thanks

Standby Namenode and Datanode coexistence

2014-10-09 Thread oc tsdb
Hi, We have cluster with 3 nodes (1 namenode + 2 datanodes). Cluster is running with hadoop 2.4.0 version. We would like to add High Availability(HA) to Namenode using the Quorum Journal Manager. As per the below link, we need two NN machines with same configuration.

Re: Standby Namenode and Datanode coexistence

2014-10-09 Thread oc tsdb
and DN on the same machine (unless you are in a DEV cluster and experimenting). On Thu, Oct 9, 2014 at 4:19 AM, oc tsdb oc.t...@gmail.com wrote: Hi, We have cluster with 3 nodes (1 namenode + 2 datanodes). Cluster is running with hadoop 2.4.0 version. We would like to add High Availability

hadoop-lzo rpm build

2014-07-06 Thread oc tsdb
Hi, We were able to build rpms for hadoop and hbase from bigtop packages.But we didn't find anything hadoop-lzo related stuff in bigtop utils. Can some one please points us from where we can download working hadoop-lzo source including spec file to build rpm for hadoop 2.4.0? Thanks oct.sdb

cluster migration from hadoop 1.2.1 to 2.4.0

2014-07-03 Thread oc tsdb
Hi, We have our hadoop cluster running with hadoop 1.2.1 and hbase 0.94.14. Now we are planing to move it to hadoop 2.4.0,hbase 0.98.2. if we migrate to the above newer versions, will there be any data loss? Do we need to take any cluster data backup before migrating to newer version of hadoop

Re: Name node and data node replacement

2013-12-11 Thread oc tsdb
. If not, try writing your edits to a nfs volume in additional to the local fs. There is no need to recover a DN. The NN compensates for a lost DN by using the other remaining replicas to create a new replica on another DN. Daryn On Dec 9, 2013, at 5:52 AM, oc tsdb oc.t...@gmail.com wrote

Re: Name node and data node replacement

2013-12-11 Thread oc tsdb
information and place those blocks on available data nodes if required. Regards Jitendra On Wed, Dec 11, 2013 at 1:57 PM, oc tsdb oc.t...@gmail.com wrote: Hi, Thanks for your response. You mean NN will always try to maintain number of replicas as configured even if one DN goes down and unable

Name node and data node replacement

2013-12-09 Thread oc tsdb
Hi, I am trying to understand,how to recover a Name node or Data node failure in case if those nodes are unable to come up due to unexpected issues. Is there a way to replace Name node with new name node without loosing data.I mean new Name node should have all the data from original Name node.

Re: is jdk required to run hadoop or jre alone is sufficient

2013-10-17 Thread oc tsdb
, and will not function without a JDK. On Wed, Oct 16, 2013 at 10:38 AM, oc tsdb oc.t...@gmail.com wrote: HI , I would like to know if JRE alone is sufficient to run HADOOP services or JDK is required ? we are planning to install latest stable version of hadoop Thanks, Oc.tsdb -- Harsh J

is jdk required to run hadoop or jre alone is sufficient

2013-10-15 Thread oc tsdb
HI , I would like to know if JRE alone is sufficient to run HADOOP services or JDK is required ? we are planning to install latest stable version of hadoop Thanks, Oc.tsdb

Log file size limiting and log file rotation configurations in hadoop

2013-10-03 Thread oc tsdb
Hi, Is there any configuration parameter in hadoop to limit the log file size?? and what parameter in configuration allows automatic rotation of log files in hadoop? Thanks, OC

compatible hadoop version for hbase-0.94.10

2013-08-07 Thread oc tsdb
Hi, I need to create a opentsdb cluster which needs hbase and hadoop. I picked the latest hbase supported by opentsdb which is hbase-.0.94.10 Can anybody please suggest which latest version of Hadoop I can use with hbase-0.94.10 Thanks in advance. Regards, VSR.

Re: compatible hadoop version for hbase-0.94.10

2013-08-07 Thread oc tsdb
Thanks Ted. Regards, OC. On Wed, Aug 7, 2013 at 12:22 PM, Ted Yu yuzhih...@gmail.com wrote: If you look at pom.xml for 0.94, you should see hadoop-1.1 and hadoop-1.2 profiles. Those hadoop releases (1.1.2 and 1.2.0, respectively) should work. On Wed, Aug 7, 2013 at 12:13 PM, oc tsdb