Re: hbase Multi Node Setup

2012-01-03 Thread Hamed Ghavamnia
Is it normal that stopping the hbase cluster is really slow? Is it different to start/stop the hbase service through /etc/init.d/hadoop-hbase-master or hbase/bin/start-hdfs.sh? On Tue, Jan 3, 2012 at 8:55 AM, Hamed Ghavamnia ghavamni...@gmail.comwrote: To TS.chia, Thanks, but that's for

Re: hbase Multi Node Setup

2012-01-03 Thread Hamed Ghavamnia
Okay, I finally got it running :) The changes I made were, 1)Using the exact same hbase-site.xml in all the machines 2)Keeping the zookeeper on the hbase-master (which has my namenode as well) But I don't get why stopping the hbase-master takes so long, the zookeeper is easily stopped, the

File edit in Hadoop

2012-01-03 Thread Stuti Awasthi
Hi all, Wish you all a very Happy New Year. As I know that files once written in Hadoop are immutable. I can't edit the files in Apache distribution of Hadoop. I tried with MapR distribution and I am able to edit, replace the files with this distribution. I wanted to know does CDH3 also

Re: File edit in Hadoop

2012-01-03 Thread Todd Lipcon
On Tue, Jan 3, 2012 at 4:11 AM, Stuti Awasthi stutiawas...@hcl.com wrote: As I know that files once written in Hadoop are immutable. I can’t edit the files in Apache distribution of Hadoop. I tried with MapR distribution and I am able to edit, replace the files with this distribution. MapR

Hadoop HDFS Backup/Restore Solutions

2012-01-03 Thread Mac Noland
Good day,   I’m guessing this question been asked a myriad of times, but we’re about to get serious with some of our Hadoop implementations so I wanted to re-ask to see if I’m missing anything, or if others happen to know if this might be on a future road map.   For our current storage offerings

Re: Hadoop HDFS Backup/Restore Solutions

2012-01-03 Thread Mac Noland
Thanks for the reply Alex.  To make sure I understand: 1) park the data by sending it  over to a different cluster on a schedule (e.g. nightly is what we offer today on most things). 2) then from this secondary cluster, which is sitting idle after the distcp, do a copy local to a NFS mount

Re: Hadoop HDFS Backup/Restore Solutions

2012-01-03 Thread Joe Stein
you can also distcp to AWS S3 http://wiki.apache.org/hadoop/AmazonS3 which you can do as frequently as you like, even after the map/reduce job is done just ship it over On Tue, Jan 3, 2012 at 4:31 PM, Mac Noland mcdonaldnol...@yahoo.com wrote: Thanks for the reply Alex. To make sure I

Re: Hadoop HDFS Backup/Restore Solutions

2012-01-03 Thread Ted Dunning
MapR provides this out of the box in a completely Hadoop compatible environment. Doing this with straight Hadoop involves a fair bit of baling wire. On Tue, Jan 3, 2012 at 1:10 PM, alo alt wget.n...@googlemail.com wrote: Hi Mac, hdfs has at the moment no solution for an complete backup- and

Re: Hadoop HDFS Backup/Restore Solutions

2012-01-03 Thread Arun C Murthy
On Jan 3, 2012, at 2:07 PM, Ted Dunning wrote: MapR provides this out of the box in a completely Hadoop compatible environment. Does it support *secure* Hadoop clusters? Arun Doing this with straight Hadoop involves a fair bit of baling wire. On Tue, Jan 3, 2012 at 1:10 PM, alo alt

Re: File edit in Hadoop

2012-01-03 Thread M. C. Srivas
On Tue, Jan 3, 2012 at 4:11 AM, Stuti Awasthi stutiawas...@hcl.com wrote: Hi all, ** ** Wish you all a very Happy New Year. ** ** As I know that files once written in Hadoop are immutable. I can’t edit the files in Apache distribution of Hadoop. I tried with MapR

Re: File edit in Hadoop

2012-01-03 Thread Todd Papaioannou
Nice Freudian ;) On Jan 3, 2012, at 2:56 PM, M. C. Srivas wrote: MapR is the only distribution that supports MapR

Re: File edit in Hadoop

2012-01-03 Thread Arun C Murthy
Stuti - it's best to stick to questions about Apache Hadoop on *@hadoop.apache.org lists. The Apache Hadoop mailing lists exist to help users and developers of Apache Hadoop. For vendor specific questions use vendor specific lists and rely on your own homework - Srivas has very little

Permission to view the Video (http://vimeo.com/3584536)

2012-01-03 Thread krishnan N
Hi All, I am new to Hadoop and started learning the HDFS . I am unable to watch the video from the below link though I have access tohttps://Vimeo.comhttps://vimeo.com/ . It says I don't have permission to view the video. Please give me access to view the video so that it helps me to understand

Re: File edit in Hadoop

2012-01-03 Thread M. C. Srivas
On Tue, Jan 3, 2012 at 4:01 PM, Arun C Murthy a...@hortonworks.com wrote: Stuti - it's best to stick to questions about Apache Hadoop on *@hadoop.apache.org lists. The Apache Hadoop mailing lists exist to help users and developers of Apache Hadoop. For vendor specific questions use vendor

Re: Permission to view the Video (http://vimeo.com/3584536)

2012-01-03 Thread Hamed Ghavamnia
Hi, You can watch some of the training movies on the cloudera site. I watched them from there. http://www.cloudera.com/resources/?type=Training On Wed, Jan 4, 2012 at 4:29 AM, krishnan N krishnan.sm...@gmail.com wrote: Hi All, I am new to Hadoop and started learning the HDFS . I am unable to

MapReduce job failing when a node of cluster is rebooted

2012-01-03 Thread Rajat Goel
Posing the issue on this forum as well. Regards, Rajat -- Forwarded message -- From: Rajat Goel rajatgoe...@gmail.com Date: Wed, Dec 28, 2011 at 12:04 PM Subject: Re: MapReduce job failing when a node of cluster is rebooted To: common-u...@hadoop.apache.org No its not