Re: EC2 scripts

2009-11-19 Thread Andrew Purtell
Thanks Naresh. Thanks for taking the time to try this out. I will incorporate your suggestions. > error: "fs.epoll.max_user_instance" is an unknown key This is a bit of future proofing. That's not a known sysctl key until kernel 2.6.27, at which point oddly low epoll user descriptor limits g

Re: EC2 scripts

2009-11-19 Thread Naresh Rapolu
Thanks Andrew, Your scripts are working fine. We restarted everything and tested, and they are working fine. A few issues though : - While starting, launch-hbase-cluster gives the following error. error: "fs.epoll.max_user_instance" is an unknown key.It occurs during starting

Re: ANN: hbase 0.20.2 is available for download

2009-11-19 Thread Jean-Daniel Cryans
You can go directly to 0.20.2 with a rolling restart http://wiki.apache.org/hadoop/Hbase/RollingRestart As usual, you probably want to qualify the release with your environment before doing the actual upgrade. J-D On Thu, Nov 19, 2009 at 1:46 PM, Vaibhav Puranik wrote: > We have 0.20.0 > > Shou

Re: ANN: hbase 0.20.2 is available for download

2009-11-19 Thread Vaibhav Puranik
We have 0.20.0 Should we upgrade 0.20.0 to 0.20.1 and then to 0.20.2? Is upgrading directly to 0.20.2 ok? Regards, Vaibhav Puranik Gumgum On Thu, Nov 19, 2009 at 12:08 PM, Jean-Daniel Cryans wrote: > hbase 0.20.2 is available for download: > http://hbase.org/releases.html. Forty issues have bee

Re: .deb

2009-11-19 Thread Lars George
Hi Andy, This was really more specific for the Cloudera distro, since I was asked that here: http://twitter.com/jmstriegel/statuses/5814363605 Thanks, Lars Andrew Purtell wrote: Hi, I made an RPM for the Cloudera Hadoop distribution. The details of it are quite distro specific. I haven

ANN: hbase 0.20.2 is available for download

2009-11-19 Thread Jean-Daniel Cryans
hbase 0.20.2 is available for download: http://hbase.org/releases.html. Forty issues have been addressed since hbase 0.20.1.  The release notes are available here: http://su.pr/1nnhl5.  Please upgrade at your convenience. This release contains mostly bug fixes, a new Cygwin documentation and a fas

Re: EC2 scripts

2009-11-19 Thread Andrew Purtell
I just performed the following steps: 1) Install pristine RHEL 5 (well, CentOS) system in VM. 2) Download and unzip the EC2 AMI and API tools zipfiles. 3) Put the tools on the path and set EC2_HOME in the environment. 4) Pristine checkout of HBase trunk. 5) Configure hbase-ec2-env.sh 6) ./bi

Re: EC2 scripts

2009-11-19 Thread Andrew Purtell
So it seems the slaves are not checking in with the master for some reason. Can you provide the log content from the slave instances in /mnt/hbase/logs/*.log ? What is the output of 'hadoop dfsadmin -report'? Thanks for trying this out Naresh. - Andy

Re: EC2 scripts

2009-11-19 Thread Naresh Rapolu
Thanks Andrew, We`ve made a private instance with our keys, by altering your public hbase AMI and used it to launch the cluster instances. We are now able to do "ssh slave" from master. But, still the problem persists. From the hbase shell of master, "status 'simple' " returns 0 live ser

Re: Zookeeper warnning message

2009-11-19 Thread stack
On Thu, Nov 19, 2009 at 3:40 AM, sadamichi wrote: > > Hi all, > > I need some advice about zookeeper log. > In my working environment, I have 3 active regionservers hbase0.20.1 and > hbase.zookeeper.leaderport 3888 is open on all servers,and > hbase.zookeeper.peerport 2888 is open only one region

Re: Image and Video data in HBASE

2009-11-19 Thread Nitin Tripathi
Hi, First my apologies for incorrectly using the mailing list as I was unable find the ways to reply to the original posted by Bharath. Here, is what is working for me. @ file storage - extract file content into byte array - store meta data associated with the file like (file type, file s

Re: HBase and Integration Tests

2009-11-19 Thread Andrew Purtell
Miroslav, > rollback could be executed in the @After method but don't know whether > the same thing could be done in hbase No the same thing cannot be done in HBase. Best regards, - Andy From: Miroslav Genov To: hbase-user@hadoop.apache.org Sent: Thu, N

Re: .deb

2009-11-19 Thread Andrew Purtell
Hi, I made an RPM for the Cloudera Hadoop distribution. The details of it are quite distro specific. I haven't heard anything from over there in a while. I don't see the practical value of making generic rpms or debs. The problem is the dependencies on and integration with Hadoop core, e.g. st

HBase and Integration Tests

2009-11-19 Thread Miroslav Genov
Hello, Is there any better way for cleaning of the test data after test's execution then manual clean up with Delete (i.e in the @After method) ? In relational database things get simpler with transactions, cause rollback could be executed in the @After method but don't know whether the same thi

Zookeeper warnning message

2009-11-19 Thread sadamichi
Hi all, I need some advice about zookeeper log. In my working environment, I have 3 active regionservers hbase0.20.1 and hbase.zookeeper.leaderport 3888 is open on all servers,and hbase.zookeeper.peerport 2888 is open only one region which has -ROOT- table server. This is the log from zookeeper

.deb

2009-11-19 Thread Lars George
Hi, I know that Andrew Purtell did compile a .rpm for HBase, do we still have that and is current? Is there a .deb too? Would it make sense to have that either in a separate build script in /contrib or is that part of the main build.xml? Just wondering. Lars

Re: Semantics of the split function

2009-11-19 Thread Andrew Purtell
Naresh, > How many regions are created after splitting the one region ? Two. > Do all the split regions remain on the same node that hosted the first region? One half remains on the same node. The other is closed and released for reassignment. Depending on the number of nodes and current clus