Re: regarding to HBase 1316 ZooKeeper: use native threads to avoid GC stalls (JNI integration)

2009-10-27 Thread nitay
Hi Zhenyu, Sorry for the delay. I started working on this a while back, before I left my job for another company. Since then I haven't had much time to work on HBase unfortunately :(. I'll try to dig up what I had and see what shape it's in and update you. Cheers, -n On Oct 27, 2009, at

Re: reminder, HUG7 and hackathon, August 7-9, SF

2009-08-07 Thread nitay
Sorry boys, but I won't be able to make the HUG tonight. I have a doctor's appointment with conflicting times that can't be moved. I'll see you all at the hackathon tomorrow though :). -n On Jul 25, 2009, at 3:16 PM, Ryan Rawson wrote: Hi all, This is a reminder of HUG7 and HBase hackatho

Re: hbase/zookeeper

2009-07-14 Thread Nitay
gt; Ryan Rawson wrote: > >> > >> I run my ZK quorum on my regionservers, but I also have 16 GB ram per > >> regionserver. I used to run 1gb, and never had problems. Now with > >> hbase managing the quorum I have 5gb ram, and its probalby over kill > >>

Re: Exception while trying list tables in Hbase 0.20 alpha

2009-07-14 Thread Nitay
Hi Saptarshi, HBase should recover from WARNs like that. We'd need to see more information around that to get full context. Can you run your command again with DEBUG enabled and provide a full log? -n On Tue, Jul 14, 2009 at 10:05 AM, Saptarshi Guha wrote: > Hello, > I installed Hbase 0.20 alph

Re: hbase/zookeeper

2009-07-14 Thread Nitay
Hi Fernando, It is recommended that you run ZooKeeper separate from the Region Servers. On the memory side, our use of ZooKeeper in terms of data stored is minimal currently. However you definitely don't want it to swap and you want to be able to handle a large number of connections. A safe value

Re: Delete issue in HBase 0.20 alpha

2009-07-10 Thread Nitay
Hi Bryan, FYI, I think the latest trunk (with HBASE-1639), should fix the problems you were seeing. Thanks, -n On Fri, Jul 10, 2009 at 12:27 AM, Nitay wrote: > Yeah, my fault. I checked in something to handle the full quorum ZooKeeper > but didn't realize I broke the basic case. M

Re: Delete issue in HBase 0.20 alpha

2009-07-10 Thread Nitay
, just using the default hbase-default.xml as-is > > (which appears to be setup for standalone mode), and not creating a > zoo.cfg. > > The only thing I am changing is the JAVA_HOME in hbase-env.sh. > > > > > > On Thu, Jul 9, 2009 at 4:36 PM, Nitay wrote: >

Re: Delete issue in HBase 0.20 alpha

2009-07-09 Thread Nitay
Hi Bryan, For the latest trunk, are you using your own zoo.cfg, or overwriting the options from hbase-default.xml? -n On Thu, Jul 9, 2009 at 4:20 PM, Bryan Keller wrote: > I can't get the trunk to run. > Looks like the way Zookeeper starts has change, and it tries to map my > DHCP-assigned IP

Re: post-1606 world

2009-07-06 Thread Nitay
at helps. -n On Sun, Jul 5, 2009 at 9:13 PM, Rong-en Fan wrote: > After 1606 went in, how can I proper configure zookeeper and start it? > Tried it during the weekend, looks like current HBASE_MANAGES_ZK > is broken. In 1606, Nitay, mentioned there is a ZKServerTool? > > BTW, it see

Re: Does HBASE allow multiple clients write to the same table?

2009-07-02 Thread Nitay
Hi Fleming, That warning is harmless. It should recover after such things. If you ever see some fatal problems (crashes, data loss, corruption, etc) after such a thing let us know. HBase should handle multiple clients writing to the same table fine. You will get better performance if they are wri

Re: Region servers going down frequently (0.20 alpha)

2009-06-30 Thread Nitay
igned to other RS, > inconsistent behavior, it used to fail to serve earlier > Attached the full region server log > > > Thanks, > Murali Krishna > > > From: Nitay > To: hbase-user@hadoop.apache.org > Sent: Tuesday, 30 June, 2009 1

Re: Region servers going down frequently (0.20 alpha)

2009-06-29 Thread Nitay
Hi Murali, Sorry I'm late the join the conversation. Yes, running a full ZK quorum (3 or 5 servers) is key for handling the sort of load you are seeing. About the RegionServer not coming back up, can you provide us the full logs (with DEBUG enabled) on those machines? Thanks, -n On Mon, Jun 29

Re: HBase .20 startup

2009-06-18 Thread Nitay
Also in the shell, try the zk and/or zk_dump commands. I'm curious what, if any, errors those give you. On Thu, Jun 18, 2009 at 3:39 PM, Nitay wrote: > Do you see a line with "Quorum servers: ..."? That is where ZooKeeper > is expected to be running. Can you reach those ho

Re: HBase .20 startup

2009-06-18 Thread Nitay
Do you see a line with "Quorum servers: ..."? That is where ZooKeeper is expected to be running. Can you reach those host/ports? Can you try the ZooKeeper admin commands? http://hadoop.apache.org/zookeeper/docs/r3.0.1/zookeeperAdmin.html#sc_zkCommands -n On Thu, Jun 18, 2009 at 3:33 PM, llpind

Re: cloudera vm

2009-06-12 Thread Nitay
Hi Alexandre, I'd recommend you contact Cloudera directly (i...@cloudera.com or train...@cloudera.com). Also you can try the Hadoop list ( core-u...@hadoop.apache.org). This type of questions belongs better with them. Cheers, -n On Fri, Jun 12, 2009 at 8:47 AM, Alexandre Jaquet wrote: > Hi, > >

Re: Problems when executing many (?) HTable.lockRow()

2009-05-14 Thread Nitay
I like this a lot Guilherme. Perhaps we should open a JIRA with them so we can track these great ideas. On Thu, May 14, 2009 at 7:05 PM, Ryan Rawson wrote: > Given the non core nature, I think the api should potentially facilitate > this but the code should be contrib. > > On May 14, 2009 5:32 P

Re: Non relational db meetup - San Francisco, June 11th

2009-05-12 Thread Nitay
Anyone know if this meetup will be videotaped and put online? I can't attend but would like to watch. Thanks, -n On Tue, May 12, 2009 at 8:45 AM, Johan Oskarsson wrote: > HBase will be represented by Ryan Rawson on a free full day > meetup covering "open source, distributed, non relational data

Re: Hadoop internal details

2009-05-07 Thread Nitay
This is better directed at the Hadoop mailing lists. I've added hadoop core user mailing list to your query. Cheers, -n On Thu, May 7, 2009 at 1:11 AM, monty123 wrote: > > My query is how hadoop manages map files, files etc. stuffs. What is the > internal data structure is uses to manage things

Re: HBase internal data structure ??

2009-05-06 Thread Nitay
Take a look at architecture page on the wiki: http://wiki.apache.org/hadoop/Hbase/HbaseArchitecture Cheers, -n On Wed, May 6, 2009 at 12:27 AM, monty123 wrote: > > Hi All, > > I a newbie to hbase, > my question is how HBase internally manages data, what data structre it > uses > to store and ma

Re: Error in .20-dev : NotAllMetaRegionsOnlineException

2009-04-30 Thread Nitay
er > > > Also, the page on :60100 loads, and gives me a bunch of lines like this: > > Trying to contact region server null for region , row '', but failed > after 10 attempts. > Exceptions: > org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out

Re: Error in .20-dev : NotAllMetaRegionsOnlineException

2009-04-30 Thread Nitay
mail.com> wrote: > Getting a lot of classpath problems trying to run Zookeeper the > one thing I hate the most about Java :) > > BTW, are Hadoop .19.1 and HBase .20-dev compatible? > > On Thu, Apr 30, 2009 at 2:49 PM, Nitay wrote: > > Yes that seems fine. What

Re: Error in .20-dev : NotAllMetaRegionsOnlineException

2009-04-30 Thread Nitay
een > # sending a request and getting an acknowledgement > syncLimit=5 > # the directory where the snapshot is stored. > dataDir=${hbase.tmp.dir}/zookeeper > # the port at which the clients will connect > clientPort=2181 > > server.0=${hbase.master.hostname}:2888:3888 > >

Re: Error in .20-dev : NotAllMetaRegionsOnlineException

2009-04-30 Thread Nitay
Hi Bradford, What's your conf/zoo.cfg look like? Is your ZooKeeper up? Can you connect to it from the RegionServer machine? On Thu, Apr 30, 2009 at 11:33 AM, Bradford Stephens < bradfordsteph...@gmail.com> wrote: > Oh, I thnk I see the problem. My Regionserver logs contain: > > 2009-04-30 11:31:

Re: meetup in Jan 2009

2009-01-08 Thread Nitay
+1 for the 14th. On Mon, Jan 5, 2009 at 12:07 PM, Jonathan Gray wrote: > Following discussion on IRC... > > Wednesday, January 14th > HBase User Group > Powerset Offices > San Francisco, CA > > -and- > > Friday, January 30th / Saturday, January 31st > HBase Hackathon > Streamy Offices > Los Ange