Re: Poor HBase map-reduce scan performance

2013-05-24 Thread lars hofhansl
Sorry. Haven't gotten to this, yet. Scanning in HBase being about 3x slower than straight HDFS is in the right ballpark, though. It has to a bit more work. Generally, HBase is great at honing in to a subset (some 10-100m rows) of the data. Raw scan performance is not (yet) a strength of HBase.

Re: HBase is not running.

2013-05-24 Thread Jay Vyas
Yes that's a great post it helped me appreciate the complexity of the whole thing to. There's gotta be a JIRA in here somewhere :) Sent from my iPhone On May 24, 2013, at 7:08 PM, "Yves S. Garret" wrote: > I do want to know. Maybe that'll get my problem resolved. > > > On Fri, May 24, 2013

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
I do want to know. Maybe that'll get my problem resolved. On Fri, May 24, 2013 at 5:00 PM, Asaf Mesika wrote: > If you truly want to understand the weirdness behind what you witnessed, > then make a big cup of coffee, prepare a notebook with a pen and sit down > to read this: http://blog.devvi

Re: querying hbase

2013-05-24 Thread Andrew Purtell
On Thu, May 23, 2013 at 5:10 PM, James Taylor wrote: > Has there been any discussions on running the HBase server in an OSGi > container? I believe the only discussions have been on avoiding talk about coprocessor reloading, as it implies either a reimplementation of or taking on an OSGi runtime

Re: HBase is not running.

2013-05-24 Thread Asaf Mesika
If you truly want to understand the weirdness behind what you witnessed, then make a big cup of coffee, prepare a notebook with a pen and sit down to read this: http://blog.devving.com/why-does-hbase-care-about-etchosts/ My friend at devving.com had a fight like this with HBase pseudo mode, but dec

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
I can. I'll change /etc/sysconfig/network to localhost, for a hostname. In CentOS/Fedora/Red Hat, /etc/hostname does not exist and it's /etc/sysconfig/network :) . On Fri, May 24, 2013 at 4:25 PM, Jay Vyas wrote: > +1 for a VM on your own machine. That's how I do it because its easy to > con

Re: [announce] HappyBase 0.5, a developer-friendly Python library to interact with HBase

2013-05-24 Thread Stack
Good on you Wouter. HappyBase makes me... well... If you want to add happybase to http://wiki.apache.org/hadoop/SupportingProjects, make yourself an id on the hadoop/hbase wiki and send it to me offlist and I'll enable you as an editor. Thanks boss, St.Ack On Fri, May 24, 2013 at 1:50 PM, Wout

[announce] HappyBase 0.5, a developer-friendly Python library to interact with HBase

2013-05-24 Thread Wouter Bolsterlee
Hi all, I have just released HappyBase 0.5. This release adds support for a thread-safe connection pool, and some other minor fixes and enhancements. Release notes: http://happybase.readthedocs.org/en/latest/news.html Documentation: http://happybase.readthedocs.org/ Source code: https:

Re: HBase is not running.

2013-05-24 Thread Jay Vyas
+1 for a VM on your own machine. That's how I do it because its easy to control and muck with network settings . Cant you just Edit etc/hostname file ? On May 24, 2013, at 4:03 PM, Jean-Daniel Cryans wrote: > This is a machine identity problem. HBase simply uses the normal Java > APIs and as

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
Hostname is "ysg.connect". I'm ok with not using it in distributed mode, for now. This is my ifconfig info: $ ifconfig eth0 Link encap:Ethernet HWaddr 00:1A:92:46:8C:66 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0

Re: HBase is not running.

2013-05-24 Thread Jean-Daniel Cryans
This is a machine identity problem. HBase simply uses the normal Java APIs and asks "who am I?". The answer it gets is ip72-215-225-9.at.at.cox.net. Changing this should only be a matter of DNS configs, starting with /etc/hosts. What is your machine's hostname exactly (run "hostname")? When you pin

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
The thing that gets me, really gets me, is that the only thing inside of /etc/hosts is this: 127.0.0.1localhost Also, I did a search for host.name and could not find it in any html files (which I presume is the documentation). On Fri, May 24, 2013 at 12:41 PM, Jean-Daniel Cryans wrote: > Ah

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
That seems to be the case. The thing that I don't get is if I missed any "global" setting in order to make everything turn towards localhost. What am I missing? I'll scour the HBase docs again. On Fri, May 24, 2013 at 1:17 PM, Jay Vyas wrote: > Yes ... get hostname and /etc/hosts synced up p

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
Here is what I don't get. Why doesn't _everything_ go through localhost? Is there a way to force this? Would I need to hack up some HBase code in order to force this? On Fri, May 24, 2013 at 12:41 PM, Jean-Daniel Cryans wrote: > Ah yeah the master advertised itself as: > > Attempting connect

Re: HBase is not running.

2013-05-24 Thread Jay Vyas
Yes ... get hostname and /etc/hosts synced up properly and i bet that will fix it On Fri, May 24, 2013 at 12:41 PM, Jean-Daniel Cryans wrote: > Ah yeah the master advertised itself as: > > Attempting connect to Master server at > ip72-215-225-9.at.at.cox.net,46122,1369408257140 > > So the region

Re: Not able to connect to Hbase remotly

2013-05-24 Thread Jean-Daniel Cryans
It says your event_data table isn't assigned anywhere on the cluster. Was it disabled? J-D On Fri, May 24, 2013 at 6:06 AM, Vimal Jain wrote: > Hi Tariq/Jyothi, > Sorry to trouble you again. > I think this problem is solved but i am not able to figure out why in > client's /etc/hosts file , i ne

Re: HBase is not running.

2013-05-24 Thread Jean-Daniel Cryans
Ah yeah the master advertised itself as: Attempting connect to Master server at ip72-215-225-9.at.at.cox.net,46122,1369408257140 So the region server cannot find it since that's the public address and nothing's reachable through that. Now you really need to fix your networking :) J-D On Fri, Ma

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
Ok, weird, it still seems to be looking towards Cox. Here is my hbase-site.xml file: http://bin.cakephp.org/view/628322266 On Thu, May 23, 2013 at 7:35 PM, Jean-Daniel Cryans wrote: > No, I meant hbase.master.ipc.address and > hbase.regionserver.ipc.address. See > https://issues.apache.org/jira

Re: HBase is not running.

2013-05-24 Thread Yves S. Garret
Ok, that's done. Now, when I go to either 127.0.0.1:60010 I get that a connection was reset or do "list" in the shell, it all just hangs for a while and I don't see a response, until I get a very long Java exception. Here are the contents of the log: http://bin.cakephp.org/view/105173437 On Th

Re: Not able to connect to Hbase remotly

2013-05-24 Thread Vimal Jain
Hi Tariq/Jyothi, Sorry to trouble you again. I think this problem is solved but i am not able to figure out why in client's /etc/hosts file , i need to put an entry of zookeeper's location.I have configured everything as IP addresss in Hbase server so why this /etc/hosts comes in picture as i under

Re: Not able to connect to Hbase remotly

2013-05-24 Thread Vimal Jain
Can someone please help here ? On Wed, May 22, 2013 at 2:56 PM, Vimal Jain wrote: > Hi, > I have Hbase configured in pseudo distributed mode on Machine A. > I would like to connect to it through a Java program running on Machine B. > But i am unable to do so.What configurations are required in

Re: hbase-0.94.7 doesn't support HDFS QJM HA

2013-05-24 Thread Azuryy Yu
Thanks Damien. I add core-site.xml and hdfs-site.xml link under HBase conf dir, then everything works well. please ingore this thread. sorry. On Fri, May 24, 2013 at 6:31 PM, Damien Hardy wrote: > And about the visibility of HDFS conf in HBase classpath, so ? > (classpath should appear in sta

Re: hbase-0.94.7 doesn't support HDFS QJM HA

2013-05-24 Thread Damien Hardy
And about the visibility of HDFS conf in HBase classpath, so ? (classpath should appear in startup log of HBase processes) 2013/5/24 Azuryy Yu > they are all configured as you pointed. > > --Send from my Sony mobile. > On May 24, 2013 6:18 PM, "Damien Hardy" wrote: > > > Hello, > > > > Is hdfs

Re: hbase-0.94.7 doesn't support HDFS QJM HA

2013-05-24 Thread Azuryy Yu
they are all configured as you pointed. --Send from my Sony mobile. On May 24, 2013 6:18 PM, "Damien Hardy" wrote: > Hello, > > Is hdfs-site.xml and core-site.xml available in HBase java process > CLASSPATH ? > > Did you add > ``` > > dfs.client.failover.proxy.provider.test-cluster > > >

Re: hbase-0.94.7 doesn't support HDFS QJM HA

2013-05-24 Thread Azuryy Yu
hdfs was well configured, many tests have done. --Send from my Sony mobile. On May 24, 2013 6:18 PM, "Damien Hardy" wrote: > Hello, > > Is hdfs-site.xml and core-site.xml available in HBase java process > CLASSPATH ? > > Did you add > ``` > > dfs.client.failover.proxy.provider.test-cluste

Re: hbase-0.94.7 doesn't support HDFS QJM HA

2013-05-24 Thread Damien Hardy
Hello, Is hdfs-site.xml and core-site.xml available in HBase java process CLASSPATH ? Did you add ``` dfs.client.failover.proxy.provider.test-cluster org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider ``` In hdfs-site.xml ? Best regards, 2013/5/24 Azuryy Yu

hbase-0.94.7 doesn't support HDFS QJM HA

2013-05-24 Thread Azuryy Yu
Hi, I configured HDFS ha using QJM, so I configured hbase as following: hbase.rootdir hdfs://test-cluster test-cluster is my name sevice ID in my HDFS configuration, but HBase cannot start, Exception: java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path i

Re: Not able to connect to Hbase remotly

2013-05-24 Thread Vimal Jain
Hi, I am again facing this issue. This time around its on different machine where i am configuring hbase in pseudo distributed mode. Client ( Java program ) connects to zookeeper fine as seen in below zookeeper logs :- 2013-05-24 15:27:22,309 INFO org.apache.zookeeper.server.NIOServerCnxnFactory: