There is no exception or warnings in the log and the console prints the
following
12/11/27 11:03:42 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
12/11/27 11:03:42 INFO zookeeper.ZooKeeper: Client
environment:host.name=localhost
12/11/
thanks a lot Mahammad for this very complete and so mature reply :)
I am very new and just started playing with HBase for my college project
work. I will try to play with API's
thanks :)
On Tue, Nov 27, 2012 at 2:31 AM, Mohammad Tariq wrote:
> Hello Alok,
>
> I have seen this project. Good w
Thanks! This is the client code I was referring to. The below code doesn't
seem to work. Also I tried HBaseConfiguration.addHBaseResrouce and that
didn't work either. Is there any other way to make it configurable outside
the resource?
On Mon, Nov 26, 2012 at 2:39 PM, Stack wrote:
> On Mon, Nov
The difference is your classpath.
So -for problem 1, you need to specify jars under /hbase-0.94.2/lib to
your classpath. You only need a subset ... but first to get over the
problem set your classpath with all these jars. I don't think
specifying a wildcard "*" works ... like below
ngc@hadoop1:~/h
On Mon, Nov 26, 2012 at 2:16 PM, Mohit Anchlia wrote:
> I have a need to move hbas-site.xml to an external location. So in order to
> do that I changed my configuration as shown below. But this doesn't seem to
> be working. It picks up the file but I get error, seems like it's going to
> the local
I am running HBase 0.94.2 running on 6 servers with Zookeeper 3.4.5 running on
3. HBase works from its shell and from within Eclipse but not as a jar file.
When I run within Eclipse I can see it worked properly by using the HBase shell
commands (such as scan).
I seem to have 2 separate prob
Hello Alok,
I have seen this project. Good work. But let me tell you one thing, the
way Hbase is used is slightly different from the way you use traditional
relational databases. Rarely people, who are working on real clusters, face
a situation wherein they need to query Hbase directly. Though
Hello Nicolas,
You are right. It has been deprecated. Thank you for updating my
knowledge base..:)
Regards,
Mohammad Tariq
On Tue, Nov 27, 2012 at 12:17 AM, Nicolas Liochon wrote:
> Hi Mohammad,
>
> Your answer was right, just that specifying the master address is not
> necessary (
I am running HBase 0.94.2 running on 6 servers with Zookeeper 3.4.5 running on
3. HBase works from its shell and from within Eclipse but not as a jar file.
When I run within Eclipse I can see it worked properly by using the HBase shell
commands (such as scan).
I seem to have 2 separate proble
I am running HBase 0.94.2 running on 6 servers with Zookeeper 3.4.5 running on
3. HBase works from its shell and from within Eclipse but not as a jar file.
When I run within Eclipse I can see it worked properly by using the HBase shell
commands (such as scan).
I seem to have 2 separate proble
I need frontend for HBase shell like we have phpmyadmin for MySql.
I tried 127.0.0.1:600010 and 127.0.0.1:60030 these are just giving
information about master mode and regional server respectively. so I tried
to use hbasemanagergui but i am unable to connect it
does HBase web UI have feature of u
Hi Mohammad,
Your answer was right, just that specifying the master address is not
necessary (anymore I think). But it does no harm.
Changing the /etc/hosts (as you did) is right too.
Lastly, if the cluster is standalone and accessed locally, having localhost
in ZK will not be an issue. However, i
What are your exact 'manager GUI' needs though? I mean, what are you
envisioning it will help you perform (over the functionality already
offered by the HBase Web UI)?
On Mon, Nov 26, 2012 at 9:59 PM, Alok Singh Mahor wrote:
> Hi all,
> I have set up standalone Hbase on my laptop. HBase shell is
I was facing the same issue few months ago, but adding the above
specified three properties in my client and IP+Hostname of the machines in
my /etc/hosts worked for me. Is is OK? Another question, if HBase is
running in pseudo mode, then what's the harm in using localhost in
/conf/regionserver
On Mon, Nov 26, 2012 at 9:42 AM, Nicolas Liochon wrote:
> We would detect it and stop properly. It's true even in standalone mode:
> one may want to launch a standalone cluster and connects remotely to it.
>
I made https://issues.apache.org/jira/browse/HBASE-7219 for now.
St.Ack
On Sun, Nov 25, 2012 at 8:28 AM, matan wrote:
> Nothing. Maybe just link to it from
> http://hbase.apache.org/book/quickstart.html such that people for whom the
> quick start doesn't work, will have a direct route to this and other
> prerequisites.
>
I just added note on loopback to the getting s
We would detect it and stop properly. It's true even in standalone mode:
one may want to launch a standalone cluster and connects remotely to it.
On Mon, Nov 26, 2012 at 6:38 PM, Stack wrote:
> distributed, write other than localhost to zk?
> St.Ack
>
Hello Matan,
Did it work?If not, add these properties in your hbase-site.xml file
and see if it works for you.
hbase.zookeeper.quorum
ZH-HOST_MACHINE
hbase.zookeeper.property.clientPort
2181
hbase.zookee
On Mon, Nov 26, 2012 at 7:28 AM, Nicolas Liochon wrote:
> Yes, it's not useful to set the master address in the client. I suppose it
> was different a long time ago, hence there are some traces on different
> documentation.
> The master references itself in ZooKeeper. So if the master finds itself
What happens if you put up a shell on your hbase instance and do the
same thing? Does it succeed?
St.Ack
On Sun, Nov 25, 2012 at 11:45 PM, shyam kumar wrote:
> HI
>
> I am unable to create a Table in hbase dynamically
> am using the following code
>
> if (!TABLE_EXISTS) {
>
HI
I am unable to create a Table in hbase dynamically
am using the following code
if (!TABLE_EXISTS) {
try{
*admin.createTable(htable);*
}catch(Exception e){
e.printStackTrace(
I wouldn't do that unless you're running in a VM. Also don't lose the local
host reference. That's the important one.
On Nov 26, 2012, at 4:46 AM, Mohammad Tariq wrote:
> Change 127.0.1.1 alok to 127.0.0.1 alok.
>
> No, Hadoop and ZK are not required for local Hbase setup. But, I
Setting up a local system HBase is frequently asked in the mailing list :).
Regards
Ram
On Mon, Nov 26, 2012 at 10:01 PM, Alok Singh Mahor wrote:
> thank you :)
>
> On Mon, Nov 26, 2012 at 4:28 PM, Mohammad Tariq
> wrote:
>
> > You are welcome Alok :)
> >
> > Yes, you can set that value throug
thank you :)
On Mon, Nov 26, 2012 at 4:28 PM, Mohammad Tariq wrote:
> You are welcome Alok :)
>
> Yes, you can set that value through hbase-site.xml file.
>
> You can visit this link, if you need any help :
> http://cloudfront.blogspot.in/2012/06/how-to-configure-habse-in-pseudo.html
>
> I have
Yes, it's not useful to set the master address in the client. I suppose it
was different a long time ago, hence there are some traces on different
documentation.
The master references itself in ZooKeeper. So if the master finds itself to
be "locahost", ZooKeeper will contain "locahost", and the cli
Thanks, but hard-coding the master's IP in my client code doesn't work - I
also don't really understand why it has to be set in the client, as
according to the flow you describe, the client is getting all it needs to
know from zookeeper (?).
Doing some digging on the HBase server side, I found tha
Uhm, those specs are actually now out of date.
If you're running HBase, or want to also run R on top of Hadoop, you will need
to add more memory.
Also forget 1GBe got 10GBe, and w 2 SATA drives, you will be disk i/o bound
way too quickly.
On Nov 26, 2012, at 8:05 AM, Marcos Ortiz wrote:
Are you asking about hardware recommendations?
Eric Sammer on his "Hadoop Operations" book, did a great job about this:
For middle size clusters (until 300 nodes):
Processor: A dual quad-core 2.6 Ghz
RAM: 24 GB DDR3
Dual 1 Gb Ethernet NICs
a SAS drive controller
at least two SATA II drives in a JB
Hello David,
Do you mean the recommended specs?IMHO, it depends more on the data
and the kind of processing you are going to perform, rather than the size
of your cluster.
Regards,
Mohammad Tariq
On Mon, Nov 26, 2012 at 7:23 PM, David Charle wrote:
> hi
>
> what's the recommended no
hi
what's the recommended nodes for NN, hmaster and zk nodes for a larger cluster,
lets say 50-100+
also, what would be the ideal replication factor for larger clusters when u
have 3-4 racks ?
--
David
Hi there, somebody already wisely mentioned the link to the # of CF's
entry, but here are a few other entries that can save you some heartburn
if you read them ahead of time.
http://hbase.apache.org/book.html#datamodel
http://hbase.apache.org/book.html#schema
http://hbase.apache.org/book.html#a
If the row Key is just the customer ID, then a simple MD5 hash or SHA-1 hash
would suffice.
That would clear up any risk of hot spotting, once you do your initial load of
data.
And that's probably a key point... hot spotting when you're first loading a
very large table is really a moot point.
Rams,
I think you need to go back and think about why you want to use Hadoop and
HBase in the first place.
Second, you need to think about your data and how you are planning to use it.
Beyond that, we can only give you a bit of generic answers
1) You can create a table with 600 columns,
Hello Sir ,
For solving RS hotspotting you can also try this below
http://blog.sematext.com/2012/04/09/hbasewd-avoid-regionserver-hotspotting-despite-writing-records-with-sequential-keys/
It works fine ..
Regrading the Columns Family you can also try to group similar columns
towards one family,
You are welcome Alok :)
Yes, you can set that value through hbase-site.xml file.
You can visit this link, if you need any help :
http://cloudfront.blogspot.in/2012/06/how-to-configure-habse-in-pseudo.html
I have outlined the whole process there.
HTH
Regards,
Mohammad Tariq
On Mon, Nov 2
wow :)
thanks a lot , my hbase shell commands are working now :)
I will try to setup pseudo-distributed mode
please tell me one more thing ..can I set any directory for hbase.rootdir
in conf/hbase-site.xml
currently I have not set anything
thanks
On Mon, Nov 26, 2012 at 4:16 PM, Mohammad Tariq w
Change 127.0.1.1 alok to 127.0.0.1 alok.
No, Hadoop and ZK are not required for local Hbase setup. But, I would
recommend at least a pseudo-distributed setup in order to get yourself
familiar with Habse properly.
HTH
Regards,
Mohammad Tariq
On Mon, Nov 26, 2012 at 4:12 PM, Alok
content of my /etc/hosts is
127.0.0.1 localhost
127.0.1.1 alok
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
do i need to change anything in this?
Have you changed the line "127.0.1.1" in your "/etc/hosts" file to
"127.0.0.1"??
Regards,
Mohammad Tariq
On Mon, Nov 26, 2012 at 3:57 PM, Alok Singh Mahor wrote:
> Hi all,
> I want to setup HBase in standalone mode on local filesystem.
> I want to use local file system so I guess no need t
Just out of curiosity, why would you want to do that? What would you do if
you want to do a quick fetch, say I want the 'username' from a table called
'users'?Moreover, we do not use the shell for any real world use-case and
the API doesn't holds any Put.add() that can be used without the key i.e
q
Hi Rams,
yes. You can. See follows:
hbase(main):001:0> create 'test1','course'
0 row(s) in 1.6760 seconds
hbase(main):002:0> put 'test1','tom','course',90
0 row(s) in 0.1040 seconds
hbase(main):003:0> scan 'test1'
ROW COLUMN+CELL
tom column=course:, timestamp
Hello sir,
You might become a victim of RS hotspotting, since the cutomerIDs will
be sequential(I assume). To keep things simple Hbase puts all the rows with
similar keys to the same RS. But, it becomes a bottleneck in the long run
as all the data keeps on going to the same region.
HTH
Regar
Hi,
Thanks! Can we have the customer number as the RowKey for the customer
(client) master table? Please help in educating me on the advantage and
disadvantage of having customer number as the Row key...
Also SCD2 we may need to implement in that table.. will it work if I have
like that?
Or
SCD2
43 matches
Mail list logo
