enchmarking with your usecase. You
> might
> > be able to get away with fewer servers, you need to test for that.
> >
> > -- Lars
> >
> >
> >
> >
> >
> > From: Ramu M S
> > To: user@hbase.apache.org
> > S
gt; be able to get away with fewer servers, you need to test for that.
>
> -- Lars
>
>
>
>
>
> From: Ramu M S
> To: user@hbase.apache.org
> Sent: Saturday, February 8, 2014 12:10 AM
> Subject: Re: Regarding Hardware configuration
rking with your usecase. You might be
able to get away with fewer servers, you need to test for that.
-- Lars
From: Ramu M S
To: user@hbase.apache.org
Sent: Saturday, February 8, 2014 12:10 AM
Subject: Re: Regarding Hardware configuration for HBase cluster
> it
> > works.
> >
> > Vladimir is right here, you probably want to seek professional help.
> >
> > -- Lars
> >
> >
> >
> >
> >
> > From: Vladimir Rodionov
> > To: "user@hbase.apa
Lars
>
>
>
>
> ____
> From: Vladimir Rodionov
> To: "user@hbase.apache.org"
> Sent: Friday, February 7, 2014 10:29 AM
> Subject: RE: Regarding Hardware configuration for HBase cluster
>
>
> This guy is building system of
dimir Rodionov
To: "user@hbase.apache.org"
Sent: Friday, February 7, 2014 10:29 AM
Subject: RE: Regarding Hardware configuration for HBase cluster
This guy is building system of a scale of Yahoo and asking user group how to
size the cluster.
Few people here can give him advice based on th
rieriq.com
From: Ted Yu [yuzhih...@gmail.com]
Sent: Friday, February 07, 2014 6:27 AM
To: user@hbase.apache.org
Cc: user@hbase.apache.org
Subject: Re: Regarding Hardware configuration for HBase cluster
Have you read http://www.slideshare.net/larsgeorge/hbase-sizing-notes ?
Cheers
On Feb 6
Have you read http://www.slideshare.net/larsgeorge/hbase-sizing-notes ?
Cheers
On Feb 6, 2014, at 8:47 PM, suresh babu wrote:
> Hi Stana,
>
> We are trying to find out how many data nodes (including hardware
> configuration detail)should be configured or setup for this
Hi Stana,
We are trying to find out how many data nodes (including hardware
configuration detail)should be configured or setup for this requirement
-suresh
On Friday, February 7, 2014, stana wrote:
> HI suresh babu :
>
> how many data nodes do you have?
>
>
> 2014
HI suresh babu :
how many data nodes do you have?
2014-02-07 suresh babu :
> refreshing the thread,
>
> Can you please suggest any inputs for the hardware configuration(for the
> below mentioned use case).
>
>
>
>
> On Wed, Feb 5, 2014 at 10:31 AM, suresh babu
>
refreshing the thread,
Can you please suggest any inputs for the hardware configuration(for the
below mentioned use case).
On Wed, Feb 5, 2014 at 10:31 AM, suresh babu wrote:
> Please find the data requirements for our use case below :
>
> Raw data p
arrieriq.com
> e-mail: vrodio...@carrieriq.com
>
>
> From: Nick Xie [nick.xie.had...@gmail.com]
> Sent: Tuesday, February 04, 2014 10:02 AM
> To: user@hbase.apache.org
> Subject: Re: Regarding Hardware configuration for HBase cluster
>
> I guess yo
: vrodio...@carrieriq.com
From: Nick Xie [nick.xie.had...@gmail.com]
Sent: Tuesday, February 04, 2014 10:02 AM
To: user@hbase.apache.org
Subject: Re: Regarding Hardware configuration for HBase cluster
I guess you'd better describe a little bit more about
to maintain data of size around 800TB,
>
> For the above requirement,please suggest me the best hardware configuration
> details like
>
> 1)how many disks to consider for machine and the capacity of disks ,for
> example, 16/24 disks per node with 1/2TB capacity per each disk
>
&g
Hi folks,
We are trying to setup HBase cluster for the following requirement:
We have to maintain data of size around 800TB,
For the above requirement,please suggest me the best hardware configuration
details like
1)how many disks to consider for machine and the capacity of disks ,for
example
Hi Stuti,
There is a pretty good, though somewhat dated, post about picking
hardware on the Cloudera blog:
http://www.cloudera.com/blog/2010/03/clouderas-support-team-shares-some-basic-hardware-recommendations/
Things I would add to bring it more up to date:
1) More hard drives, a lot of organi
Hi,
I am setting up Hadoop and Hbase clusters for some applications. Data can range
from TBs to PBs in production. I want to know what all hardware requirements I
should look before finalizing machines.
Foe eg : Number of nodes, RAM, HDD, cache etc.
Are there any guidelines for huge cluster mana
Inline.
J-D
On Wed, May 11, 2011 at 4:22 PM, Miles Spielberg wrote:
> We're planning out our first Hbase cluster, and we'd like to get some
> feedback on our proposed hardware configuration. We're intending to use this
> cluster purely for Hbase; it will not genera
We're planning out our first Hbase cluster, and we'd like to get some
feedback on our proposed hardware configuration. We're intending to use this
cluster purely for Hbase; it will not generally be running MapReduce jobs,
nor will we be using HDFS for other storage tasks. I
We're planning out our first Hbase cluster, and we'd like to get some feedback
on our proposed hardware configuration. We're intending to use this cluster
purely for Hbase; it will not generally be running MapReduce jobs, nor will we
be using HDFS for other storage tasks. I
w this doesn't mean that I'll need to buy all of the machines today
and build out the cluster.
It means that I will need to figure out my machine room, (rack space,
power, etc...) and also hardware configuration.
You'll also need to plan out your hardware choices too. An example.
tency
>>> of hardware becomes less important.
>>>
>>> With respect to HBase, I suspect there to be a parallel evolution.
>>>
>>> As to building out and replacing your cluster... if this is a production
>>> environment, you'll have to think
etain
>> is going to be 1PB, with a 3x replication factor, I'll need at least 3PB of
>> disk. Assuming that I can fit 12x2TB drives in a node, I'll need 125-150
>> machines. (There's some overhead for logging and OS)
>>
>> Now this doesn't mean that I&#x
B of disk. Assuming that I can fit 12x2TB drives in a node, I'll need
> 125-150 machines. (There's some overhead for logging and OS)
> >>
> >> Now this doesn't mean that I'll need to buy all of the machines today
> and build out the cluster.
> >> It
can fit 12x2TB drives in a node, I'll need 125-150
>> machines. (There's some overhead for logging and OS)
>>
>> Now this doesn't mean that I'll need to buy all of the machines today and
>> build out the cluster.
>> It means that I will need to fig
a node, I'll need 125-150
> machines. (There's some overhead for logging and OS)
>
> Now this doesn't mean that I'll need to buy all of the machines today and
> build out the cluster.
> It means that I will need to figure out my machine room, (rack space, power,
&
ately.
It goes back to the OP's initial question about starting with a heterogeneous
cluster where the nodes aren't roughly the same size and configuration.
HTH
-Mike
> Date: Mon, 2 May 2011 10:30:21 -0400
> From: rough...@gmail.
the cluster.
It means that I will need to figure out my machine room, (rack space, power,
etc...) and also hardware configuration.
You'll also need to plan out your hardware choices too. An example.. you may
want 10GBe on the switch but not at the data node. However you're going to
e overhead for logging and OS)
Now this doesn't mean that I'll need to buy all of the machines today and build
out the cluster.
It means that I will need to figure out my machine room, (rack space, power,
etc...) and also hardware configuration.
You'll also need to plan out you
PB of
> disk. Assuming that I can fit 12x2TB drives in a node, I'll need 125-150
> machines. (There's some overhead for logging and OS)
>
> Now this doesn't mean that I'll need to buy all of the machines today and
> build out the cluster.
> It means that I wi
y and build
out the cluster.
It means that I will need to figure out my machine room, (rack space, power,
etc...) and also hardware configuration.
You'll also need to plan out your hardware choices too. An example.. you may
want 10GBe on the switch but not at the data node. However you're
Thank you both. How would you estimate really big clusters, with
hundreds of nodes? Requirements might change in time and replacing an
entire cluster seems not the best solution...
On 04/29/2011 07:08 PM, Stack wrote:
I agree with Michel Segel. Distributed computing is hard enough.
There i
I agree with Michel Segel. Distributed computing is hard enough.
There is no need to add extra complexity.
St.Ack
On Fri, Apr 29, 2011 at 4:05 AM, Iulia Zidaru wrote:
> Hi,
> I'm wondering if having a cluster with different machines in terms of CPU,
> RAM and disk space would be a big issue fo
Heterogeneous clusters aren't really a good idea. I wouldn't recommend it.
Sent from a remote device. Please excuse any typos...
Mike Segel
On Apr 29, 2011, at 6:05 AM, Iulia Zidaru wrote:
> Hi,
> I'm wondering if having a cluster with different machines in terms of CPU,
> RAM and disk space
Hi,
I'm wondering if having a cluster with different machines in terms of
CPU, RAM and disk space would be a big issue for HBase. For example,
machines with 12GBs RAM and machines with 48GBs. We suppose that we use
them at full capacity. What problems we might encounter if having this
kind of
35 matches
Mail list logo
