something I have said above flags some alarm bells and help
figure out the problem.
Regards,
Seraph
> From: Jean-Daniel Cryans
> Reply-To:
> Date: Tue, 9 Feb 2010 09:45:42 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> You want namenode+jobtracker+hbase-master o
Original Message
> From: Seraph Imalia
> To: hbase-user@hadoop.apache.org
> Sent: Tue, February 9, 2010 7:30:42 AM
> Subject: Re: Hbase pausing problems
>
> Hi Jean-Daniel,
>
> Thank you for your input - I'll make these changes and try it tonight. I
> think
> I
> read somewhere that it is wise to place a datanode and regionserver
> together
> per server. Is this wise? Or is there a better way to configure this?
>
> Regards,
> Seraph
>
>
> > From: Jean-Daniel Cryans
> > Reply-To:
> > Date: Mon, 8 Feb
eraph
> From: Jean-Daniel Cryans
> Reply-To:
> Date: Mon, 8 Feb 2010 10:11:36 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> The "too many store files" is due to this
>
>
> hbase.hstore.blockingStoreFiles
> 7
>
> I
, so I wrote some quick coldfusion and java code to get the
> data inserted into local mysql servers so that hBase could have time to do
> whatever it was doing.
>
> It is still compacting and it is now 9 hours after the last restart. With 0
> load from client apps.
>
&
actually happening? -
Is my thinking correct? - Is it related to the "hBase pausing problems" we are
still having? - What do I do to fix it or make it hurry up?
Regards,
Seraph
> From: stack
> Reply-To:
> Date: Wed, 20 Jan 2010 12:03:01 -0800
> To:
> Subject: Re: Hbase
On Wed, Jan 20, 2010 at 11:46 AM, Seraph Imalia wrote:
>
> > From: stack
> > Reply-To:
> > Date: Wed, 20 Jan 2010 11:26:00 -0800
> > To:
> > Subject: Re: Hbase pausing problems
> >
> > Looking at logs, what J-D says regards the number of regions y
> From: stack
> Reply-To:
> Date: Wed, 20 Jan 2010 11:26:00 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> Looking at logs, what J-D says regards the number of regions you are
> carrying per server (800). Enable compression and that'll shrink the
;> From: stack
>> Reply-To:
>> Date: Wed, 20 Jan 2010 10:55:52 -0800
>> To:
>> Subject: Re: Hbase pausing problems
>>
>> On Wed, Jan 20, 2010 at 9:37 AM, Seraph Imalia wrote:
>>
>>>
>>> Does this mean that when 1 regionserver does a me
> From: stack
> Reply-To:
> Date: Wed, 20 Jan 2010 10:55:52 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> On Wed, Jan 20, 2010 at 9:37 AM, Seraph Imalia wrote:
>
>>
>> Does this mean that when 1 regionserver does a memstore flush, the ot
> >
> >
> >> From: stack
> >> Reply-To:
> >> Date: Wed, 20 Jan 2010 07:26:58 -0800
> >> To:
> >> Subject: Re: Hbase pausing problems
> >>
> >> On Wed, Jan 20, 2010 at 1:06 AM, S
> From: Jean-Daniel Cryans
> Reply-To:
> Date: Wed, 20 Jan 2010 10:55:26 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> A table is sorted by row key and all the regions are sequentially
> split so that a row will always go to a single region and if that
>
t your schema -- though,
nevermind, i can find it in your master log.
St.Ack
> > St.Ack
> >
> >
> >
> >> Thank you for your assistance thus far; please let me know if you need
> or
> >> discover anything else?
> >>
> >> Regards,
>
h Imalia wrote:
>
>
>
>> From: stack
>> Reply-To:
>> Date: Wed, 20 Jan 2010 07:26:58 -0800
>> To:
>> Subject: Re: Hbase pausing problems
>>
>> On Wed, Jan 20, 2010 at 1:06 AM, Seraph Imalia wrote:
>>
>>>
>>> The client
> From: stack
> Reply-To:
> Date: Wed, 20 Jan 2010 07:26:58 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> On Wed, Jan 20, 2010 at 1:06 AM, Seraph Imalia wrote:
>
>>
>> The client stops being able to write to hBase as soon as 1 of th
as currently setup. You might
also consider adding more machines to your cluster.
St.Ack
> Thank you for your assistance thus far; please let me know if you need or
> discover anything else?
>
> Regards,
> Seraph
>
>
>
> > From: Jean-Daniel Cryans
> > Reply
your assistance thus far; please let me know if you need or
discover anything else?
Regards,
Seraph
> From: Jean-Daniel Cryans
> Reply-To:
> Date: Mon, 18 Jan 2010 09:49:16 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> The next step would be to take a look a
AM, Seraph Imalia wrote:
> Answers below...
>
> Regards,
> Seraph
>
>> From: stack
>> Reply-To:
>> Date: Fri, 15 Jan 2010 10:10:39 -0800
>> To:
>> Subject: Re: Hbase pausing problems
>>
>> How many CPUs?
>
> 1x Quad Xeon in each server
&
Answers below...
Regards,
Seraph
> From: stack
> Reply-To:
> Date: Fri, 15 Jan 2010 10:10:39 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> How many CPUs?
1x Quad Xeon in each server
>
> You are using default JVM settings (see HBASE_OPTS in hbase-en
Hi Jean-Daniel,
Thank you for your comprehensive response. Answers below...
> From: Jean-Daniel Cryans
> Reply-To:
> Date: Fri, 15 Jan 2010 09:45:12 -0800
> To:
> Subject: Re: Hbase pausing problems
>
> General comments:
>
> - Having less than 5-6 nodes is usu
How many CPUs?
You are using default JVM settings (see HBASE_OPTS in hbase-env.sh). You
might want to enable GC logging. See the line after hbase-env.sh. Enable
it. GC logging might tell you about the pauses you are seeing.
Can you get a fourth server for your cluster and run the master, zk,
General comments:
- Having less than 5-6 nodes is usually very problematic since HDFS
isn't optimized at all for that number. At the very least you could
set replication to 2 so that each write only hit 2/3 of the cluster
instead of all of them.
- Giving the all the RAM you can to the region serv
Hi,
We are using coldfusion as our server-side coding language which is built on
java. We have written a java class to simplify the coldfusion coding by
providing simple classes to insert data into hBase.
Our hBase cluster is 3 servers...
1. each server has a hadoop datanode.
2. each server ha
23 matches
Mail list logo
