;>>>> For middle size clusters (until 300 nodes):
> >>>>> Processor: A dual quad-core 2.6 Ghz
> >>>>> RAM: 24 GB DDR3
> >>>>> Dual 1 Gb Ethernet NICs
> >>>>> a SAS drive controller
> >>>>> at least two
The-Definitive-Guide-book-tp4034563.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
in
> > assignment strategy as in the case that a hbase cluster is restarting? Is
> > there any reason that we cannot use the previous region assignments in
> META
> > table?
> >
>
> Not that I know of.
> St.Ack
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
r latency critical application. More processes with smaller heaps
> > > would help in mitigating this issue.
> > >
> > > Any experience or thoughts on this would help.
> > > Thanks!
> > >
> > > --
> > > *Ishan Chhabra *| Rocket Scientist | Rocketfuel Inc. | *m *650 556
> 6803
> > >
> >
> >
> >
> > --
> >
> > Robert Dyer
> > rd...@iastate.edu
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
27;test_table'
>
> ERROR: Table test_table is enabled. Disable it first.'
>
> Here is some help for this command:
> Drop the named table. Table must first be disabled. If table has
> more than one region, run a major compaction on .META.:
>
> hbase> major_compact ".META."
>
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
gt; > > jean-m...@spaggiari.org>
> > > > > >> wrote:
> > > > > >>
> > > > > >>> Hi Mike,
> > > > > >>>
> > > > > >>> Why not using LVM with MapR? Since LVM is reading from 2 dr
gt;>>>> that
> >>>>>> the option you were thinking of? Or am I missing something?
> >>>>>>
> >>>>>> Thanks.
> >>>>>>
> >>>>>> --Brennon
> >>>>>>
> >>>>>>
> >>>>>> On 12/21/12 4:19 PM, Ted Yu wrote:
> >>>>>>
> >>>>>> Currently there is no such capability - you may need to customize
> load
> >>>>>>> balancer.
> >>>>>>>
> >>>>>>> What version of HBase are you using ?
> >>>>>>>
> >>>>>>> Cheers
> >>>>>>>
> >>>>>>> On Fri, Dec 21, 2012 at 3:54 PM, Brennon Church <
> bren...@getjar.com>
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>> I'm curious, is there any concept of hosting regions from a given
> >>>>>>> table
> >>>>>>>
> >>>>>>>> only on a single host or subset of hosts in a cluster? In our
> case we
> >>>>>>>> have
> >>>>>>>> a heavily-used table that can cause problems for the older
> systems in
> >>>>>>>> our
> >>>>>>>> cluster. Newer systems would have less trouble, so I'd like to
> >>>>>>>> restrict
> >>>>>>>> regions for that one table only to those more powerful servers.
> >>>>>>>>
> >>>>>>>> Thanks.
> >>>>>>>>
> >>>>>>>> --Brennon
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>
> >
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
safer.
> But when a region server dies, its regions are reallocated, whatever the
> balancer settings.
>
> On Thu, Dec 27, 2012 at 4:09 PM, Adrien Mogenet >wrote:
>
> > Are you sure ? So why is the balancer disabled before rolling restart ?
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
; value is string[512].
> > >>
> > >> It's splitted over 16 regions located on 7 regionservers.
> > >>
> > >> So it's not a big table, and there is a lot of horsepower behind it.
> > >>
> > >> I asked a major_compaction few hours ago. Let's say, about 5 hours
> > >> ago. and it's still compacting! But all servers activities seems to be
> > >> null. CPU usage is almost 0.
> > >>
> > >> There is nothing on the master logs.
> > >>
> > >> How can I see what's going on? Is there a way to see the compaction
> > >> queue?
> > >>
> > >> JM
> > >
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
ry.get(get_entry_exist);
> >>
> >> But should this be faster?
> >> Get get_entry_exist = new Get(key);
> >> Result entry_exist = table_entry.get(get_entry_exist);
> >>
> >> There is only one CF and one C on my table.
> >>
> >> Or is there an even faster way?
> >>
> >> Also, is there a way to make that even faster? I think BloomFilters
> >> can help, right?
> >>
> >> Thanks,
> >>
> >> JM
> >>
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
> > btw, quick question- in your presentation, the scale there is seconds
> or
> > > mill-seconds:)
> > >
> > > - Shengjie
> > >
> > >
> > > On 27 December 2012 15:54, Anoop John wrote:
> > >
> > > > >how the massive number of get() is going to
> > > > perform againt the main table
> > > >
> > > > Didnt follow u completely here. There wont be any get() happening..
> As
> > > the
> > > > exact rowkey in a region we get from the index table, we can seek to
> > the
> > > > exact position and return that row.
> > > >
> > > > -Anoop-
> > > >
> > > > On Thu, Dec 27, 2012 at 6:37 PM, Shengjie Min
> > > > wrote:
> > > >
> > > > > how the massive number of get() is going to
> > > > > perform againt the main table
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > All the best,
> > > Shengjie Min
> > >
> >
>
>
>
> --
> All the best,
> Shengjie Min
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
>
> On Sun, Jan 6, 2013 at 12:30 PM, Adrien Mogenet >wrote:
>
> > Nice topic, perhaps one of the most important for 2013 :-)
> > I still don't get how you're ensuring consistency between index table and
> > main table, without an external component (such as boo
e it
> > operates
> > >> in region on data for the region. Think of them as loadable kernel
> > modules.
> > >> They are not a general purpose server side platform for programming as
> > if
> > >> you are building a HBase client (with HTable, etc.
egionInfo and I want to know if this region is
> >> opened, closed, opening, in transit, etc. How can I retreive this
> >> information?
> >>
> >> From the table I can get a fresh region info, but I'm not able to find
> >> the status into it. I just have "isOffline()".
> >>
> >> Thanks,
> >>
> >> JM
> >>
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
r.call(WritableRpcEngine.java:364)
> >> > at
> >> >
> >>
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1345)
> >> > below is the excerpts from webui:
> >> > Regions in
> >> >
> >>
> TransitionRegionStatebd8d2bf3ef04d0f8d3dac5ca2f612f42T21_0513_201301_bigtable,2710075,1358994123350.bd8d2bf3ef04d0f8d3dac5ca2f612f42.
> >> > state=PENDING_OPEN, ts=Thu Jan 24 16:58:34 CST 2013 (699s ago),
> >> > server=hadoop1,60020,1358993820407
> >> >
> >>
> >>
> >>
> >> --
> >> *
> >> *
> >> *
> >>
> >> Thanx and Regards*
> >> * Vikas Jadhav*
> >>
> >
> >
> >
> > --
> > Kevin O'Dell
> > Customer Operations Engineer, Cloudera
> >
>
>
>
> --
> Kevin O'Dell
> Customer Operations Engineer, Cloudera
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
t;
> > >
> > > Because of this, if I scan the entries of the table using Hive it is
> > taking
> > > ages.
> > > Basically it is taking around 24 hours to scan the table. Any idea, of
> > how
> > > to debug.
> > >
> > >
> > > -Vibhav
> > >
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
Could HCatalog be an option ?
Le 26 janv. 2013 21:56, "Jack Levin" a écrit :
>
> AFAIK, namenode would not like tracking 20 billion small files :)
>
> -jack
>
> On Sat, Jan 26, 2013 at 6:00 PM, S Ahmed wrote:
> > That's pretty amazing.
> >
> > What I am confused is, why did you go with hbase and
8658733
> *Mobile:* +972 (54) 634 7879
> Akamai Technologies
> Inter Gama Building, Grand Neter
> Kfar Neter, ISRAEL 4059300
>
>
>
>
>
>
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
; > > core
> > > > >> > > > that contain 12 nodes(6 nodes on each server). Each node has
> > 8Gb
> > > > RAM
> > > > >> &
> > > > >> > 2
> > > > >> > > > VCPU.
> > > > >> > > > I've set some parameter that get better result like set
> > WAL=off
> > > on
> > > > >> > > put,but
> > > > >> > > > some parameters like Heap-size,Deferred log flush don't help
> > me.
> > > > >> > > > Beside that I have another question,why each time I've run
> > > > >> > mapreduce,I've
> > > > >> > > > got different result time while all the config & hardware
> are
> > > > same &
> > > > >> > not
> > > > >> > > > change ?
> > > > >> > > >
> > > > >> > > > Tnx you guys
> > > > >> > > >
> > > > >> > > > On Tue, Jan 8, 2013 at 8:42 AM, Ted Yu > > > >> > >
> > > > >> > > wrote:
> > > > >> > > >
> > > > >> > > > > Have you read through
> > > > >> http://hbase.apache.org/book.html#performance?
> > > > >> > > > >
> > > > >> > > > > What version of HBase are you using ?
> > > > >> > > > >
> > > > >> > > > > Cheers
> > > > >> > > > >
> > > > >> > > > > On Mon, Jan 7, 2013 at 9:05 PM, Farrokh Shahriari <
> > > > >> > > > > mohandes.zebeleh...@gmail.com > wrote:
> > > > >> > > > >
> > > > >> > > > > > Hi there
> > > > >> > > > > > I have a cluster with 12 nodes that each of them has 2
> > core
> > > of
> > > > >> CPU.
> > > > >> > > > Now,I
> > > > >> > > > > > want insert large data about 2Gb in 80 sec ( or 6Gb in
> > > 240sec
> > > > ).
> > > > >> > I've
> > > > >> > > > > used
> > > > >> > > > > > Map-Reduce over hbase,but I can't achieve proper result
> .
> > > > >> > > > > > I'd be glad if you tell me what I can do to get better
> > > result
> > > > or
> > > > >> > > which
> > > > >> > > > > > parameters should I config or tune to improve
> > > Map-Reduce/Hbase
> > > > >> > > > > performance
> > > > >> > > > > > ?
> > > > >> > > > > >
> > > > >> > > > > > Tnx
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
>
>
>
> --
> Bing Jiang
> Tel：(86)134-2619-1361
> weibo: http://weibo.com/jiangbinglover
> BLOG: http://blog.sina.com.cn/jiangbinglover
> National Research Center for Intelligent Computing Systems
> Institute of Computing technology
> Graduate University of Chinese Academy of Science
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
_RANK_TIMING_SCALE_COLUMN,
> > >> > Bytes.toBytes(timingScale));
> > >> > puts.add(timingScalePut);
> > >> >
> > >> > nodeKeyPut = new Put(domainNodeRankRowKey);
> > >> > nodeKeyPut.add(RankStructure.DOMAIN_NODE_RANK_FAMILY,
> > >> > RankStructure.DOMAIN_NODE_RANK_NODE_KEY_COLUMN,
> > >> > Bytes.toBytes(nodeRankEntry.getKey()));
> > >> > puts.add(nodeKeyPut);
> > >> >
> > >> > rankPut = new Put(domainNodeRankRowKey);
> > >> > rankPut.add(RankStructure.DOMAIN_NODE_RANK_FAMILY,
> > >> > RankStructure.DOMAIN_NODE_RANK_RANKS_COLUMN,
> > >> > Bytes.toBytes(nodeRankEntry.getValue()));
> > >> > puts.add(rankPut);
> > >> > }
> > >> >
> > >> > try
> > >> > {
> > >> > this.rankTable.put(puts);
> > >> > }
> > >> > catch (IOException e)
> > >> > {
> > >> > e.printStackTrace();
> > >> > }
> > >> > }
> > >>
> > >>
> > >>
> > >> --
> > >> Harsh J
> > >
> > >
> >
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
; {
> >> domainNodeRankRowKey =
> >> Bytes.toBytes(RankStructure.DOMAIN_NODE_RANK_ROW +
> >> Tools.GetAHash(domainKey + timingScale + nodeRankEntry.getKey()));
> >>
> >> domainKeyPut = new Put(domainNodeRankRowKey);
> >> domainKeyPut.add(RankStructure.DOMAIN_NODE_RANK_FAMILY,
> >> RankStructure.DOMAIN_NODE_RANK_DOMAIN_KEY_COLUMN,
> >> Bytes.toBytes(domainKey));
> >> puts.add(domainKeyPut);
> >>
> >> timingScalePut = new Put(domainNodeRankRowKey);
> >> timingScalePut.add(RankStructure.DOMAIN_NODE_RANK_FAMILY,
> >> RankStructure.DOMAIN_NODE_RANK_TIMING_SCALE_COLUMN,
> >> Bytes.toBytes(timingScale));
> >> puts.add(timingScalePut);
> >>
> >> nodeKeyPut = new Put(domainNodeRankRowKey);
> >> nodeKeyPut.add(RankStructure.DOMAIN_NODE_RANK_FAMILY,
> >> RankStructure.DOMAIN_NODE_RANK_NODE_KEY_COLUMN,
> >> Bytes.toBytes(nodeRankEntry.getKey()));
> >> puts.add(nodeKeyPut);
> >>
> >> rankPut = new Put(domainNodeRankRowKey);
> >> rankPut.add(RankStructure.DOMAIN_NODE_RANK_FAMILY,
> >> RankStructure.DOMAIN_NODE_RANK_RANKS_COLUMN,
> >> Bytes.toBytes(nodeRankEntry.getValue()));
> >> puts.add(rankPut);
> >> }
> >>
> >> try
> >> {
> >> this.rankTable.put(puts);
> >> }
> >> catch (IOException e)
> >> {
> >> e.printStackTrace();
> >> }
> >> }
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
gt; >
> > We are passing random 1 row-keys as input, while HBase is taking
> around
> > 17 secs to return 1 records.
> >
> > Please suggest some tuning to increase HBase read performance.
> >
> > Thanks,
> > Ankit Jain
> > iLabs
> >
> >
> >
> > --
> > Thanks,
> > Ankit Jain
> >
>
--
Adrien Mogenet
http://www.borntosegfault.com
t; I'm sure there is some basis for this text in the book but I
> recommend
> >>> we
> >>>>> strike it. We could replace it with YCSB or LoadTestTool driven
> >> latency
> >>>>> graphs for different workloads maybe. Although that would also be a
> >> big
> >>>>> simplification of 'schema design' considerations, it would not be so
> >>>>> starkly lacking background.
> >>>>>
> >>>>> On Sunday, April 7, 2013, Ted Yu wrote:
> >>>>>
> >>>>>> From http://hbase.apache.org/book.html#number.of.cfs :
> >>>>>>
> >>>>>> HBase currently does not do well with anything above two or three
> >>> column
> >>>>>> families so keep the number of column families in your schema low.
> >>>>>>
> >>>>>> Cheers
> >>>>>>
> >>>>>> On Sun, Apr 7, 2013 at 3:04 PM, Stack >> >
> >>>>>> wrote:
> >>>>>>
> >>>>>>> On Sun, Apr 7, 2013 at 11:58 AM, Ted >>>>>> >
> >>>>>> wrote:
> >>>>>>>
> >>>>>>>> With regard to number of column families, 3 is the recommended
> >>>>>> maximum.
> >>>>>>>>
> >>>>>>>
> >>>>>>> How did you come up w/ the number '3'? Is it a 'hard' 3? Or does
> >> it
> >>>>>>> depend? If the latter, on what does it depend?
> >>>>>>> Thanks,
> >>>>>>> St.Ack
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>> --
> >>>>> Best regards,
> >>>>>
> >>>>> - Andy
> >>>>>
> >>>>> Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein
> >>>>> (via Tom White)
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>
>
>
--
Adrien Mogenet
http://www.borntosegfault.com
cketTimeoutException).
How does HBase handle data locality for random accesses ? Could it be a
lead to solve this kind of issue ?
My block cache of 5 GB is not full at all...
--
Adrien Mogenet
http://www.mogenet.me
rate and how many nodes you
> have?
>
> Sent from my iPhone
>
> On 11 ביול 2012, at 22:08, Adrien Mogenet
> wrote:
>
> Hi there,
>
> I'm discovering HBase and comparing it with other distributed database I
> know much better. I am currently stressing my testing p
a every day and
> that will be add hbase.
> Any links, articals, suggestions, ideas that will improve hbase random
> read/write performance will be appreciated.
>
>
> bruce
> best regards!!!
>
--
Adrien Mogenet
http://www.mogenet.me
nd up with the most efficient
> regions, size-wise?
>
> At what point is it a good idea to turn off automatic region splits and
> manually manage them?
>
> Thanks,
>
> Rob Roland
> Senior Software Engineer
> Simply Measured, Inc.
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
ven distribution of rowkeys now.
>
> Is there a best practice for number of regions of a table per server?
> Meaning, with 5 region servers, 10 regions per table, so 170 regions per
> region server, would that be good?
>
> Thanks for the feedback,
>
> Rob
>
> On Fri, J
gt; >>> The question here is - why do you need to distribute your data over
> >>> lots of tables? What's your access pattern and what kind of data are
> >>> you putting in? Or is this just a theoretical question?
> >>>
> >>> On Jul 13
ting : Region is not online
> and in master-status I found region in transcation kept for 10 minutes and
> status kept in PENDING_OPEN
>
> i can't find any idea to fix it.
> Any suggestion will be appreciated！
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
easy way to tell how my nodes are balanced and how the rows are
> distributed in the cluster?
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
gionserver. Are there
> other reasons for data locality to be poor and any way to fix it?
>
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
Hi there,
While I'm performing read-intensive benchmarks, I'm seeing storm of
"CallerDisconnectedException" in certain RegionServers. As the
documentation says, my client received a SocketTimeoutException
(6ms etc...) at the same time.
It's always happening and I get very poor read-performance
ket timeouts happen, also check the GC log, but one thing people
>> often hit while doing pure random read workloads with tons of clients
>> is running out of sockets because they are all stuck in CLOSE_WAIT.
>> You can check that by using lsof. There are other discussion on this
&
o "FFF..
(x32)". Maybe it's another topic, but I'm feeling it could result in
slow response time, even if Index size is low enough to fit in memory
(~120 MB / 12 GB of allocated heap).
What do you think about that hypothesis ?
On Thu, Aug 23, 2012 at 8:02 PM, Adrien Mogenet
wrote:
&g
me tasks (due to scheduling constraints), a few blocks
> may be read out by the RS-node's DNs, but shouldn't be a big impact
> given that a good scheduler in MR usually helps avoid having to do
> that.
>
> Alternatively you can also consider running low-slotted TTs to use up
> the RS machines but in a safer way.
>
> --
> Harsh J
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
On Fri, Aug 24, 2012 at 6:52 PM, N Keywal wrote:
> Hi Adrien,
>
>> What do you think about that hypothesis ?
>
> Yes, there is something fishy to look at here. Difficult to say
> without more logs as well.
> Are your gets totally random, or are you doing gets on rows that do
> exist? That would e
If you plan pre-splitting regions, look at the classes exposed by
RegionSplitter
(http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/util/RegionSplitter.html).
Are you keys String representing hexadecimal values or are they really
binary encoded ? (I mean, \xFF\x03 and not "F3" for example)
version of this data, or is it smart
> enough to go to the MemStore or WAL to get the most recent version of
> data?
>
> thanks!
>
> Jason
>
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
ata in Memstore?
>
> thanks,
>
> Jason
>
> On Wed, Sep 12, 2012 at 5:19 PM, Adrien Mogenet
> wrote:
> > WAL is just there for recover. Reads will meet the Memstore on their read
> > path, that's how LSM Trees are working.
> >
> > On Wed, Sep 12, 20
d you guys be interested in participating in a Paris-based user group?
>>> The idea would be to share HBase practises, with something like a meet-up
>>> per quarter.
>>>
>>> Reply to me directly or on the list, as you prefer.
>>>
>>> Cheers,
>>>
>>> Nicolas
>>>
>>
>>
>>
>> --
>> Bertrand Dechoux
>>
>
>
>
> --
> Bertrand Dechoux
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
t; don't-bother-trying-this-at-home, it's-too-late-go-to-sleep idea? Or
> not?
>
> Thanks,
> Otis
> --
> Search Analytics - http://sematext.com/search-analytics/index.html
> Performance Monitoring - http://sematext.com/spm/index.html
--
Adrien Mogenet
06.59.16.64.22
http://www.mogenet.me
;), see complete trace here: http://pastebin.com/raw.php?i=7wy0wdNq
Any idea?
--
Adrien Mogenet
http://www.borntosegfault.com
erWatcher ctor)
>
> this.recoverableZooKeeper = ZKUtil.connect(conf, quorum, this,
> descriptor);
>
> Can you check more of the RS log ?
>
> zookeeper log may reveal something as well.
>
> Cheers
>
> On Fri, Jul 12, 2013 at 3:32 PM, Adrien Mogenet >wrote:
>
now: I have to
> configure a new HBase cluster and I thought about using HBase 0.94.9 and
> JDK 7.
>
> Does anyone have some tests on this version? It is expected to work better
> than with JDK 1.6?
> I am looking forward to hear you input!
> Thanks!
>
--
Adrien Mogenet
http://www.borntosegfault.com
adding a
> > "timeout" argument to "coprocessorExec" in the future?
> >
> > Correct me if I was wrong, "coprocessorExec" does not seems to be async.
> If
> > I want to make by call to the coprocessor async, do I have to resort to
> > something like asynchbase?
> >
> > TIA
> >
> > Kim
> >
>
--
Adrien Mogenet
http://www.borntosegfault.com
space allocated for block cache -
> >>>>> there is no guarantee (as usual). If you don have in_memory column
> families you may decrease
> >>>>>
> >>>>>
> >>>>>
> >>>>> Best regards,
> >>>>> Vladimir Rodionov
> >>>>> Principal Platform Engineer
> >>>>> Carrier IQ, www.carrieriq.com
> >>>>> e-mail: vrodio...@carrieriq.com
> >>>>>
> >>>>>
> >>>>> From: Saurabh Yahoo [saurabh...@yahoo.com]
> >>>>> Sent: Wednesday, August 28, 2013 5:10 AM
> >>>>> To: user@hbase.apache.org
> >>>>> Subject: experiencing high latency for few reads in HBase
> >>>>>
> >>>>> Hi,
> >>>>>
> >>>>> We are running a stress test in our 5 node cluster and we are
> getting the expected mean latency of 10ms. But we are seeing around 20
> reads out of 25 million reads having latency more than 4 seconds. Can
> anyone provide the insight what we can do to meet below second SLA for each
> and every read?
> >>>>>
> >>>>> We observe the following things -
> >>>>>
> >>>>> 1. Reads are evenly distributed among 5 nodes. CPUs remain under 5%
> utilized.
> >>>>>
> >>>>> 2. We have 4gb block cache (30% block cache out of 12gb) setup. 3gb
> block cache got filled up but around 1gb remained free. There are a large
> number of cache eviction.
> >>>>>
> >>>>> Questions to experts -
> >>>>>
> >>>>> 1. If there are still 1gb of free block cache available, why is
> hbase evicting the block from cache?
> >>>>>
> >>>>> 4. We are seeing memory went up to 10gb three times before dropping
> sharply to 5gb.
> >>>>>
> >>>>> Any help is highly appreciable,
> >>>>>
> >>>>> Thanks,
> >>>>> Saurabh.
> >>>>>
> >>>>> Confidentiality Notice: The information contained in this message,
> including any attachments hereto, may be confidential and is intended to be
> read only by the individual or entity to whom this message is addressed. If
> the reader of this message is not the intended recipient or an agent or
> designee of the intended recipient, please note that any review, use,
> disclosure or distribution of this message or its attachments, in any form,
> is strictly prohibited. If you have received this message in error, please
> immediately notify the sender and/or notificati...@carrieriq.com and
> delete or destroy any copy of this message and its attachments.
>
--
Adrien Mogenet
http://www.borntosegfault.com
ry went up to 10gb three times before dropping
> sharply to 5gb.
> >>
> >> Any help is highly appreciable,
> >>
> >> Thanks,
> >> Saurabh.
> >>
> >> Confidentiality Notice: The information contained in this message,
> including any attachments hereto, may be confidential and is intended to be
> read only by the individual or entity to whom this message is addressed. If
> the reader of this message is not the intended recipient or an agent or
> designee of the intended recipient, please note that any review, use,
> disclosure or distribution of this message or its attachments, in any form,
> is strictly prohibited. If you have received this message in error, please
> immediately notify the sender and/or notificati...@carrieriq.com and
> delete or destroy any copy of this message and its attachments.
>
--
Adrien Mogenet
http://www.borntosegfault.com
ils on what exactly you are trying to
> do and how your Java MR code is written, how many MR jobs for Java vs Pig
> and so on
>
> Sent from Yahoo! Mail on Android
>
>
--
Adrien Mogenet
http://www.borntosegfault.com
ev mailing list?
--
Adrien Mogenet
http://www.borntosegfault.com
>
> > --
> > View this message in context:
> >
> http://apache-hbase.679495.n3.nabble.com/Spatial-data-posting-in-HBase-tp4051123.html
> > Sent from the HBase User mailing list archive at Nabble.com.
> >
>
--
Adrien Mogenet
http://www.borntosegfault.com
onization. How do we guarantee that this method is thread safe? I am
> curious to know is it safe to use the static method on
> RegionServer(multithreaded environment)?
>
> Please correct me if i stated something wrong above.
>
> --
> Thanks & Regards,
> Anil Gupta
>
--
Adrien Mogenet
http://www.borntosegfault.com
Support
> >>> http://sematext.com/
> >>> On Sep 24, 2013 8:29 AM, "cto" wrote:
> >>>
> >>>> Hi ,
> >>>>
> >>>> I am very new in HBase. Could you please let me know , how to insert
> >>>> spatial
> >>>> data (Latitude / Longitude) in HBase using Java .
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> View this message in context:
> >>>>
> http://apache-hbase.679495.n3.nabble.com/Spatial-data-posting-in-HBase-tp4051123.html
> >>>> Sent from the HBase User mailing list archive at Nabble.com.
> >>>>
> >>
> >
>
>
--
Adrien Mogenet
http://www.borntosegfault.com
ggesting you not to use geohash, just that its not going to be
> > the most efficient.
> >
> > Note that the the downside to tiling is that if you're doing a geospatial
> > index... your data volume explodes because you are storing references to
> > the data at diffe
; > >>
> > >> > Is it possible to make schema changes to HBase Table without having
> to
> > >> > explicitly disable the Table ? ( I want to add new Column Family to
> > >> > existing table).
> > >> >
> > >> > Thanks, Chetan
> > >> >
> > >>
> > >
> > >
> > >
> > > --
> > > - Chetan
> > > http://about.me/chetan.kadam
> > >
> >
> >
> >
> > --
> > - Chetan
> > http://about.me/chetan.kadam
> >
>
--
Adrien Mogenet
http://www.borntosegfault.com
; Thanks,
> >> > >> > >
> >> > >> > > JM
> >> > >> > >
> >> > >> > >
> >> > >> > > 2013/10/22 Vimal Jain
> >> > >> > >
> >> > >> > > > Hi,
> >> > >> > > > I am running in Hbase in pseudo distributed mode. ( Hadoop
> >> > version -
> >> > >> > > 1.1.2
> >> > >> > > > , Hbase version - 0.94.7 )
> >> > >> > > > I am getting few exceptions in both hadoop ( namenode ,
> >> datanode)
> >> > >> logs
> >> > >> > > and
> >> > >> > > > hbase(region server).
> >> > >> > > > When i search for these exceptions on google , i concluded
> >> that
> >> > >> > problem
> >> > >> > > is
> >> > >> > > > mainly due to large number of full GC in region server
> process.
> >> > >> > > >
> >> > >> > > > I used jstat and found that there are total of 950 full GCs
> in
> >> > span
> >> > >> of
> >> > >> > 4
> >> > >> > > > days for region server process.Is this ok?
> >> > >> > > >
> >> > >> > > > I am totally confused by number of exceptions i am getting.
> >> > >> > > > Also i get below exceptions intermittently.
> >> > >> > > >
> >> > >> > > >
> >> > >> > > > Region server:-
> >> > >> > > >
> >> > >> > > > 2013-10-22 12:00:26,627 WARN
> org.apache.hadoop.ipc.HBaseServer:
> >> > >> > > > (responseTooSlow):
> >> > >> > > > {"processingtimems":15312,"call":"next(-6681408251916104762,
> >> > 1000),
> >> > >> rpc
> >> > >> > > > version=1, client version=29,
> >> > >> > methodsFingerPrint=-1368823753","client":"
> >> > >> > > > 192.168.20.31:48270
> >> > >> > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> ","starttimems":1382423411293,"queuetimems":0,"class":"HRegionServer","responsesize":4808556,"method":"next"}
> >> > >> > > > 2013-10-22 12:06:17,606 WARN
> org.apache.hadoop.ipc.HBaseServer:
> >> > >> > > > (operationTooSlow): {"processingtimems":14759,"client":"
> >> > >> > > > 192.168.20.31:48247
> >> > >> > > >
> >> > >> > > >
> >> > >> > >
> >> > >> >
> >> > >>
> >> >
> >>
> ","timeRange":[0,9223372036854775807],"starttimems":1382423762845,"responsesize":61,"class":"HRegionServer","table":"event_data","cacheBlocks":true,"families":{"gin
> >>
> >
> >
> >
> > --
> > Thanks and Regards,
> > Vimal Jain
> >
>
>
>
> --
> Thanks and Regards,
> Vimal Jain
>
--
Adrien Mogenet
http://www.borntosegfault.com
lt behavior as close as in
previous versions. "By chance", logs were mentioning this "Periodic
Flusher" but this could have taken much more time to debug otherwise :-)
What are you thoughts guys?
(Perhaps should be cc'ed to dev list?)
--
Adrien Mogenet
http://www.borntosegfault.com
Hi Adrien,
> >
> > What was the bad behavior you faced because of that? Maybe it's what need
> > to be fixed more than the periodic flusher? Or put a bigger default
> value?
> >
> > JM
> >
> >
> > 2013/12/8 Adrien Mogenet
> >
> > >
lt it to 0 (off) then? (As Ted pointed out, you can turn
> > this off).
> > Are you not worried about MTTR when a RegionServer dies with 3GB of logs
> > to replay?
> >
> >
> > -- Lars
> >
> >
> >
> >
>
Hi,
You can load your CP through the HBaseTesting utility and test it that way!
--
Adrien Mogenet
>From my mobile phone
On 29 Jan 2014 07:25, "Sujee Maniyam" wrote:
> Hi all,
>
> I am looking for a way to test co-processors. Some thing similar to
> mrunit.
> is the
vailable via the rest client, shell and/or thrift client?
>
> Also, is there a FuzzyColumn equivalent of this feature?
>
--
Adrien Mogenet
http://www.borntosegfault.com
>
> ---
>
> -------
> Confidentiality Notice: The information contained in this e-mail and any
> accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
> of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the original
> message and all copies from
> your system. Thank you.
>
> ---
>
> ---
> Confidentiality Notice: The information contained in this e-mail and any
> accompanying attachment(s)
> is intended only for the use of the intended recipient and may be
> confidential and/or privileged of
> Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader
> of this communication is
> not the intended recipient, unauthorized use, forwarding, printing,
> storing, disclosure or copying
> is strictly prohibited, and may be unlawful.If you have received this
> communication in error,please
> immediately notify the sender by return e-mail, and delete the original
> message and all copies from
> your system. Thank you.
>
> ---
>
--
Adrien Mogenet
http://www.borntosegfault.com
2014-05-08 5:47 GMT-04:00 Vikas Jadhav :
>
> > Hello
> > I need to apply complex logic on hbase which we write generally in
> > stored procs in RDBMS.
> > Is there any way of doing this I looked at hbase coprocessors but
> > found difficult to understan
in real it is
> one message write in whereas the other message dropped.
>
> Thank you!
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Discuss-HBase-with-multiple-threads-tp4060081p4060111.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
--
Adrien Mogenet
http://www.borntosegfault.com
he information contained in this message,
> including any attachments hereto, may be confidential and is intended to be
> read only by the individual or entity to whom this message is addressed. If
> the reader of this message is not the intended recipient or an agent or
> designee of the intended recipient, please note that any review, use,
> disclosure or distribution of this message or its attachments, in any form,
> is strictly prohibited. If you have received this message in error, please
> immediately notify the sender and/or notificati...@carrieriq.com and
> delete or destroy any copy of this message and its attachments.
>
--
Adrien Mogenet
http://www.borntosegfault.com
66 matches
Mail list logo
