Re: hbase datalocality while running mapreduce

er this table whether there will be any data locality. If not > please explain > > Thanks > -- Kevin O'Dell Field Engineer 850-496-1298 | ke...@rocana.com @kevinrodell <http://www.rocana.com>

Re: Compaction monitoring

gt; > For example, I have difficulties answering the following questions: > * can I shorten my off-peak hours range? > * can I afford to do compactions more often? or more aggressively? > * how much degrades my performance if region size is becoming too large? > > HBase version I'm

Re: Scan time increasing linearly

> Am I doing something terribly wrong? > > Thanks in advance! > Best regards, > Lydia -- Kevin O'Dell Field Engineer 850-496-1298 | ke...@rocana.com @kevinrodell <http://www.rocana.com>

Re: how to optimize for heavy writes scenario

; > > > In my opinion, 1M/s input data will result in only 70MByte/s write > > throughput to the cluster, which is quite a small amount compare to the 6 > > region servers. The performance should not be bad like this. > > > > Is anybody has idea why the performance stops at 600K/s? > > Is there anything I have to tune to increase the HBase write throughput? > > > > > If you double the clients writing do you see an up in the throughput? > > If you thread dump the servers, can you tell where they are held up? Or if > they are doing any work at all relative? > > St.Ack > -- Kevin O'Dell Field Engineer 850-496-1298 | ke...@rocana.com @kevinrodell <http://www.rocana.com>

Re: Optimizations for a Read-only database

. On Fri, Mar 17, 2017 at 1:55 PM, Kevin O'Dell <ke...@rocana.com> wrote: > Hi Jeff, > > You can definitely lower the memstore, the last time I looked there it > had to be set to .1 at lowest it could go. I would not recommend disabling > compactions ever, bad things will oc

Re: Optimizations for a Read-only database

How about disabling some regular operations to save CPU time. I think > Compaction is one of those we'd like to stop. > > thanks > > Jeff > -- Kevin O'Dell Field Engineer 850-496-1298 | ke...@rocana.com @kevinrodell <http://www.rocana.com>

Re: Rowkey design question

, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) -- Kevin O'Dell Field Enablement, Cloudera

Re: introducing nodes w/ more storage

accidental. Use at your own risk. Michael Segel michael_segel (AT) hotmail.com -- Kevin O'Dell Field Enablement, Cloudera

Re: introducing nodes w/ more storage

to make is that with respect to HBase, you still need to think about the cluster as a whole. On Apr 2, 2015, at 7:41 AM, Kevin O'dell kevin.od...@cloudera.com wrote: Hi Mike, Sorry for the delay here. How does the HDFS load balancer impact the load balancing of HBase? -- The HDFS

Re: how to explain read/write performance change after modifying the hfile.block.cache.size?

is still buffered somewhere when hbase put the data into the memstore? Reading src code may cost me months, so a kindly reply will help me a lot... ... Thanks very much! Best Regards, Ming -- Kevin O'Dell Systems Engineer, Cloudera

Re: how to explain read/write performance change after modifying the hfile.block.cache.size?

until you kill all the cache right? Or was this an old JIRA I was thinking of? On Thu, Nov 20, 2014 at 3:37 PM, Ted Yu yuzhih...@gmail.com wrote: The indices are always cached. Cheers On Nov 20, 2014, at 12:33 PM, Kevin O'dell kevin.od...@cloudera.com wrote: I am also under

Re: Avoid GC Pauses on Scan MapReduces

=1000. I suspect this may be a block cache issue. My question is if/how to disable the block cache for the scan queries? This is taking out writes and causing instability on the cluster. Thanks, Pere -- Kevin O'Dell Systems Engineer, Cloudera

Re: hbase set memstore size to 0

Hi Ozhang, If you are only bulk loading into HBase, then memstore flush size should not matter. You most likely you looking to lower the upper/global memstore limits. On Aug 3, 2014 2:23 PM, ozhang ozhangu...@gmail.com wrote: Hello, In our hbase cluster memstore flush size is 128 mb. And to

Re: hbase set memstore size to 0

matter. If memstore flush size 128 mb, does java take some memory for each memstore on region startup. Or it only takes memory while you are using it to insert data. Thanks a lot 3 Ağu 2014 21:27 tarihinde Kevin O'dell [via Apache HBase] ml-node+s679495n4062260...@n3.nabble.com yazdı: Hi Ozhang

Re: Does compression ever improve performance?

Hi Jeremy, I always recommend turning on snappy compression, I have ~20% performance increases. On Jun 14, 2014 10:25 AM, Ted Yu yuzhih...@gmail.com wrote: You may have read Doug Meil's writeup where he tried out different ColumnFamily compressions : https://blogs.apache.org/hbase/

Re: Effect of region size on compaction performance

prohibited. If you have received this message in error, please immediately notify the sender and/or notificati...@carrieriq.com and delete or destroy any copy of this message and its attachments. -- Kevin O'Dell Systems Engineer, Cloudera

Re: 答复: what is the default size of each Column family memstore....

memstore -- Kevin O'Dell Systems Engineer, Cloudera

Re: 0.92 = 0.96 in one go?

* Search Analytics Solr Elasticsearch Support * http://sematext.com/ -- Kevin O'Dell Systems Engineer, Cloudera

Re: Hbase tuning for heavy write cluster

Rohit, 64GB heap is not ideal, you will run into some weird issues. How many regions are you running per server, how many drives in each node, any other settings you changed from default? On Jan 24, 2014 6:22 PM, Rohit Dev rohitdeve...@gmail.com wrote: Hi, We are running Opentsdb on CDH 4.3

Re: Hbase Performance Issue

Have you tried writing out an hfile and then bulk loading the data? On Jan 4, 2014 4:01 PM, Ted Yu yuzhih...@gmail.com wrote: bq. Output is written to either Hbase Looks like Akhtar wants to boost write performance to HBase. MapReduce over snapshot files targets higher read throughput.

Re: Hbase Performance Issue

. On Sun, Jan 5, 2014 at 2:19 AM, Kevin O'dell kevin.od...@cloudera.com wrote: Have you tried writing out an hfile and then bulk loading the data? On Jan 4, 2014 4:01 PM, Ted Yu yuzhih...@gmail.com wrote: bq. Output is written to either Hbase Looks like Akhtar wants to boost write

Re: HBase Client

. Regards, Andy. -- Kevin O'Dell Systems Engineer, Cloudera

Re: Get all columns in a column family

this message in context: http://apache-hbase.679495.n3.nabble.com/Get-all-columns-in-a-column-family-tp4053696.html Sent from the HBase User mailing list archive at Nabble.com. -- Kevin O'Dell Systems Engineer, Cloudera

Re: Problem When Prefetch META table

: Encountered problems when prefetch META table: ... Does this depend on the number of thread in whereby I insert the data? -- Kevin O'Dell Systems Engineer, Cloudera

Re: Table state

it is possible), and try bringing up the cluster again. hbck will not work as none of the region servers are up. Any one have any other ideas? Thanks, Raheem -- Kevin O'Dell Systems Engineer, Cloudera

Re: Table state

in the RS logs to see what this region can not come back online... JM 2013/12/10 Kevin O'dell kevin.od...@cloudera.com Hey Raheem, You can sideline the table into tmp(mv /hbase/table /tmp/table, then bring HBase back online. Once HBase is back you can use HBCK to repair your META

Re: Maximum number of regions for a table?

a table that grows very fast so the region keeps splitting, is it possible that the table could have as many regions as it could until all the resource run out? Thanks. Kim -- Kevin O'Dell Systems Engineer, Cloudera

Re: Region server block cache and memstore size

Dynamics +7 812 640 38 76 https://mail.google.com/mail/u/0/html/compose/static_files/blank_quirks.html# Skype: ivan.v.tretyakov www.griddynamics.com itretya...@griddynamics.com -- Kevin O'Dell Systems Engineer, Cloudera

Re: HBase Region Server crash if column size become to big

on Android -- Kevin O'Dell Systems Engineer, Cloudera

Re: HBase Region Server crash if column size become to big

crashs. How can i change the batch size in the hbase shell? Whats OOME? @Dhaval: there is only the *.out file in /var/log/hbase. Is the .log file located in another directory? 2013/9/11 Kevin O'dell kevin.od...@cloudera.com You can also check the messages file in /var/log. The OOME may also

Re: HBase Java client - unknown host: localhost.localdomain

Can you attach a screen shot of the HMaster UI? It appears ZK is connecting fine, but can't find .META. On Aug 25, 2013 8:57 AM, Shengjie Min shengjie@gmail.com wrote: Hi Jean-Marc, You meant my cloudera vm or my client? Here is my /etc/hosts cloudera vm: 127.0.0.1

Re: HBase Java client - unknown host: localhost.localdomain

, are you able to access the VM from outside? Like, are you able to access the WebUI from outside of the VM with something like http://cloudera:60010;? JM 2013/8/25 Shengjie Min shengjie@gmail.com On 25 August 2013 21:08, Kevin O'dell kevin.od

Re: HBase Java client - unknown host: localhost.localdomain

2013/8/25 Shengjie Min shengjie@gmail.com On 25 August 2013 21:08, Kevin O'dell kevin.od...@cloudera.com wrote: Can you attach a screen shot of the HMaster UI? It appears ZK is connecting fine, but can't find .META. On Aug 25

Re: Question about the time to execute joins in HBase!

QQ what is your caching set to? On Aug 22, 2013 11:25 AM, Pavan Sudheendra pavan0...@gmail.com wrote: Hi all, A serious question.. I know this isn't one of the best hbase practices but I really want to know.. I am doing a join across 3 table in hbase.. One table contain 19m records, one

Re: How many column families in one table ?

? Thanks, Viral -- Thanks and Regards, Vimal Jain -- Kevin O'Dell Systems Engineer, Cloudera

Re: Memory distribution for Hadoop/Hbase processes

My questions are : 1) How this thing is working ? It is working because java can over allocate memory. You will know you are using too much memory when the kernel starts killing processes. 2) I just have one table whose size at present is about 10-15 GB , so what should be ideal memory

Re: How many column families in one table ?

you are the average of 5 people you spend the most time with On Aug 4, 2013 8:15 PM, Kevin O'dell kevin.od...@cloudera.com wrote: Hi Vimal, It really depends on your usage pattern but HBase != Bigtable. On Aug 4, 2013 2:29 AM, Vimal Jain vkj...@gmail.com wrote: Hi, I have tested

Re: AssignmentManager looping?

Does it exist in meta or hdfs? On Aug 1, 2013 8:24 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: My master keep logging that: 2013-07-31 21:52:59,201 WARN org.apache.hadoop.hbase.master.AssignmentManager: Region 270a9c371fcbe9cd9a04986e0b77d16b not found on server

Re: AssignmentManager looping?

, 270a9c371fcbe9cd9a04986e0b77d16b, aff4d1d8bf470458bb19525e8aef0759] Can I just delete those zknodes? Worst case hbck will find them back from HDFS if required? JM 2013/8/1 Kevin O'dell kevin.od...@cloudera.com Does it exist in meta or hdfs? On Aug 1, 2013 8:24 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org

Re: AssignmentManager looping?

the znodes but got the same result. So I shutted down all the RS and restarted HBase, and now I have 0 regions for this table. Running HBCK. Seems that it has a lot to do... 2013/8/1 Kevin O'dell kevin.od...@cloudera.com Yes you can if HBase is down, first I would copy .META

Re: AssignmentManager looping?

If that doesn't work you probably have an invalid reference file and you will find that in RS logs for the HLog split that is never finishing. On Aug 1, 2013 1:38 PM, Kevin O'dell kevin.od...@cloudera.com wrote: JM, Stop HBase rmr /hbase from zkcli Sideline META Run offline meta repair

Re: AssignmentManager looping?

Kevin O'dell kevin.od...@cloudera.com If that doesn't work you probably have an invalid reference file and you will find that in RS logs for the HLog split that is never finishing. On Aug 1, 2013 1:38 PM, Kevin O'dell kevin.od...@cloudera.com wrote: JM, Stop HBase rmr /hbase from

Re: Multiple region servers per physical node

, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) -- Kevin O'Dell Systems Engineer

Re: G1 before/after GC time graph

...@carrieriq.com and delete or destroy any copy of this message and its attachments. -- Kevin O'Dell Systems Engineer, Cloudera

Re: GC recommendations for large Region Server heaps

a stable HBase cluster with 16 or 24GB RS heaps). Thanks in advance, --Suraj -- Kevin O'Dell Systems Engineer, Cloudera

Re: how many severs in a hbase cluster

. Perhaps those parentheses made that statement look like an optional statement. Just to clarify it was mandatory. Warm Regards, Tariq cloudfront.blogspot.com On Sat, Jun 22, 2013 at 9:45 PM, Kevin O'dell kevin.od...@cloudera.com wrote: If you run ZK with a DN/TT

Re: how many severs in a hbase cluster

If you run ZK with a DN/TT/RS please make sure to dedicate a hard drive and a core to the ZK process. I have seen many strange occurrences. On Jun 22, 2013 12:10 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: You HAVE TO run a ZK3, or else you don't need to have ZK2 and any ZK failure

Re: Running HBase with different versions

version on client to access it. Thanks in advance! -- Kevin O'Dell Systems Engineer, Cloudera

Re: Hbase write stream blocking and any solutions?

* * -- Kevin O'Dell Systems Engineer, Cloudera

Re: HMaster and HRegionServer going down

-- Thanks and Regards, Vimal Jain -- Thanks and Regards, Vimal Jain -- Thanks and Regards, Vimal Jain -- Thanks and Regards, Vimal Jain -- Kevin O'Dell Systems Engineer, Cloudera

Re: Region servers going down under heavy write load

increase RAM bit more but not much (Already RS has 20GB memory) Thanks in advance. Ameya -- Kevin O'Dell Systems Engineer, Cloudera

Re: PleaseHoldException when Master is clearly running as JPS

http://jayunit100.blogspot.com -- Jay Vyas http://jayunit100.blogspot.com -- Kevin O'Dell Systems Engineer, Cloudera

Re: PleaseHoldException when Master is clearly running as JPS

-- Jay Vyas http://jayunit100.blogspot.com -- Jay Vyas http://jayunit100.blogspot.com -- Kevin O'Dell Systems Engineer, Cloudera

Re: Eternal RIT problem when RS tries to access wrong region-folder on HDFS

: HRB 67460 Geschäftsführung: Thomas Kitlitschko -- Kevin O'Dell Systems Engineer, Cloudera

Re: Eternal RIT problem when RS tries to access wrong region-folder on HDFS

should pick this up as an orphan if you run it. -Kevin On Fri, May 3, 2013 at 10:34 AM, Dimitri Goldin dimitri.gol...@neofonie.dewrote: Hi Kevin, On 05/03/2013 02:57 PM, Kevin O'dell wrote: That is interesting. I have seen this before, can you please send a hadoop fs -lsr /hbase/documents

Re: HBase and Datawarehouse

back. - Piet Hein (via Tom White) -- Kevin O'Dell Systems Engineer, Cloudera

Re: How to remove all traces of a dropped table.

David, I have only seen this once before and I actually had to drop the META table and rebuild it with HBCK. After that the import worked. I am pretty sure I cleaned up the ZK as well. It was very strange indeed. If you can reproduce this can you open a JIRA as this is no longer a one off

Re: help why do my regionservers shut themselves down?

leases 2013-04-22 16:47:57,598 INFO org.apache.hadoop.hbase.**regionserver.ShutdownHook: Shutdown hook finished. I would appreciate it very much if someone could explain to me what just happened here. thanks, -- Kevin O'Dell Systems Engineer, Cloudera

Re: HBase Region Server Spinning on JMX requests

. -- Ron Buckley -- Kevin O'Dell Systems Engineer, Cloudera

Re: Region stuck in transition

? Regards -- *CHUNG Fabien * -- Chung Fabien EFREI Promo 2013 Tel : 06 48 03 54 92 -- Kevin O'Dell Systems Engineer, Cloudera

Re: should i use compression?

or the data_block_encoding. Should i? I want to have faster reads. Please suggest. Sincerely, Prakash Kadel -- Kevin O'Dell Systems Engineer, Cloudera

Re: how to reduce zookeeper.out

? it is a online system. Best R. beatls -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: how to reduce zookeeper.out

for the zookeeper.out. On Sat, Mar 30, 2013 at 10:31 PM, Kevin O'dell kevin.od...@cloudera.com wrote: Hi Hua, I believe(don't quote me) that you can use the rolling file appender to set the files to a max size. I know HBase does this, but I am not sure about ZK. On Sat, Mar 30, 2013

Re: if reads are bigger than a heap size?

size from requests couldn't be loaded at once on memories. What situations could be expected inside of hbase? flush memstores? firstly hbase accept all requests, and then response datas in order although the responses are so late? or deny requests? -- Kevin O'Dell Customer Operations

Re: hbase time skew

. I googled and understood that hbase can only handle about a couple of seconds time skew. We were wondering if there's any configuration in HBase that we can do so as to increase the number of seconds that hbase could handle? Thanks very much, YuLing -- Kevin O'Dell Customer Operations

Re: HBase is able to connect to ZooKeeper but the connection closes immediately...

-cdh3u3, r, Thu Jan 26 10:13:36 PST 2012 hbase(main):001:0 status 34 servers, 0 dead, 59.0882 average load hbase(main):002:0 What's going on? I suspect that HBase should be able to read/write from any node that I can modify hdfs from. -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Possible to delete a specific cell?

-- http://www.wibidata.com office: 1.415.496.9424 x208 cell: 1.609.577.1600 twitter: @nattyice http://www.twitter.com/nattyice -- http://www.wibidata.com office: 1.415.496.9424 x208 cell: 1.609.577.1600 twitter: @nattyice http://www.twitter.com/nattyice -- Kevin

Re: Possible to delete a specific cell?

cells prior to it would be very useful. Jeff On Thu, Mar 7, 2013 at 10:26 AM, Kevin O'dell kevin.od...@cloudera.com wrote: The problem is it kills all older cells. We should probably file a JIRA for this, as this behavior would be nice. Thoughts?: hbase(main):028:0 truncate 'tre

Re: Possible to delete a specific cell?

versioned cells, being able to delete a specific cell without deleting all cells prior to it would be very useful. Jeff On Thu, Mar 7, 2013 at 10:26 AM, Kevin O'dell kevin.od...@cloudera.com wrote: The problem is it kills all older cells. We should probably file a JIRA

Re: Possible to delete a specific cell?

Kevin O'dell kevin.od...@cloudera.com: JM, If you delete t2, you will also wipe out t3 right now. On Thu, Mar 7, 2013 at 1:37 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Kevin, How do you see that? Like a specific cell format which can cancel once timestamp

Re: Possible to delete a specific cell?

Ted, Yes that is correct, sorry 3 is newer than 1 when speak TSs. Sorry for the confusion :) On Thu, Mar 7, 2013 at 1:48 PM, Ted Yu yuzhih...@gmail.com wrote: I think there was typo in Kevin's email: t3 should be t1 On Thu, Mar 7, 2013 at 10:42 AM, Kevin O'dell kevin.od...@cloudera.com

Re: Odd WARN in hbase 0.94.2

, Bryan Beaudreault bbeaudrea...@hubspot.comwrote: Yep we do have that property set to that value. The file does not seem to exist when I try ls'ing it myself. I'm not sure where it comes from or how it should be created. On Tue, Mar 5, 2013 at 4:35 PM, Kevin O'dell kevin.od...@cloudera.com

Re: Odd WARN in hbase 0.94.2

that it doesn't indicate some problem. Has anyone ever seen this and know what it is or how to fix it? http://pastebin.com/PA6Y9pJN Thanks! -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: discp versus export

...@rocketmail.comwrote: Export and distcp has different application. Use discp when you need to move data across clusters. Do you want to export table data outside your cluster? If not then export table is better. Sent from HTC via Rocket! excuse typo. -- Kevin O'Dell Customer Operations Engineer

Re: HRegionInfo was null or empty in Meta errors

around this or have I completely hosed my hbase installation? On Jan 31, 2013, at 6:23 AM, Kevin O'dell kevin.od...@cloudera.com wrote: I am going to disagree with ignoring the error. You will encounter failures when doing other operations such as import/exports. The first

Re: Shell .META. scan STARTROW question

this: scan '.META.' , {STARTROW = 'z', LIMIT = 10} it's scanning the .META. from the beginning. Like if startrow was not considered. Is there a special character at the beginning of the .META. keys? It seems not. JM -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Shell .META. scan STARTROW question

Sorry for the silly question JM, but I have to ask :) On Mon, Feb 25, 2013 at 10:28 AM, Kevin O'dell kevin.od...@cloudera.comwrote: If you look at META do you have anything that starts with z? On Mon, Feb 25, 2013 at 10:24 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi, When

Re: Never ending transtionning regions.

that? I will try to create the missing directory and see the results... Thanks, JM -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Never ending transtionning regions.

I will face the issue again. If I'm able to reproduce, we might be able to figure where the issue is... JM 2013/2/23 Kevin O'dell kevin.od...@cloudera.com JM, How are you doing today? Right before the file does not exist should be another path. Can you let me know if in that path

Re: Never ending transtionning regions.

Kevin O'dell kevin.od...@cloudera.com JM, Here is what I am seeing: 2013-02-23 15:46:14,630 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=entry,ac.adanac-oidar.www\x1Fhttp\x1F-1\x1F/sports/patinage/2012/04/04/001-artistique-trophee

Re: How to Upgrade Hbase using Cloudera Manager?

. The current installed HBase version is 0.92.1+156. I want to upgrade it to the latest stable version. Can anyone please let me know what is the latest stable version and how can it be upgraded to it from Cloudera Manager only. Thanks, Vidosh -- Kevin O'Dell Customer Operations Engineer

Re: debugging responseTooSlow

is 1 Master running with 1 NN (on the same server) with 3 regionservers running alongside the datanodes. Thanks, Viral -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: HBase Region/Table Hotspotting

hotspotting is most welcome. Many thanks in advance. Regards, Joarder Kamal -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Acceptable CPU_WIO % ?

drives and I will configure all in RAID0. It doesn't seems to me to be an issue to lose one node, since data will be replicated everywhere else. I will simply have to replace the failing disk and restart the node, no? JM 2013/2/8, Kevin O'dell kevin.od...@cloudera.com: Azuryy

Re: split table data into two or more tables

tables in hbase with iidentical schemas, i.e. if table A has 100M records put 50M into table B, 50M into table C and delete table A. Currently, I use hbase-0.92.1 and hadoop-1.4.0 Thanks. Alex. -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Acceptable CPU_WIO % ?

, but I'm wondering how low shoud I go? JM -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Acceptable CPU_WIO % ?

anyway, I can re-run the tests just in case I did not configured something properly JM 2013/2/7, Kevin O'dell kevin.od...@cloudera.com: Hey JM, Why RAID0? That has a lot of disadvantages to using a JBOD configuration? Wait I/O is a symptom, not a problem. Are you actually

Re: Acceptable CPU_WIO % ?

will need to let it run for few more minutes to get some more data ... JM 2013/2/7, Kevin O'dell kevin.od...@cloudera.com: JM, Okay, I think I see what was happening. You currently only have one drive in the system that is showing High I/O wait correct? You are looking at bringing

Re: MemStoreFlusher: region has too many store files (client timeout)

-store-files-client-timeout-tp4037887.html Sent from the HBase User mailing list archive at Nabble.com. -- Kevin O'Dell Customer Operations Engineer, Cloudera -- View this message in context: http://apache-hbase.679495.n3.nabble.com/MemStoreFlusher-region-has-too-many-store-files

Re: Empty a table

the splitting. But I want to keep the regions the way they are. I just want to clean them. Is there a simple way to do that with the shell or something like that? Thanks, JM -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: MemStoreFlusher: region has too many store files (client timeout)

-hbase.679495.n3.nabble.com/MemStoreFlusher-region-has-too-many-store-files-client-timeout-tp4037887.html Sent from the HBase User mailing list archive at Nabble.com. -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: HBase vs Hadoop memory configuration.

and 7 DN+TT) Or it will be 1GB in total? And if we say 1GB for the DN, how much should we reserved for the other deamons? I want to make sure I give the maximum I can give to HBase without starving Hadoop... JM 2013/1/27, Kevin O'dell kevin.od...@cloudera.com: JM, That is probably

Re: What's the maximum number of regions per region server?

Best Regards. James Chang -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: Max storefile size in CDH3u4

What are you currently using? Also, what is your current region per node count? On Jan 28, 2013 6:50 PM, Lashing lss...@gmail.com wrote: Hi I'm running high in region number, can someone tell me what's the max storefile size in CDH3u4, thanks.

Re: Max storefile size in CDH3u4

, but anything above 4GB is not recommended and can *greatly *impact performance. On Mon, Jan 28, 2013 at 7:14 PM, Lsshiu lss...@gmail.com wrote: 3gb More than one thousand. Kevin O'dell kevin.od...@cloudera.com What are you currently using? Also, what is your current region per node

Re: HBase vs Hadoop memory configuration.

, I have configured my nodes with 45% memory for HBase, 45% memory for Hadoop. The last 10% are for the OS. Should I move that with 1GB for Hadoop, 10% for the OS and the rest for HBase? Even if running MR jobs? Thanks, JM -- Kevin O'Dell Customer Operations Engineer, Cloudera

Re: HBase vs Hadoop memory configuration.

1361 blocks per node. It that what you are asking? JM 2013/1/27, Kevin O'dell kevin.od...@cloudera.com: Hey JM, I suspect they are referring to the DN process only. It is important in these discussion to talk about individual component memory usage. In my experience most HBase

Re: drop table problem

in TransitionRegionStatebd8d2bf3ef04d0f8d3dac5ca2f612f42T21_0513_201301_bigtable,2710075,1358994123350.bd8d2bf3ef04d0f8d3dac5ca2f612f42. state=PENDING_OPEN, ts=Thu Jan 24 16:58:34 CST 2013 (699s ago), server=hadoop1,60020,1358993820407 -- * * * Thanx and Regards* * Vikas Jadhav* -- Kevin O'Dell

Re: drop table problem

Sorry I should have specified those are different options to try, not an ordered set of instructions. On Thu, Jan 24, 2013 at 8:47 AM, Kevin O'dell kevin.od...@cloudera.comwrote: Typically, hbck won't detect anything wrong here, as Ram said in another thread we really should work

Re: Region server crash while syncing HLog

) 4163,64-71 1% Thanks Varun -- Kevin O'Dell Customer Operations Engineer, Cloudera

  1   2   >