Re: Loading HBase table into HDFS

2016-09-22 Thread Ted Yu
The parameter I mentioned only covers one column family. You need to run export for each of the column families. > On Sep 22, 2016, at 9:15 PM, karthi keyan wrote: > > Thanks all , > > I Want to load a certain number of columnfamily in to the HDFS. how can i > achieve it ? > > >> On Wed,

Re: [RegionServer Dead] Identify HBase Table Cause RegionServer Dead(Version 1.0.0-cdh5.5.2)

2016-09-22 Thread Proust/Feng Guizhou
Thanks Ted and Vlad I upload the screenshots to flickr, seems they are more clear there 1. MutateCount(Put Count) at table level(null as gap) https://flic.kr/p/LxLa6d 2. MutateCount(Put Count) at table level(null as line con

Re: Loading HBase table into HDFS

2016-09-22 Thread karthi keyan
Thanks all , I Want to load a certain number of columnfamily in to the HDFS. how can i achieve it ? On Wed, Sep 21, 2016 at 9:30 PM, Ted Yu wrote: > By specifying "hbase.mapreduce.scan.column.family", you can export > selected > column family. > > On Wed, Sep 21, 2016 at 8:49 AM, sudhir patil

Re: HBase Replication - Specific Tables To Different Clusters

2016-09-22 Thread Guanghao Zhang
HBase replication supported both of them. You can use add_peer or set_peer_tableCFs to config specific tables for specific peers.

HBase Replication - Specific Tables To Different Clusters

2016-09-22 Thread Noland, McDonald
Good day, Hope this message finds everyone well. We are working on some requirements around HBase replication and wanted to verify our understanding. We understand that we can replicate a source HBase cluster to multiple destination clusters by setting up peers and then setting the tables need

Re: Increased response time of hbase calls

2016-09-22 Thread Enis Söztutar
Please also note that m7 IS NOT HBase and have no connection with Apache HBase at all. Please do not let your vendor tell otherwise. Enis On Thu, Sep 22, 2016 at 12:00 AM, Deepak Khandelwal < dkhandelwal@gmail.com> wrote: > Ok thx everyone. > > Will check with Mapr > > On Wednesday, Septembe

Re: [RegionServer Dead] Identify HBase Table Cause RegionServer Dead(Version 1.0.0-cdh5.5.2)

2016-09-22 Thread Ted Yu
For tuning G1GC, see the head of https://blogs.apache.org/hbase/ FYI On Thu, Sep 22, 2016 at 10:30 AM, Vladimir Rodionov wrote: > Your RS was declared dead because of a long GC. > > What you can do: > > 1. Tweak CMS config: -XX:CMSInitiatingOccupancyFraction=50 > -XX:CMSInitiatingOccupancyFract

Re: [RegionServer Dead] Identify HBase Table Cause RegionServer Dead(Version 1.0.0-cdh5.5.2)

2016-09-22 Thread Vladimir Rodionov
Your RS was declared dead because of a long GC. What you can do: 1. Tweak CMS config: -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSInitiatingOccupancyFractionOnly. Plus increase heap size accordingly to accommodate decreasing of a working set size (now CMS starts when 50% of heap is occupied). I

Re: [RegionServer Dead] Identify HBase Table Cause RegionServer Dead(Version 1.0.0-cdh5.5.2)

2016-09-22 Thread Ted Yu
bq. the MutateCount metrics didn't show there is a peak time before and after the problem on that table In the graph, there was a purple line with spikes - I assume this was not for the table with max MemStoreSize. The legend in the graph is hard to read. If the sizes of the Puts vary, that may ex

[RegionServer Dead] Identify HBase Table Cause RegionServer Dead(Version 1.0.0-cdh5.5.2)

2016-09-22 Thread Proust/Feng Guizhou
Hi, HBase Users I encounter a RegionServer Dead case, and want to identify which HBase Table actually cause the problem Based on HBase JMX Restful Service, what I have on hand is: 1. Table level Grafana monitoring for Put, Get, Scan, MemStoreSize 2. RegionServer level Grafana monitoring for GC an

RegionServer aborting and shutting down

2016-09-22 Thread Kristoffer Sjögren
Hi We are running OpenTSDB 2.2 with HBase 1.1.2 and are having problems with RegionServers that are shutting down sporadically from alleged GC pauses. We run 2 OpenTSDB machines and 30 region servers. 8 GB heaps. The region servers are collocated with data nodes and yarn jobs. Every region server

Re: Hbase throttling issues

2016-09-22 Thread Guanghao Zhang
Did you set any other quotas? The exception ThrottlingException.throwReadSizeExceeded shows that the throttle type is READ_SIZE, but your quota's throttle type is REQUEST_SIZE. You can use list_quota shell cmd to check whether there are READ_SIZE quota. 2016-09-22 12:06 GMT+08:00 Sumit Nigam : >

Re: Increased response time of hbase calls

2016-09-22 Thread Deepak Khandelwal
Ok thx everyone. Will check with Mapr On Wednesday, September 21, 2016, Heng Chen wrote: > Not sure hbase m7 is which version of hbase in community. > > Is your batch load job some kind of bulk load or just call HTable API > to dump data to HBase? > > > 2016-09-22 14:30 GMT+08:00 Dima Spivak >