Re: how to work Htable connection

2012-11-05 Thread Leonid Fedotov
connection (method 1) is preferred. As of your second question: Client use zookeeper to find HBase master server, then consult with HBase master about region server(s) location(s) and then connect to region server(s) directly. Thank you! Sincerely, Leonid Fedotov On Nov 4, 2012, at 9:47 PM, 김인태

Re: HBase scan performance decreases over time.

2012-11-05 Thread Leonid Fedotov
you! Sincerely, Leonid Fedotov On Nov 5, 2012, at 10:14 AM, Asaf Mesika wrote: > Where is this settings located? > > Sent from my iPhone > > On 5 בנוב 2012, at 15:05, Michael Segel wrote: > >> There's an HDFS bandwidth setting which is set to 10MB/s. >

Re: Region is not online: .META.,,1

2012-11-07 Thread Leonid Fedotov
The first to try is hbase hbck -repair Check here: http://hbase.apache.org/book/apbs04.html#d2067e11173 Thank you! Sincerely, Leonid Fedotov On Nov 6, 2012, at 10:08 PM, Mesika, Asaf wrote: > After restart, running hbck results in: > 12/11/07 06:07:28 DEBUG client.MetaScanner: Sc

Re: Question About Starting and Stopping HADOOP & HBASE Cluster in Secure Mode

2012-11-27 Thread Leonid Fedotov
! Sincerely, Leonid Fedotov On Nov 27, 2012, at 3:28 AM, a...@hsk.hk wrote: > Hi, > > I currently use the following steps to start and stop HADOOP & HBASE cluster: > > 1) Without Kerberos Security > (start zookeepers) > start the cluster from Master: > {$H

Re: Connecting to standalone HBase from a remote client

2012-11-27 Thread Leonid Fedotov
locations . Thank you! Sincerely, Leonid Fedotov On Nov 27, 2012, at 8:10 AM, matan wrote: > Hi Mohammad, > > I'm loosing track... I came to understand that ZK tells the client where > the ROOT/META is, and from there the client gets the region server it > should contact. An

Re: recommended nodes

2012-11-27 Thread Leonid Fedotov
balanced. Thank you! Sincerely, Leonid Fedotov On Nov 27, 2012, at 11:52 AM, Jean-Marc Spaggiari wrote: > Hi Michael, > > so are you recommanding 32Gb per node? > > What about the disks? SATA drives are to slow? > > JM > > 2012/11/26, Michael Segel : >> Uhm, th

Re: Reg:delete performance on HBase table

2012-12-05 Thread Leonid Fedotov
le" it mark it as deleted instantly, and then delete actual data during the next major compaction. Thank you! Sincerely, Leonid Fedotov On Dec 5, 2012, at 5:03 AM, Manoj Babu wrote: > Hi All, > > I am having doubt on delete performance inHBase table. > > I have 190 million

Re: 答复: how config multi regionserver, or what is wrong?

2012-12-10 Thread Leonid Fedotov
Your nodes are too much out of sync with time. > Reported time is too far out of sync with master. Time difference of > 496371ms > max allowed of 3ms You need to set up time synchronization service for your cluster. Thank you! Sincerely, Leonid Fedotov Hortonworks support team

Re: Where to place logs

2012-12-28 Thread Leonid Fedotov
. Thank you! Sincerely, Leonid Fedotov On Dec 28, 2012, at 12:51 AM, Varun Sharma wrote: > Thanks for the tip. I was just wondering what people have done in the past > - do people typically reserve a separate disk for logging activity ? > > Thanks > Varun > > On Wed, De

Re: persistence in Hbase

2013-01-10 Thread Leonid Fedotov
Panshul, Of course you will have all your data in place. It stored in HDFS and remains in there after restarting. Thank you! Sincerely, Leonid Fedotov On Jan 10, 2013, at 7:18 AM, Panshul Gupta wrote: > Hello, > > I was wondering if it is possible that I have data stored in Hbase ta

Re: Storing images in Hbase

2013-01-10 Thread Leonid Fedotov
Jack, yes, this is very interesting to know your setup details. Could you please provide more information? Or we can take this off the list if you like… Thank you! Sincerely, Leonid Fedotov On Jan 10, 2013, at 9:24 AM, Jack Levin wrote: > We stored about 1 billion images into hbase with f

Re: Storing images in Hbase

2013-01-10 Thread Leonid Fedotov
I'm voting for continuing here as well… So, location is up to Jack. :) Thank you! Sincerely, Leonid Fedotov On Jan 10, 2013, at 11:24 AM, Mohammad Tariq wrote: > Jack, Leonid, > >I request you guys to please continue the discussion > through the thread itself if possibl

Re: HDFS disk space requirements

2013-01-11 Thread Leonid Fedotov
What is the reason to have replication factor set to 5? change it to 3 and you will save 30% of the space. Also, you can load your JSON data to separate folder with replication set to 1, as it is only the source and will be gone after processing. Thank you! Sincerely, Leonid Fedotov On Jan

Re: Adding hbase nodes on the fly

2013-01-11 Thread Leonid Fedotov
Load all the needed binaries to the new server, copy configuration from the existing one and start the new one. Master will pick it up and start to use. Thank you! Sincerely, Leonid Fedotov On Jan 11, 2013, at 4:02 AM, Panshul Whisper wrote: > Hello, > > Is it possible to add Hbase

Re: Ganglia Vs Nagios

2013-02-26 Thread Leonid Fedotov
Ganglia is monitoring and trending. Nagios is health checking and alerting. There are also many other tools, like Cacti, for example. Very similar functionality to Ganglia, It all depends on what kind of information you need to get. Thank you! Sincerely, Leonid Fedotov On Feb 26, 2013, at

Re: Ganglia Vs Nagios

2013-02-28 Thread Leonid Fedotov
Brushan, I do not think this sematext.com solution is what you are looking for. It only monitors HBase and nothing else in the Hadoop ecosystem. As Enis said, go to Ambari and it will give you full size monitoring/alerting/management functionality. Thank you! Sincerely, Leonid Fedotov On Feb

Re: Root Region is not online

2013-03-01 Thread Leonid Fedotov
Charan, did you restart HBase services after restarting HDFS? THis needs to be done, as HBase may lost track of the files during HDFS unavailability. Thank you! Sincerely, Leonid Fedotov On Mar 1, 2013, at 12:33 AM, charan raj wrote: > hi, > > I am currently using a 5 nod

Re: discp versus export

2013-03-05 Thread Leonid Fedotov
Rita, it seems like replication will be the best option for you. Take a look on this doc: http://hbase.apache.org/replication.html Thank you! Sincerely, Leonid Fedotov On Mar 4, 2013, at 4:18 PM, Rita wrote: > the end goal is to have a backup of our hbase tables. > > > On Mon, Ma

Re: Unable to start regionserver in distributed mode

2013-03-28 Thread Leonid Fedotov
Make sure you use hosts names, not "localhost" as name in the hadoop and base configurations. Thank you! Sincerely, Leonid Fedotov On Mar 28, 2013, at 8:30 AM, anand nalya wrote: > Hi, > > I'm trying to run HBase in distrbuted mode with 2 region servers, but when &g

Re: Lost regions question

2013-04-15 Thread Leonid Fedotov
Try to run "habase hbck -fix" It should do the job. Thank you! Sincerely, Leonid Fedotov On Apr 12, 2013, at 9:56 AM, Brennon Church wrote: > hbck does show the hdfs files there without associated regions. I probably > could have recovered had I noticed just after this hap

Re: help why do my regionservers shut themselves down?

2013-04-23 Thread Leonid Fedotov
tions... Thank you! Sincerely, Leonid Fedotov On Apr 22, 2013, at 6:25 PM, kaveh minooie wrote: > > Hi > > after a few mapreduce jobs my regionservers shut themselves down. this is the > latest time that this has happened: > > 20

Re: HBase is not running.

2013-04-26 Thread Leonid Fedotov
Looks like your zookeeper configuration is incorrect in HBase. Check it out. Thank you! Sincerely, Leonid Fedotov Technical Support Engineer On Apr 26, 2013, at 9:59 AM, Yves S. Garret wrote: > Hi, thanks for your reply. > > I did [ hostname ] in my linux OS and this is what I h

Re: Hbase cluster for serving real time site traffic

2012-11-01 Thread Leonid Fedotov
! Sincerely, Leonid Fedotov Technical Support Engineer lfedo...@hortonworks.com office: +1 855 846 7866 ext 292 mobile: +1 650 430 1673 On Nov 1, 2012, at 4:17 AM, Marcos Ortiz Valmaseda wrote: > Regards, Varun. > 1- I think that you should take a look to the Cloudera Manager for CDH 4.1 to &g

Upgrade from .94 to .98 and major compaction

2015-02-08 Thread Leonid Fedotov
! Leonid Fedotov signature.asc Description: Message signed with OpenPGP using GPGMail