Re: Doubt

thanks a lot it is really nice. I didn't have any idea about this. Thanks Gaurhari On Tue, Feb 14, 2017 at 3:32 PM, Ted Yu wrote: > All the major NoSQL projects are indexed by http://search-hadoop.com/ > > You can easily find relevant information there. > > FYI > > On

Re: Doubt

All the major NoSQL projects are indexed by http://search-hadoop.com/ You can easily find relevant information there. FYI On Tue, Feb 14, 2017 at 7:28 AM, gaurhari dass wrote: > Actually I am not using HBase right now at large scale. > > I am using Mongodb mainly so to

Re: Doubt

Actually I am not using HBase right now at large scale. I am using Mongodb mainly so to keep myself updated I follow these discussions to learn about issues so I post it on my profile so that I can have easy access to those issues. Thanks Gaurhari On Tue, Feb 14, 2017 at 3:15 PM, Ted Yu

Re: Doubt

Do you use hbase (I assume you do) ? Why not share your own experience (bugs you encountered, tips for good operations practice, etc) ? Thanks On Tue, Feb 14, 2017 at 5:52 AM, gaurhari dass wrote: > I was not sure by sharing some one's email id publicly so I am

Re: Doubt

The previous thread from mailing list is on-going. I would expect proper edit of the thread, including attribution to participants. Otherwise the post doesn't have much value since prior conversation is publicly available. > On Feb 14, 2017, at 5:31 AM, gaurhari dass

Re: Doubt

Hi Yu, No there is no permission required. https://www.linkedin.com/pulse/hbase-read-write-performance-conversation-gaurhari-dass @Richard yes it is that conversation i copied from current emails. if there is any issue then let me know or should I include link. Thanks Gaurhari On Tue,

Re: Doubt

rmance-td4086182.html#a4086185 https://richardstartin.com/ From: Ted Yu <yuzhih...@gmail.com> Sent: 14 February 2017 12:30 To: user@hbase.apache.org Subject: Re: Doubt Clicking on both links directed me to: https://www.linkedin.com/post/new Do the pages

Re: Doubt

Clicking on both links directed me to: https://www.linkedin.com/post/new Do the pages require read permission ? On Tue, Feb 14, 2017 at 1:46 AM, gaurhari dass wrote: > Hi > > I want to post like this > > https://www.linkedin.com/post/edit/hbase-read-write- >

Re: Doubt

Hi I want to post like this https://www.linkedin.com/post/edit/hbase-read-write-performance-conversation-gaurhari-dass https://www.linkedin.com/post/edit/hbase-performance-improvements-gaurhari-dass it is just for my reference as well can be helpful to others if it is ok. Thanks Gaurhari On

Re: Doubt

Would like to hear more details, wherever it will be posted (smile). Best Regards, Yu On 14 February 2017 at 06:06, Stack wrote: > You might consider adding list of issues and solutions to the hbase > reference guide? > Yours, > S > > On Fri, Feb 10, 2017 at 1:34 AM, gaurhari

Re: Doubt

You might consider adding list of issues and solutions to the hbase reference guide? Yours, S On Fri, Feb 10, 2017 at 1:34 AM, gaurhari dass wrote: > Hi , > > I always follow problems users facing with hbase and solutions provided. > > these problems and solutions are

Re: Doubt

thanks On Fri, Feb 10, 2017 at 9:44 PM, Josh Elser wrote: > [image: Boxbe] This message is eligible > for Automatic Cleanup! (els...@apache.org) Add cleanup rule >

Re: Doubt

Gaurhari, This is a publicly-archived mailing list. As such, I don't believe anyone is going to be upset with intellectual property concerns. If anything, you could take a look at the ASF's trademark policy[1]. This likely covers any sensitive issues. [1]

Doubt

Hi , I always follow problems users facing with hbase and solutions provided. these problems and solutions are always helpful to me. I want to know if it is ok if I share these problems and solutions on my linkedin articles as it is. Thanks Gaurhari

Re: Doubt in Scanner.next()

As refguide states, hbase.client.scanner.caching works with hbase.client.scanner.max.result.size to try and use the network efficiently. Make sure the release you use is 1.1.0+ which had important bug fixes w.r.t. max result size. On Wed, Jan 11, 2017 at 9:46 AM, Josh Elser

Re: Doubt in Scanner.next()

Behind the scenes, the ClientScanner is buffering results from the previous RPC. Ignoring multiple RegionServers for now, the caching value denotes the number of records that were fetched by the ClientScanner in an RPC. When the buffered results are consumed by your client, a new RPC will be

Doubt in Scanner.next()

I have hbase.client.scanner.caching as 100. I am scanning a table. For instance say we have 500 rows matching for the current scan. When I give the statement ResultScanner.next() what will happen? whether it will return 100 rows for each next operation or something else Thanks

Hbase master selection doubt

How Hbase uses Zookeeper for Master selection and region server failure detection when Zookeeper is not strictly consistent. Say In Hbase Master selection process, how does a node is 100 % sure that a master is created ? Does it has to create the /master node and that node already exists will

Re: Hbase master selection doubt

bq. non strictly consistency of Zookeeper Can you elaborate on what the above means ? please read this: http://zookeeper.apache.org/doc/trunk/zookeeperProgrammers.html#ch_zkGuarantees Cheers On Sat, Jun 27, 2015 at 7:20 AM, Shushant Arora shushantaror...@gmail.com wrote: How Hbase uses

Re: Hbase master selection doubt

Zookeeper is Sequential Consistency Updates from a client will be applied in the order that they were sent. On Sat, Jun 27, 2015 at 8:18 PM, Ted Yu yuzhih...@gmail.com wrote: bq. non strictly consistency of Zookeeper Can you elaborate on what the above means ? please read this:

Re: Hbase master selection doubt

By strictly consistent I mean - all clients should see same data at any time in different sessions. Say a client C1 was connected to follower F1, And F1 was few seconds behind the leader. And client C2 connects to F2 which is in sync with Leader . Now C1 and C2 will see different data under root

Re: Regarding a doubt I am having for HBase

-- *From:* Alex Baranau barana...@gmail.com *Sent:* Thursday, March 5, 2015 2:56 PM *To:* Jaspreet Singh *Subject:* Re: Regarding a doubt I am having for HBase Hi Jaspreet, Do you see this time when you fetch by first field or by second? How do you construct

Re: Regarding a doubt I am having for HBase

Singh -- *From:* Alex Baranau barana...@gmail.com *Sent:* Thursday, March 5, 2015 2:56 PM *To:* Jaspreet Singh *Subject:* Re: Regarding a doubt I am having for HBase Hi Jaspreet, Do you see this time when you fetch by first field or by second? How do you

Re: small hbase doubt

compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO

Re: small hbase doubt

answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean

Re: small hbase doubt

..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org

small hbase doubt

Hello everyone, could anyone tell me small query? Does Hbase decompress data before executing query or it execute queries on compressed data? and how snappy and lzo actually behave ? thanks

Re: small hbase doubt

Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So only when a row feet your needs HBase will decrompress the value and send it back to you... Does it reply to your question? JM 2013/7/11 Alok Singh Mahor

Re: small hbase doubt

Compression only applies to data on disk. Over the wire (I.E., RS to client) is uncompressed. On 7/11/13 9:24 AM, Jean-Marc Spaggiari jean-m...@spaggiari.org wrote: Hi Alok, What do you mean by query? Gets are done based on the key. And snappy and LZO are used to compress the value. So

Re: small hbase doubt

To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11

Re: small hbase doubt

I thought that in 0.95 ProtoBuf provides RPC compression, no? On Friday, July 12, 2013, Alok Singh Mahor wrote: To Jean : Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how

Re: small hbase doubt

: Thanks for replying. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11

Re: small hbase doubt

. well could you please elaborate your answer..and by that 'query' ..i meant can anyone clear my doubt :-) To Doug: Thanks for replying. but then how LZO improves efficiency of network bandwidth when getting data from remote server...? what's that? On Thu, Jul 11, 2013 at 6:54 PM

RE: Doubt Regading HLogs

Is it a bug or part of design. It seems more of a design to me. Can someone guide me through the purpose of this feature. Thanks Rishabh From: Rishabh Agrawal Sent: Friday, May 17, 2013 4:24 PM To: user@hbase.apache.org Subject: Doubt Regading HLogs Hello, I am working with Hlogs of Hbase

Re: Doubt Regading HLogs

, so you see the real content as it is at the time of reading. btw, why do you want to read the HLog? On Fri, May 17, 2013 at 12:53 PM, Rishabh Agrawal rishabh.agra...@impetus.co.in wrote: Hello, I am working with Hlogs of Hbase and I have this doubt that HDFS shows size of last log file

RE: Doubt Regading HLogs

Thanks Nicolas, When will this file be finalized. Is it time bound? Or it will be always be zero for last one (even if it contains the data) -Original Message- From: Nicolas Liochon [mailto:nkey...@gmail.com] Sent: Friday, May 17, 2013 4:39 PM To: user Subject: Re: Doubt Regading HLogs

Re: Doubt Regading HLogs

Liochon [mailto:nkey...@gmail.com] Sent: Friday, May 17, 2013 4:39 PM To: user Subject: Re: Doubt Regading HLogs That's HDFS. When a file is currently written, the size is not known, as the write is in progress. So the namenode reports a size of zero (more exactly, it does not take into account

Re: Doubt Regading HLogs

? Or it will be always be zero for last one (even if it contains the data) -Original Message- From: Nicolas Liochon [mailto:nkey...@gmail.com] Sent: Friday, May 17, 2013 4:39 PM To: user Subject: Re: Doubt Regading HLogs That's HDFS. When a file is currently written, the size

Re: HBase Key Design : Doubt

Hi, I have 2 column families A and B in table T1. put 'T1', 'R1', 'A:qualf1',100 put 'T1', R1', 'B:qualf2', 200 As per my understanding the above is one row and one single version each for the 2 column families. If I do a put 'T1', 'R1', 'A:qualf1', 500, then there is another version for the

Re: HBase Key Design : Doubt

No, you're right. But if you just want to keep 500 as the value, you just have to set the number of version to 1 for your table... If you just want to keep 100, then you can insert with a revert timestamp, so the last cell inserted will be hidden by the previous one. JM 2012/10/11, Narayanan K

HBase Key Design : Doubt

Hi all, I have a usecase wherein I need to find the unique of some things in HBase across dates. Say, on 1st Oct, A-B-C-D appeared, hence I insert a row with rowkey : A-B-C-D. On 2nd Oct, I get the same value A-B-C-D and I don't want to redundantly store the row again with a new rowkey - A-B-C-D

Re: HBase Key Design : Doubt

correct me if I'm wrong. The version applies to the individual cell (ie. row key, column family and column qualifier) not (row key, column family). On Wed, Oct 10, 2012 at 3:13 PM, Narayanan K knarayana...@gmail.com wrote: Hi all, I have a usecase wherein I need to find the unique of some

Re: HBase Key Design : Doubt

Correct. If you do 2 Puts for row key A-B-C-D on different days, the second Put logically replaces the first and the earlier Put becomes a previous version. Unless you specifically want older versions, you won't get them in either Gets or Scans. Definitely want to read thisŠ

Doubt in performance tuning

Hi, Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds? We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes. Regards, Rams

Re: Doubt in performance tuning

On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian ramasubramanian.naraya...@gmail.com wrote: Hi, Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds? We tried doing this in both pig script and in pentaho.

Re: Doubt in performance tuning

Hi, Will be helpful if u say specific things to look into. Pls help Regards, Rams On 10-Sep-2012, at 10:40 PM, Stack st...@duboce.net wrote: On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian ramasubramanian.naraya...@gmail.com wrote: Hi, Currently it takes 11 odd minutes to load 1.2

Re: Doubt in performance tuning

Well, Lets actually skip a few rounds of questions... and start from the beginning. What does your physical cluster look like? On Sep 10, 2012, at 12:40 PM, Ramasubramanian ramasubramanian.naraya...@gmail.com wrote: Hi, Will be helpful if u say specific things to look into. Pls help

Doubt at hbase configuration

Hi, I was running coprocessor AggregationProtocol, it got socket timeout exception. Somebody said to set hbase.rpc.timeout to larger value. I added the following in hbase.site.xml property namehbase.rpc.timeout/name value300/value /property but it was not working. The

Re: Doubt at hbase configuration

The timeout is on the client side, not the server side. J-D On Fri, Mar 30, 2012 at 12:11 AM, Balaji k balaji.kan...@gmail.com wrote: Hi,          I was running coprocessor AggregationProtocol, it got socket timeout exception. Somebody said to set  hbase.rpc.timeout to larger value. I added

Re: schema doubt

Each file is about 12k to 6k. Inserting wont be an issue just the access. I would like to access them quickly. Not sure what the proper key should be. The file name is ok, but just wondering if there is anything more I can be doing to leverage hbase. On Thu, Sep 15, 2011 at 9:24 AM, Akash

Doubt in backup master ?

org.apache.hadoop.hbase.regionserver.HRegionServer: No master found, will retry 2011-08-09 12:23:26,454 DEBUG org.apache.hadoop.hbase.regionserver.HRegionServer: No master found, will retry . . . --- My doubt is Are the above two commands are same

RE: Doubt in backup master ?

-Original Message- From: shanmuganathan.r [mailto:shanmuganatha...@zohocorp.com] Sent: Tuesday, August 09, 2011 12:47 PM To: user Subject: Doubt in backup master ? Hi Ram, Now I am using the HBase 0.90.3 version. When I am using the following command for the backup master means

Doubt in hbase installation?

Hi All, I have some doubt in the installation of hbase in fully distributed mode. In my configuration the hbase does not manage the zookeeper. I added zoo.cfg in zookeeper configuration file . Also specified some configuration in the hbase-site.xml file. Are the two

RE: Doubt in hbase installation?

: Wednesday, July 27, 2011 2:08 AM To: user@hbase.apache.org Subject: Doubt in hbase installation? Hi All, I have some doubt in the installation of hbase in fully distributed mode. In my configuration the hbase does not manage the zookeeper. I added zoo.cfg in zookeeper configuration