Re: How to designTemporal table in Hbase

2" for > "col1" in date range between "From_Date" and "To_Date"? > > > On 5/31/16, Mohammad Tariq <donta...@gmail.com> wrote: > > Hi Subhash, > > > > What would be your query pattern like? > > > > > > > >

Re: How to designTemporal table in Hbase

Hi Subhash, What would be your query pattern like? [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Tue, May 31, 2016 at 11:48 PM, Subhash Pophale wrote: > Hi All, > > I am new to Hbase database. I am planning to create

Re: Type of filter to use

Hi Rajesh, To begin with I would suggest you to rethink about your key design. If you are getting a lot of data(which I assume you do) then this type of keys could lead you to region hotspotting . Coming back to your original question you could

Re: Rowkey design

Hi Marko, Scan expects complete start and end row keys, IIRC. Order would anyway get disturbed as you are salting your keys. [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Mon, Nov 30, 2015 at 1:19 PM, Marko Dinic wrote: > Hi

Re: Rowkey design

Hi Marko, You could add the place(and unit as well) to your key if that's not making it very long. And then use RowFilter with SubstringComparator to get the desired rows. [image: http://] Tariq, Mohammad about.me/mti [image: http://] On Mon, Nov 30, 2015 at 3:49 AM,

Re: [ANNOUNCE] HBase 0.94.21 is available for download

+1. Thank you HBase team for your continuous efforts and support. [image: http://] Tariq, Mohammad about.me/mti [image: http://] http://about.me/mti On Thu, Jul 3, 2014 at 10:05 PM, lars hofhansl la...@apache.org wrote: The HBase Team is pleased to announce the immediate release of

Re: Invitation to connect on LinkedIn

You need to use JM's address instead of hbase mailing list. *Warm regards,* *Mohammad Tariq* *cloudfront.blogspot.com http://cloudfront.blogspot.com* On Thu, Jun 19, 2014 at 1:22 PM, rakesh rakshit ihavethepotent...@gmail.com wrote: Friend, I guess you are mistaken. I am not Jean-Marc whom

Re: [ANNOUNCE] HBase 0.94.19 is available for download

Great job guys. +1 :) Warm Regards, Tariq cloudfront.blogspot.com On Tue, Apr 29, 2014 at 3:56 AM, lars hofhansl la...@apache.org wrote: The HBase Team is pleased to announce the immediate release of HBase 0.94.19. Download it from your favorite Apache mirror [1]. This release has also

Re: Scan vs map-reduce

Well, it depends. Could you please provide some more details?It will help us in giving a proper answer. Warm Regards, Tariq cloudfront.blogspot.com On Mon, Apr 14, 2014 at 11:38 AM, Li Li fancye...@gmail.com wrote: I have a full table scan which cost about 10 minutes. it seems a bottleneck

Re: HBase read operation document/help...

Just to add on to Ted's comment, ROOT has been dropped. META locations are now directly stored in ZK. See this tickethttps://issues.apache.org/jira/browse/HBASE-3171for more. Warm Regards, Tariq cloudfront.blogspot.com On Wed, Feb 26, 2014 at 12:54 AM, Ted Yu yuzhih...@gmail.com wrote: You

Re: Need Help on hbase error: The znode for the -ROOT- region doesn't exist!

Hello there, Looks like some problem with RS holding the -ROOT-. Please make sure it's up and running. Showing us the logs would be helpful. Warm Regards, Tariq cloudfront.blogspot.com On Sat, Aug 31, 2013 at 5:14 AM, S. Zhou myx...@yahoo.com wrote: I wrote a java program which connects to

Re: how to export data from hbase to mysql?

My 2 cents : 1- Map your table to a Hive table and do the export using Sqoop. 2- Export http://hbase.apache.org/book/ops_mgt.html#export the table to a file first, and then export it using Sqoop. Warm Regards, Tariq cloudfront.blogspot.com On Wed, Aug 28, 2013 at 7:12 PM, Shahab Yunus

Hitting HBASE-7693 with hbase-0.94.9

Hello list, Although the issue https://issues.apache.org/jira/browse/HBASE-7693 has been fixed, it looks like i'm hitting it. *Environment :* hadoop-1.1.2 hbase-0.94.9 OS X 10.8.4 (12E55) I'd really appreciate if somebody could throw some light. Here is the trace I see when I run my MR job

Re: Pagination with HBase

Hello Jonathan, You might have to pay special attention to the OFFSET part though. OFFSET of nth row will not remain n forever. As you insert new rows ordering will get changed as rows are not arranged in the order of insertion in HBase. Warm Regards, Tariq cloudfront.blogspot.com On Thu, Aug

Re: Hitting HBASE-7693 with hbase-0.94.9

to incorrectly match map jobs to data-local map slots. So it seems that the problem you encountered was different. Cheers On Thu, Aug 1, 2013 at 5:18 PM, Mohammad Tariq donta...@gmail.com wrote: Hello list, Although the issue https://issues.apache.org/jira/browse/HBASE-7693 has been

Re: puzzle about hbase row update

Yes, it is for the cell. As Ram sir has specified, there are no updates in HBase per se. You either put a new version or delete the old data and put the new data in the same cell. Along with the link specified by Ram sir, I would suggest you to go through this as well :

Re: how can i improve sequence write speed?

Hello there, I'm sorry I didn't quite get it. What do you mean by sequence write speed? If you are looking for ways to improve HBase writes, you might find this useful : http://hbase.apache.org/book/perf.writing.html Warm Regards, Tariq cloudfront.blogspot.com On Mon, Jul 1, 2013 at

Re: Installing HBase, what jar files from Hadoop need to match?

Hello there, I don't think it is necessary anymore. It was the case for older versions of hadoop and hbase. Both these projects are much more mature now and work perfectly well without any jar transfer from one to another. But if you still face nay problem try copying hadoop-core and

Re: how many severs in a hbase cluster

Hello there, IMHO, 5-8 servers are sufficient enough to start with. But it's all relative to the data you have and the intensity of your reads/writes. You should have different strategies though, based on whether it's 'read' or 'write'. You actually can't define 'big' in absolute terms.

Re: how many severs in a hbase cluster

Oh, you already have heavyweight's input :). Thanks JM. Warm Regards, Tariq cloudfront.blogspot.com On Sat, Jun 22, 2013 at 8:05 PM, Mohammad Tariq donta...@gmail.com wrote: Hello there, IMHO, 5-8 servers are sufficient enough to start with. But it's all relative to the data you

Re: how many severs in a hbase cluster

in hbase when it runs compaction and split in regions. Oh, you already have heavyweight's input :). Thanks JM. Warm Regards, Tariq cloudfront.blogspot.com On Sat, Jun 22, 2013 at 8:05 PM, Mohammad Tariq donta...@gmail.com wrote: Hello there, IMHO, 5-8 servers are sufficient

Re: how many severs in a hbase cluster

will be an issue. You need to have an odd number of ZK servers... Also, if you don't run MR jobs, you don't need the TT and JT... Else, everything below is correct. But there is many other options, all depend on your needs and the hardware you have ;) JM 2013/6/22 Mohammad Tariq

Re: how many severs in a hbase cluster

, or are not the named recipient(s), please immediately notify the sender by return email, and delete all copies of this message. On Sat, Jun 22, 2013 at 10:05 AM, Mohammad Tariq donta...@gmail.com wrote: Yeah, I forgot to mention that no. of ZKs should be odd. Perhaps those parentheses made

Re: Create table with coprocessors from hbase shell

Hello Anil and Michael, As of hbase-0.94.4 it is not possible to create a table with co-proc using create command through shell. Though alter has the option to add a co-proc. hbase alter 't1', METHOD = 'table_att',

Re: Best practices for loading data into hbase

I am sorry to barge in when heavyweights are already involved here. But, just out of curiosity, why don't you use Sqoop http://sqoop.apache.org/ to import the data directly from your existing systems into HBase instead of first taking the dump and then doing the import. Sqoop allows us to do

Re: Not able to connect to Hbase remotly

Hello Vimal, I am sorry for being unresponsive. I have been travelling like crazy since last few days. Proper *name resolution* is a must for smooth HBase interaction. That is why it better to have the IP address along with hostname in your /etc/hosts file. Warm Regards, Tariq

Re: Not able to connect to Hbase remotly

Hello Vimal, Add the IP and hostname of your HBase machine into the hosts file of your client machine and see if it helps. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 4:38 PM, Vimal Jain vkj...@gmail.com wrote: Hi Jyothi, I am running my hbase in pseudo

Re: Unknown process in listing of jps command

Hello VImal, HQuorumPeer=ZK Main=Eclipse or something(i feel) Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 2:01 PM, Vimal Jain vkj...@gmail.com wrote: Hi, I have configured Hadoop and Hbase successfully ( i think so ) . I tried creating some tables and

Re: HBase is not running.

2012 From source with checksum fe2baea87c4c81a2c505767f3f9b71f4 No issues, I'm guessing. Not sure where I'm tripping up. On Fri, May 3, 2013 at 6:52 AM, Mohammad Tariq donta...@gmail.com wrote: Yes..You can do that. I would suggest you to start fresh and setup a single node

Re: PleaseHoldException when Master is clearly running as JPS

to the top seems redundant... right? I did so but still no luck :(. 1) OS? This is fedora 16. 2) any thoughts on why the PleaseHoldException is being triggered ? On Tue, May 21, 2013 at 4:32 PM, Mohammad Tariq donta...@gmail.com wrote: OS?Add 127.0.0.1 localhost and see if it makes any

Re: PleaseHoldException when Master is clearly running as JPS

, Jay Vyas jayunit...@gmail.com wrote: Hi kevin : So you don't have any region servers defined in your /etc/hosts ? On Tue, May 21, 2013 at 4:46 PM, Mohammad Tariq donta...@gmail.com wrote: Sorry, my bad. By that I meant 127.0.0.1hostname..To me it seems like HBase is not able

Re: PleaseHoldException when Master is clearly running as JPS

after sleep of 1002 On Tue, May 21, 2013 at 4:57 PM, Mohammad Tariq donta...@gmail.com wrote: OK..You already have your hostname in there. But it is appearing twice. Comment out 127.0.0.1 hbase-master. This might be a reason. I did not notice that you are on a distributed setup. RS IPs

Re: HBase is not running.

21, 2013 at 4:21 PM, Mohammad Tariq donta...@gmail.com wrote: sure.. Warm Regards, Tariq cloudfront.blogspot.com On Wed, May 22, 2013 at 1:48 AM, Yves S. Garret yoursurrogate...@gmail.comwrote: Hello, No, still having issues. I'll give you some more details

Re: PleaseHoldException when Master is clearly running as JPS

, 2013 at 2:48 AM, Jay Vyas jayunit...@gmail.com wrote: https://gist.github.com/anonymous/5623327 -- all logs for starting up hbase and master On Tue, May 21, 2013 at 5:13 PM, Mohammad Tariq donta...@gmail.com wrote: No prob. I was referring to this : 127.0.0.1 hbase-master

Re: HBase is not running.

starting master, logging to /media/alternative-storage-do-not-touch/hbase-0.94.7/logs/hbase-ysg-master-ysg.connect.out No real problems or error or warnings... but it does not have the same output that you have in your blog... perhaps that's an issue? On Tue, May 21, 2013 at 5:14 PM, Mohammad Tariq

Re: HBase Support

/home/imadas/zookeeperfolder/value /property /configuration Thanks Regards Raju. On Fri, May 10, 2013 at 8:20 PM, Mohammad Tariq donta...@gmail.com wrote: You are welcome Raju, There seems to be some connection related issue. Could you please show me you

Does Hbase read .bashrc file??

Hello list, Does Hbase read the environment variables set in *~/.bashrc*file everytime I issue *bin/start-hbase.sh*??What could be the possible reasons for that?Specially if I have a standalone setup on my local FS. Thank you so much for your time. Warm Regards, Tariq

Re: Does Hbase read .bashrc file??

Khurana ama...@gmail.com wrote: The start script is a shell script and it forks a new shell when the script is executed. That'll source the bashrc file. On May 11, 2013, at 12:39 PM, Mohammad Tariq donta...@gmail.com wrote: Hello list, Does Hbase read the environment variables

Re: Does Hbase read .bashrc file??

, Mohammad Tariq donta...@gmail.com wrote: Hello Aman, Thank you so much for the quick response. But why would that happen? I mean the required env variables are present in hbase-env.sh already. What is the need to source bashrc? Consider a scenario wherein you want to run Hbase

Re: Does Hbase read .bashrc file??

, Mohammad Tariq donta...@gmail.com wrote: Hello Aman, Thank you so much for the quick response. But why would that happen? I mean the required env variables are present in hbase-env.sh already. What is the need to source bashrc? Consider a scenario wherein you want to run Hbase

Re: HBase Support

Hello Raju, This means that there is some problem with the connection between HMaster and ZK. Make sure all your Hbase daemons are running fine. Which version are you using?Also showing complete HMaster and ZK logs would be helpful. Warm Regards, Tariq cloudfront.blogspot.com On Fri, May

Re: HBase Support

. On Fri, May 10, 2013 at 4:14 PM, Mohammad Tariq donta...@gmail.com wrote: Hello Raju, This means that there is some problem with the connection between HMaster and ZK. Make sure all your Hbase daemons are running fine. Which version are you using?Also showing complete HMaster and ZK

Re: HBase Support

...@gmail.com wrote: Thank you Tariq, Have checked Hbase Master Logs(Which i have Provided to you). Did you find any clue to identify what is the Problem. Thanks Regards Raju. On Fri, May 10, 2013 at 7:01 PM, Mohammad Tariq donta...@gmail.com wrote: Hello Raju, ZK logs

Re: HBase Support

Hello Raju, Please find my answers embedded below : 1.what are the causes of Client session timed out.(and client session scenario) There could be several reasons. You network is totally down, you have exceeded the maximum no. of clients allowed at a time, you are facing network

Re: Hbase Guidance.

I don't get the logic behind asking the same question multiple times with different names. Warm Regards, Tariq cloudfront.blogspot.com On Thu, May 9, 2013 at 6:30 PM, naga raju rajumudd...@gmail.com wrote: Hi all, I am New to Hbase(Hadoop), and i am working on hbase with standalone

Re: Export / Import and table splits

Hello JM, You might find these post by Lars useful : http://www.larsgeorge.com/2009/01/changing-hbase-tables-in-code.html http://www.larsgeorge.com/2009/05/hbase-schema-manager.html I'm not sure whether this is exactly what you need, but I feel you could use something like this to achieve

Re: HBase is not running.

Hello Yves, I think by that JM means that you should first make sure that all you Hbase daemons are running fine. The webUI is a pretty convenient tool which allows you to monitor everything in a simpler way. If you are able to see the webUI properly, it means everything is in place and

Re: HBase is not running.

, 2013 at 1:57 AM, Mohammad Tariq donta...@gmail.com wrote: Hello Yves, I think by that JM means that you should first make sure that all you Hbase daemons are running fine. The webUI is a pretty convenient tool which allows you to monitor everything in a simpler way

Re: HBase and Datawarehouse

Sorry for the late response. I totally agree with Anil. If you have warehousing needs, I would also suggest Hive. You could easily map your Hbase tables to your Hive tables and crunch crunch the data. It would save you from writing lengthy and tedious MR jobs. And as Anil has said Pig is another

Re: HBase and Datawarehouse

*Database(SQL, NoSQL, Graph, Document etc etc)* 1. Used for Online Transactional Processing (OLTP) but can be used for other purposes such as Data Warehousing. This records the data from the user for history. 2. The tables and joins are complex since they are normalized (for RDMS).

Re: HBase is not running.

Hello Yves, The log seems to be incomplete. Could you please the complete logs?Have you set the hbase.zookeeper.quorum property properly?Is your Hadoop running fine? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Fri, Apr 26, 2013 at 2:00 AM, Yves S. Garret

Re: HBase is not running.

it, setup the JAVA_HOME and ran bin/start-hbase.sh ? JMS 2013/4/25 Mohammad Tariq donta...@gmail.com: Hello Yves, The log seems to be incomplete. Could you please the complete logs?Have you set the hbase.zookeeper.quorum property properly?Is your Hadoop running fine

Re: regionserver stucking

You could make use of jVisualVM as well. Comes in quite handy. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Wed, Apr 17, 2013 at 2:05 PM, ramkrishna vasudevan ramkrishna.s.vasude...@gmail.com wrote: Just do jstack with pid. Regards Ram On Wed, Apr 17, 2013 at

Re: HBase random read performance

Hello Ankit, How exactly are you trying to fetch the data?Some tips to enhance the reads could be : Use of scan caching. Good rowkey design. Use of block cache. Properly closing HTable and ResultScanner. Use of bloom filters. Use of Filters to limit the search. Proper use of compression. Use

Re: Hbase restart issues

Hello Rishabh, Is your NN able to come out of the safemode by itself? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Apr 1, 2013 at 12:19 PM, Rishabh Agrawal rishabh.agra...@impetus.co.in wrote: Hello Whenever, I stop Hbase and Hadoop gracefully (in

Re: connecting Hbase using java

have you added the required jars?also, it's better to add zookeeper related props in the config file. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Sat, Mar 30, 2013 at 8:19 PM, Ted Yu yuzhih...@gmail.com wrote: What packages were not accessible ? Most people use

Re: Unable to start regionserver in distributed mode

also make sure that you have proper name resolution as it is vital for a healthy Hbase operation. Sometimes even after configuring everything perfectly Hbase refuses to work as intended just because of improper name resolution. Add the actual host name along with their IPs in the /etc/hosts file.

Re: HBase Writes With Large Number of Columns

Hello Pankaj, What is the configuration which you are using?Also, the H/W specs? Maybe tuning some of these would make things faster. Although amount of data being inserted is small, the amount of metadata being generated would be higher. Now, you have to generate the key+qualifier+TS

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

On Wed, Mar 20, 2013 at 2:09 AM, Mohammad Tariq donta...@gmail.com wrote: Yes. Either add 192.168.1.102 localhost here or just change your config properties in the config files to contain debian-vm at all the places. No prob. I am also sleepy. It's already 6:40 am here in India :) Warm

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

Hello Pal, Add 127.0.0.1 along with the hostname of your vm, where you are running your Hbase, into its /etc/hosts file. You are running Hbase in pseudo distributed mode, but the logs show that the connection request is going to some other IP. Warm Regards, Tariq https://mtariq.jux.com/

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

will see it in the zookeeper log) I know it works, because http://debian-vm:60010 comes up from Host os On Wed, Mar 20, 2013 at 1:30 AM, Mohammad Tariq donta...@gmail.com wrote: Hello Pal, Add 127.0.0.1 along with the hostname of your vm, where you are running your Hbase, into its

Re: HBase client hangs after connecting to Zookeeper in pseudo-mode

it references to debian-vm? I will try it tomorrow, because it's getting late here. Pal On Wed, Mar 20, 2013 at 1:56 AM, Mohammad Tariq donta...@gmail.com wrote: I said this as I saw 127.0.0.1 in your configuration file. The master references itself in the ZK. If the master finds itself

Re: Hbase in Pseudo distributed mode getting problems

Hello Sam, Don't remove that line from /etc/hosts file, instead change it to 127.0.0.1 YOUR_HOST_NAME. And restart all the processes. BTW, which link have you followed? It seems you have forgotten to paste it. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On

Re: does hbase master need to be a hadoop datanode as well?

Hello Kaven, It's not all necessary to run HM on server running DN. Actually it's not advisable to do so, as HM has high memory requirements and running other daemons on the same machine may lead you to problems. The basic cluster setup, which people normally use looks somewhat like this :

Re: does hbase master need to be a hadoop datanode as well?

is, if you are running in long GCs, ZK might miss the heartbeats and thinks servers are down. So safer to run same separately if you can. JM 2013/2/22 Mohammad Tariq donta...@gmail.com Hello Kaven, It's not all necessary to run HM on server running DN. Actually it's not advisable

Re: Rowkey design question

distributed but how would I perform then a scan restricted to a special time range? 2013/2/19 Mohammad Tariq donta...@gmail.com javascript:;: No. before the timestamp. All the row keys which are identical go to the same region. This is the default Hbase behavior and is meant to make

Re: HBase unknown table problem

Hello Anand, Are your regionservers running fine? Have a look over the logs and see if you find something unusual there. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Wed, Feb 20, 2013 at 6:41 PM, anand nalya anand.na...@gmail.com wrote: Hi, I've created a

Re: Rowkey design question

Hello Paul, Try this and see if it works : scan.setStartRow(Bytes.toBytes(startDate.getTime() + )); scan.setStopRow(Bytes.toBytes(endDate.getTime() + 1 + )); Also try not to use TS as the rowkey, as it may lead to RS hotspotting. Just add a hash to your rowkeys so that data is

Re: Rowkey design question

: Hey Tariq, thanks for your quick answer. I'm not sure if I got the idea in the seond part of your answer. You mean if I use a timestamp as a rowkey I should append a hash like this: 135727920+MD5HASH and then the data would be distributed more equally? 2013/2/19 Mohammad Tariq donta

Re: Rowkey design question

distributed but how would I perform then a scan restricted to a special time range? 2013/2/19 Mohammad Tariq donta...@gmail.com: No. before the timestamp. All the row keys which are identical go to the same region. This is the default Hbase behavior and is meant to make the performance better

Re: Row Key Design in time based aplication

Hello Mehmet, If ProjectIds are sequential, then it is definitely not a feasible approach. Division is just to make sure that all the regions are evenly loaded. You can create pre-splitted tables to avoid the region hotspotting. Alternatively hash your rowkeys so that all the regionservers

Re: MapReduce to load data in HBase

Good point sir. If Pig fits into Panshul's requirements then it's a much better option. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, Feb 7, 2013 at 5:25 PM, Damien Hardy dha...@viadeoteam.com wrote: Hello, Why not using a PIG script for that ? make the json

Re: searching functionality in Hbase

Hello Dastagiri, Search is actually Get or Scan+some condition. You have Hbase Filters and Co-proc. You can use indexing for faster results(search). Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, Feb 7, 2013 at 5:43 PM, Dastagiri S Shaik

Re: MapReduce to load data in HBase

. One Json per line. I need to process this file and store all values into HBase. Thanking You, On Thu, Feb 7, 2013 at 12:59 PM, Mohammad Tariq donta...@gmail.com wrote: Good point sir. If Pig fits into Panshul's requirements then it's a much better option. Warm Regards, Tariq

Re: cluster monitoring

Hello Rita, Monitoring at what level?Do you want to print the roewkeys while you are processing or is it something else? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Tue, Feb 5, 2013 at 6:57 PM, Rita rmorgan...@gmail.com wrote: hi, is it possible to see

Re: Hbase Read/Write throughput measure

that I am using cloudera manager. The other yahoo link I couldn't understand how to use it. So any help please?? Sent from my iPad On Feb 1, 2013, at 2:32 PM, Mohammad Tariq donta...@gmail.com wrote: Hello Dalia, I think the easiest way

Re: Hbase Read/Write throughput measure

there is no clue, note that I am using cloudera manager. The other yahoo link I couldn't understand how to use it. So any help please?? Sent from my iPad On Feb 1, 2013, at 2:32 PM, Mohammad Tariq donta...@gmail.com wrote: Hello

Re: Hbase Read/Write throughput measure

, note that I am using cloudera manager. The other yahoo link I couldn't understand how to use it. So any help please?? Sent from my iPad On Feb 1, 2013, at 2:32 PM, Mohammad Tariq donta...@gmail.com wrote: Hello Dalia, I think the easiest way to measure

Re: Hbase Read/Write throughput measure

/hbase-binding/conf directory. HTH Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 12:17 AM, Mohammad Tariq donta...@gmail.com wrote: Hello Dalia, Me and Anil are talking about this : 1 - git clone http://github.com/brianfrankcooper

Re: Hbase Read/Write throughput measure

using cloudera manager. The other yahoo link I couldn't understand how to use it. So any help please?? Sent from my iPad On Feb 1, 2013, at 2:32 PM, Mohammad Tariq donta...@gmail.com wrote: Hello Dalia, I think the easiest way

Re: Start key and End key in HBase

It signifies start and end of the table regions, it is used in doing range queries. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 10:11 AM, raviprasa...@polarisft.com wrote: Hi all, Can anyone let me know what is the use of Start key and End

Re: Start key and End key in HBase

Just to add to whatever Anoop sir has said, the row corresponding to the endkey is not included in the result set by default. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Feb 4, 2013 at 12:38 PM, Anoop Sam John anoo...@huawei.com wrote: When you do a scan with

Re: Hbase Read/Write throughput measure

Hello Dalia, I think the easiest way to measure the read/write throughput is to use PerformanceEvaluation tool that comes with the Hbase distribution. It spawns a map-reduce job to do the reads/writes in parallel. Apart from this there are several other ways to benchmark your Hbase

Re: Parallel scan in HBase

Hello Farrokh, Scans work sequentially with one region after the other. Scans from client side do not go to regionservers in parallel. And, for the second question, the code will run at the client side. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Fri, Feb 1, 2013

Re: Parallel scan in HBase

Do you need to scan each n every row within that range?Or you need specific rows based on some filter? Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Fri, Feb 1, 2013 at 9:16 PM, lars hofhansl la...@apache.org wrote: The scan contract in HBase is that all rows are

Re: Pagination with HBase - getting previous page of data

I'm kinda hesitant to put my leg in between the pros ;)But, does it sound sane to use PageFilter for both rows and columns and having some additional logic to handle the 'nth' page logic?It'll help us in both kind of paging. On Wednesday, January 30, 2013, Jean-Marc Spaggiari

Re: New htable slow

Hi there, Do you have too many Htable instances opened simultaneously?It's not advisable to do so. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Jan 28, 2013 at 5:00 PM, Lsshiu lss...@gmail.com wrote: Hi In my 0.90.6 hbase environment , each time when I

Indexing Hbase Data

Hello list, I would like to have some suggestions on Hbase data indexing. What would you prefer? I never faced such requirement till now. This is the first time when there is a need of indexing, so thought of getting some expert comments and suggestions. Thank you so much for your

Re: Indexing Hbase Data

. -Viral On Mon, Jan 28, 2013 at 3:45 AM, Mohammad Tariq donta...@gmail.com wrote: Hello list, I would like to have some suggestions on Hbase data indexing. What would you prefer? I never faced such requirement till now. This is the first time when there is a need of indexing, so

Re: New htable slow

Use HTbalePool instead and see if it gives you better performance. Creating an HTable instance is a fairly expensive operation that takes a few seconds to complete. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Jan 28, 2013 at 5:35 PM, Lsshiu lss...@gmail.com

Re: Indexing Hbase Data

the main table row key. First this should help, later can make this more better by using coprocessors. Regards Ram On Mon, Jan 28, 2013 at 5:25 PM, Mohammad Tariq donta...@gmail.com wrote: Hello Viral, Thank you so much for the quick response. Intention is to index the values. I'll

Re: New htable slow

It does. These excerpts from Hbase Definitive Guide might help you in a better fashion : HTablePool: Instead of creating an HTable instance for every request from your client application, it makes much more sense to create one initially and subsequently reuse them. The primary reason for doing so

Re: Indexing Hbase Data

that. What do you mean with faster resuls? To build the index? Or to read through it? JM 2013/1/28, Mohammad Tariq donta...@gmail.com: Thank you for the valuable reply sir. Actually I tried that and it works fine. But we need faster results. I was thinking of creating an index and have it loaded

Re: drop table problem

Which version are you using?Try hbck and see if you find anything interesting. This problem was faced by a couple of folks few weeks ago. Try to search through the mailing list. Probably there is some problem with the znode holding this table. Remove it and restart everything. Warm Regards, Tariq

Re: tabel in 'transition' state which cannot be dropped

looks to me a copy of your other email, with a different heading. anyways, do as Ram sir has said. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, Jan 24, 2013 at 3:54 PM, ramkrishna vasudevan ramkrishna.s.vasude...@gmail.com wrote: Oops, which version is of

Re: paging results filter

I think you need PageFilterhttp://hbase.apache.org/apidocs/org/apache/hadoop/hbase/filter/PageFilter.html . HTH Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Thu, Jan 24, 2013 at 6:20 PM, Toby Lazar tla...@gmail.com wrote: Hi, I need to create a client function

Re: Pagination with HBase - getting previous page of data

Hello sir, While paging through, store the startkey of the current page of 25 rows in a separate byte[]. Now, if you want to come back to this page when you are at the next page do a range query where startkey would be the rowkey you had stored earlier and the endkey would be the

Re: paging results filter

(only results 41-60), I don't see how PageFilter can be configued for that. Am I missing the obvious? Thanks, Toby On Thu, Jan 24, 2013 at 7:52 AM, Mohammad Tariq donta...@gmail.com wrote: I think you need PageFilter http://hbase.apache.org/apidocs/org/apache/hadoop

Re: Hbase Mapreduce- Problem in using arrayList of pust in MapFunction

Give put(ListPut puts) a shot and see if it works for you. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Mon, Jan 21, 2013 at 11:41 AM, Farrokh Shahriari mohandes.zebeleh...@gmail.com wrote: Hi there Is there any way to use arrayList of Puts in map function to

Re: Loading data, hbase slower than Hive?

. Regards, Austin On Sun, Jan 20, 2013 at 2:42 AM, Mohammad Tariq donta...@gmail.com wrote: Hello Austin, I am sorry for the late response. Asaf has made a very valid point. Rowkwey design is very crucial. Specially if the data is gonna be sequential(timeseries kinda

  1   2   3   >