Re: HBase cluster design

The hardware specs are: 4 nodes with 48g RAM, 24 cores and 1 TB disk each server Attached my hbase config files. Thanks, Flavio On Fri, May 23, 2014 at 3:33 AM, Dhaval Shah wrote: > Can you share your hbase-env.sh and hbase-site.xml? And hardware specs of > your cluster? > > > > > Regards, > Dha

[ANNOUNCE] Apache Phoenix has graduated as a top level project

Wow! Congratulations!! - hbell 2014年5月23日金曜日、Job Thomas >さんは書きました: > > Congratulations. > > > > > From: James Taylor [mailto:jamestay...@apache.org] > Sent: Fri 5/23/2014 3:16 AM > To: HBase Dev; HBase User > Subject: [ANNOUNCE] Apache Phoenix has graduated a

Re: Re: CDH5 hbase client outofmemory

This can be considered as a bug. We're not going to survive long if there is an OOM, so retrying is not very useful... You can create a jira for this (https://issues.apache.org/jira/browse/HBASE), and submit a patch if possible.. For the root cause, if you don't have much memory, you can lower th

Re: Re: CDH5 hbase client outofmemory

>>I found the doPut operation is the async, and when one row success, this will return. >>So, I guess when the HBase server is slower to response the put request. >>The hbase client will accumulate so many rows. That also sounds like a bug. Can add this also in the bug u r going to raise. -Anoo

Re: 答复: what in regionserver's Used Heap

You can use jmap with -histo option to find out heap consumption: http://docs.oracle.com/javase/7/docs/technotes/tools/share/jmap.html Please pastebin jmap output. Cheers On Thu, May 22, 2014 at 11:30 PM, sunweiwei wrote: > Hi Ted > > I have checked regionsever:60030/rs-status#regionMemstoreSt

Re: [ANNOUNCE] Apache Phoenix has graduated as a top level project

Cool! Congrats! On Fri, May 23, 2014 at 12:18 AM, JungHo Lee wrote: > Wow! Congratulations!! > > - > hbell > > 2014年5月23日金曜日、Job > Thomas j...@suntecgroup.com');> > >さんは書きました: > > > > > Congratulations. > > > > > > > > > > From: James Taylor [mailto:jamestay

Re: [ANNOUNCE] Apache Phoenix has graduated as a top level project

Congratulations ;) On 05/23/2014 04:41 PM, Jimmy Xiang wrote: Cool! Congrats! On Fri, May 23, 2014 at 12:18 AM, JungHo Lee wrote: Wow! Congratulations!! - hbell 2014年5月23日金曜日、Job Thomas さんは書きました: Congratulations. From: James Taylor [mailto:jamestay

Re: [ANNOUNCE] Apache Phoenix has graduated as a top level project

Congratulations! Phoenix has been attracting a lot of userst. Good job, guys! Demai On Thu, May 22, 2014 at 2:47 PM, Jean-Marc Spaggiari < jean-m...@spaggiari.org> wrote: > Oh, nice!!! > > Congratulations to all the Phoenix team!!! > > JM > Le 2014-05-22 17:46, "James Taylor" a écrit : > > >

Top 10 records from 10 Billion ROWS of HBase Table.

We have Hbase Table which have 10 Billion of Rows data.I have to find TOP 10 records based on Column value which is an Integer. Is there efficient way to find TOP 10 values from 10 Billion of rows based on Column Values ? Thanks in Advance! -- View this message in context: http://apache-hbas

Re: Top 10 records from 10 Billion ROWS of HBase Table.

Have you looked at Apache Phoenix ? Alternatively, you can enhance AggregationClient to add top N facility. Cheers On Fri, May 23, 2014 at 9:54 AM, Syed wrote: > We have Hbase Table which have 10 Billion of Rows data.I have to find TOP > 10 > records based on Column value which is an Integer.

Re: Top 10 records from 10 Billion ROWS of HBase Table.

Sorry, I haven't tried..I am new to Hbase and Hadoop Cluster. If any code example/links to demonstrate will help more to understand. Thanks for your Response! On Fri, May 23, 2014 at 8:15 PM, Ted Yu-3 [via Apache HBase] < ml-node+s679495n4059623...@n3.nabble.com> wrote: > Have you looked at Ap

Re: Top 10 records from 10 Billion ROWS of HBase Table.

Phoenix has recently become top level project. For the time being, you can start with: http://phoenix.incubator.apache.org/ Cheers On Fri, May 23, 2014 at 10:32 AM, Syed wrote: > Sorry, I haven't tried..I am new to Hbase and Hadoop Cluster. If any code > example/links to demonstrate will hel

What jars dependent for java invoking HBase0.98？

Dear， I write a MR based on HBase0.98.Finally I want to with the following command execution：hadoop jar my.jar.But I don't know what need the jar dependencies? look for the "Ref Guide (single-page)"prompt message： commons-configuration (commons-configuration-1.6.jar) commons-lang (commons-lang-2.

Re: [ANNOUNCE] Apache Phoenix has graduated as a top level project

Wow, congratulations to James and to all Phoenix project. Good work guys !!! -- Marcos Ortiz[1] (@marcosluis2186[2]) http://about.me/marcosortiz[3] On Friday, May 23, 2014 09:33:57 AM Demai Ni wrote: > Congratulations! Phoenix has been attracting a lot of userst. Good job, > guys! > > Demai >

Re: What jars dependent for java invoking HBase0.98？

Take a look at http://hbase.apache.org/book.html#mapreduce There're sample commands just above section 7.1 Cheers On Fri, May 23, 2014 at 12:56 AM, wrote: > Dear， > > I write a MR based on HBase0.98.Finally I want to with the following > command execution：hadoop jar my.jar.But I don't know wh

HBase exception: Failed after retry of OutOfOrderScannerNextException

I saw the following exceptions happened frequently: any hints? Failed to scan rows on table : start=04, end=05, Failed after retry of OutOfOrderScannerNextException: was there a rpc timeout?  org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:391)

What is the best database to handle large volume of data

Hi, Request your advice and suggestions on deciding what database can we consider other than oracle to store huge volume of transactional data. It is expected to get around 100 millions of data in a day and we need to keep this in the database for any updates not less than 3 months. There is a

Re: What is the best database to handle large volume of data

Hi, Just to add: there will be heavy writes and updates. Regards, Rams > On 24-May-2014, at 1:37 am, Ramasubramanian > wrote: > > Hi, > > Request your advice and suggestions on deciding what database can we consider > other than oracle to store huge volume of transactional data. It is exp

Re: What is the best database to handle large volume of data

Hi, your question is very general and hard to answer regarding the lack of essential information. However, based on my assumption on what you are trying to do I would recommend cassandra and materialized views for your portal (if the questions are pre-computable) and indices (if the questions are

Copy some records from Huge hbase table to another table

Hi, We have one huge HBase table with billions of rows. This table holds the information about websites and number of hits on that site in every 15 minutes. Every website will have multiple records in data with different number of hit count and last updated timestamp. Now, we want to create anot

Re: What is the best database to handle large volume of data

Just to counter...Oracle can handle that type of load. My company has an extremely large DW in Oracle RDBMS, we add close to 100 million records as day and have three years worth of history. The hardware it runs on isn't as impressive as you might think and all works very well. The key in having

Re: Call for Lightning Talks, Hadoop Summit HBase BoF

Hi Nick. Are you planning to post the agenda on the meetup page? Please let me know if you need any help! Cos On Wed, May 14, 2014 at 05:38PM, Nick Dimiduk wrote: > Just to be clear, this is not a call for vendor pitches. This is a venue > for HBase users, operators, and developers to intermingl

Re: Any lessons from hbase deployments on on-premise products ?

Hi, Our SPM product (monitors HBase, Hadoop and a bunch of other stuff) comes in On Premise version in addition to the Cloud one, and it uses HBase to store all the performance metrics. I can tell you that the bulk of the Installation Guide is really about HBase (and t

Re: Copy some records from Huge hbase table to another table

Would the new HBase table reside in the same cluster as the original table ? See this recent thread: http://search-hadoop.com/m/DHED4uBNqJ1 Cheers On Fri, May 23, 2014 at 2:49 PM, Shaikh Ahmed wrote: > Hi, > > We have one huge HBase table with billions of rows. This table holds the > informat

Re: Copy some records from Huge hbase table to another table

Hi Riyaz, You can do this with a single SQL command using Apache Phoenix, a SQL engine on top of HBase, and you'll get better performance than if you hand coded it using the HBase client APIs. Depending on your current schema, you may be able to run this command with no change to your data. Let's a

[VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

The 1st HBase 0.98.3 release candidate (RC0) is available for download at http://people.apache.org/~apurtell/0.98.3RC0/ and Maven artifacts are also available in the temporary repository https://repository.apache.org/content/repositories/orgapachehba

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

Did you build this yourself? Apache jenkins seems to take a holiday. -- Lars From: Andrew Purtell To: "d...@hbase.apache.org" Cc: "user@hbase.apache.org" Sent: Friday, May 23, 2014 8:55 PM Subject: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is ava

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

As with all the other 0.98 releases, built on a dev box. > On May 23, 2014, at 9:06 PM, lars hofhansl wrote: > > Did you build this yourself? > Apache jenkins seems to take a holiday. > > -- Lars > > > > > From: Andrew Purtell > To: "d...@hbase.apache.org"

Re: [VOTE] The 1st HBase 0.98.3 release candidate (RC0) is available, vote closing 5/31/2014

+1 - grabbed the hadoop-1-bin tarball, checked checksums - unpacked, checked documentation and contents - started in local mode, checked UI pages - created some tables, wrote some data - flushed, compacted, scanned All good. Might do some more extensive tests later. -- Lars - Original Me