Re: Rebuild HBASE Table to reduce Regions per RS

2014-01-14 Thread Doug Meil
Normally when people are doing merges they are scripting it (I.E., not typing out or copying/pasting each region name), but if a table is that far gone the least problematic way is to re-create assuming you have the capacity (i.e., not just storage, but nodes to support all the extra hbase regions

[jira] [Created] (HBASE-8739) [refGuide] corrected map-task "spitting"

2013-06-12 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8739: Summary: [refGuide] corrected map-task "spitting" Key: HBASE-8739 URL: https://issues.apache.org/jira/browse/HBASE-8739 Project: HBase Issue

[jira] [Created] (HBASE-8738) [refGuide] Overhauled HBase metrics section

2013-06-12 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8738: Summary: [refGuide] Overhauled HBase metrics section Key: HBASE-8738 URL: https://issues.apache.org/jira/browse/HBASE-8738 Project: HBase Issue Type: Improvement

Re: Reads are very slow

2013-05-21 Thread Doug Meil
Hi there, One thing to point out is that GZ compression is the tightest but slowest compression algorithm. If speed is important, probably want to look at Snappy for your CF compression algorithm. From: Vibhav Mundra mailto:mun...@gmail.com>> Reply-To: "dev@hbase.apache.org

[jira] [Resolved] (HBASE-8571) CopyTable and RowCounter don't seem to use setCaching setting

2013-05-17 Thread Doug Meil (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Meil resolved HBASE-8571. -- Resolution: Won't Fix Closing this as "won't fix" but I will say that it's j

[jira] [Created] (HBASE-8571) CopyTable and RowCounter don't seem to use setCaching setting

2013-05-17 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8571: Summary: CopyTable and RowCounter don't seem to use setCaching setting Key: HBASE-8571 URL: https://issues.apache.org/jira/browse/HBASE-8571 Project: HBase

Re: Eclipse + src/main/XML + Patch = Not working

2013-04-19 Thread Doug Meil
Ahhh... Stack moved them back from assembly to src/main/docbkx on April 7th. I'm not crazy, they *we're* actually moving around. :-) On 4/19/13 11:45 AM, "Doug Meil" wrote: > >Speaking of that, I did a few patches a few weeks ago and the refguide >files wer

Re: Eclipse + src/main/XML + Patch = Not working

2013-04-19 Thread Doug Meil
Speaking of that, I did a few patches a few weeks ago and the refguide files were under "hbase-assembly", but I don't see them there anymore. What happened? On 4/19/13 9:10 AM, "Jean-Marc Spaggiari" wrote: >Hi, > >It's most probably not related to HBase but maybe someone faced that >alread

Re: HBase table truncate

2013-04-10 Thread Doug Meil
M, "Matteo Bertozzi" wrote: >On Wed, Apr 10, 2013 at 6:27 PM, Doug Meil >wrote: > >> >> re: "truncate is supposed to be more like a "delete_all"," >> >> In an RDBMS an "truncate" doesn't do "delete all", it actuall

Re: HBase table truncate

2013-04-10 Thread Doug Meil
re: "truncate is supposed to be more like a "delete_all"," In an RDBMS an "truncate" doesn't do "delete all", it actually whacks the underlying files to clear the table (or a particular partition, if you happen to have an RDBMS that supports partitioning). I think that HBase's implementation of

[jira] [Created] (HBASE-8257) [refGuide] adding object design section in Schema Design

2013-04-03 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8257: Summary: [refGuide] adding object design section in Schema Design Key: HBASE-8257 URL: https://issues.apache.org/jira/browse/HBASE-8257 Project: HBase Issue Type

[jira] [Created] (HBASE-8244) [refGuide] Moving existing List Data use case to Schema Design Case Studies section

2013-04-02 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8244: Summary: [refGuide] Moving existing List Data use case to Schema Design Case Studies section Key: HBASE-8244 URL: https://issues.apache.org/jira/browse/HBASE-8244 Project

[jira] [Created] (HBASE-8243) [refGuide] Adding Schema Design case studies

2013-04-02 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8243: Summary: [refGuide] Adding Schema Design case studies Key: HBASE-8243 URL: https://issues.apache.org/jira/browse/HBASE-8243 Project: HBase Issue Type: New Feature

Re: HBase Types: Explicit Null Support

2013-04-01 Thread Doug Meil
HmmmŠ good question. I think that fixed width support is important for a great many rowkey constructs cases, so I'd rather see something like losing MIN_VALUE and keeping fixed width. On 4/1/13 2:00 PM, "Nick Dimiduk" wrote: >Heya, > >Thinking about data types and serialization. I think nul

[jira] [Created] (HBASE-8183) [refGuide] fixed typo in performance.xml

2013-03-22 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8183: Summary: [refGuide] fixed typo in performance.xml Key: HBASE-8183 URL: https://issues.apache.org/jira/browse/HBASE-8183 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-8182) [refGuide] updating book.xml to set good example for using byte-array constants

2013-03-22 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8182: Summary: [refGuide] updating book.xml to set good example for using byte-array constants Key: HBASE-8182 URL: https://issues.apache.org/jira/browse/HBASE-8182 Project: HBase

[jira] [Created] (HBASE-8180) [refGuide] Addition to performance.xml - use byte-array constants for CF, Cols

2013-03-22 Thread Doug Meil (JIRA)
Doug Meil created HBASE-8180: Summary: [refGuide] Addition to performance.xml - use byte-array constants for CF, Cols Key: HBASE-8180 URL: https://issues.apache.org/jira/browse/HBASE-8180 Project: HBase

Re: Notes from HBase Types/Serialization Discussion

2013-03-07 Thread Doug Meil
Thanks! On 3/7/13 5:16 PM, "Stack" wrote: >(I'm sending this for Doug Meil; he is having difficulty getting this up >on >the dev list) > > >Hi Devs- > >Notes from an HBase client conference call a few of us had yesterday. > Attendees: Enis, Nick D.,

Constructing rowkeys and HBASE-7221

2013-01-07 Thread Doug Meil
(); Assert.assertEquals("key length", schema.getRowKeyLength(), bytes.length); Assert.assertEquals("e1", rowkey.getInt(1), intVal); Assert.assertEquals("e2", rowkey.getLong(2), longVal); } Doug Meil Chief Software Architect, Explorys doug.m...@explorys.com

Re: HBase - Secondary Index

2012-12-05 Thread Doug Meil
re: "It seems everybody wants secondary indexes in HBase. The problem is that most folks don't agree what that actually means." Agreed. And often times when people say "secondary indexing" they may be talking about an access path on something that isn't represented in the key. So you'd not jus

Re: HBase map reduce exaple

2012-11-19 Thread Doug Meil
Hi there, you need to read about custom map reduce keys... http://developer.yahoo.com/hadoop/tutorial/module5.html#types On 11/19/12 3:17 AM, "marcin.kasinski" wrote: >hadoop 1.0.4 >hbase 0.94.2 > >Hello. > >I'm new to hbase so please try to forgive me if my question is totally >stupid. >

Re: Please welcome Mr. Jesse Yates as our newest committer

2012-11-12 Thread Doug Meil
Congrats! On 11/12/12 12:46 AM, "Stack" wrote: >On Sat, Nov 10, 2012 at 10:35 PM, lars hofhansl >wrote: >> The PMC voted for Jesse Yates as the newest HBase committer. >> >> Jesse hardly needs any introductions. He has been working on HBase for >>while and restarted the work on HBase snaps

Re: Set scanner caching to a better default?

2012-10-17 Thread Doug Meil
100 is a good idea. It's one of the most common questions on the dist-list (e.g., hey my MR job is slow? answer: set caching to something more than 1). On 10/17/12 1:12 AM, "Stack" wrote: >On Tue, Oct 16, 2012 at 8:25 PM, lars hofhansl >wrote: >> We just ran into this again today, where

Re: Shared HDFS for HBase and MapReduce

2012-06-06 Thread Doug Meil
Regarding locality, it's not just Lars' stuff, it's in the RefGuide (see section 9.7.3)Š http://hbase.apache.org/book.html#regions.arch re: "You will still be reading/writing over the network" This is definitely true as far as writes go because of the replicas (see the RefGuide for why), altho

Re: how do we start contributing to the project

2012-06-04 Thread Doug Meil
Hi there- Also, see this regarding getting started with HBase. http://hbase.apache.org/book.html#developer This chapter also has the guidelines on submitting patches, etc. On 6/3/12 7:06 PM, "Jonathan Hsieh" wrote: >Hey Gourav, > >Checkout this web page. >http://wiki.apache.org/hadoop/Hba

Re: Please welcome our newest committer and PMC member, Liyin Tang

2012-05-17 Thread Doug Meil
Welcome! On 5/17/12 12:04 AM, "Stack" wrote: >One of us Liyin! > >Keep up the great work. > >Add yourself to the pom.xml team section (Don't break the build!). > >St.Ack >

Re: local bulk loading?

2012-04-27 Thread Doug Meil
>> >> When I hit this problem, I concluded that HFileOutputFormat cannot be >>used >> in standalone mode since it requires DistributedCache, which doesn't >>work >> with the local job runner. >> >> So you're not the only one :( >> &

local bulk loading?

2012-04-26 Thread Doug Meil
s in the troubleshooting chapter.. http://hbase.apache.org/book.html#trouble.mapreduce … but it came up in a different context. In the context that the guy was asking the question he thought he was remote, but he was really local. Doug Meil Chief Software Architect, Explorys doug.m...@explorys.com

Re: HBASE Code format

2012-03-23 Thread Doug Meil
I'll update for 100. On 3/22/12 3:10 PM, "Stack" wrote: >On Wed, Mar 21, 2012 at 10:17 PM, Laxman wrote: >> Note: We don't need to reformat entire codebase. My proposal is to apply >> these standards to new code getting commited. >> > >I have no strong opinion other than if we are going to

Re: Max xceiver config

2012-03-22 Thread Doug Meil
Will do. On 3/22/12 9:31 AM, "Ramkrishna.S.Vasudevan" wrote: >Your article is too good. > >I think Doug can add a link to this document and also update in the book >as >how to configure the >Max xceiver config. > >Regards >Ram > >> -Original Message- >> From: Lars George [mailto:lar

Re: HBASE Code format

2012-03-22 Thread Doug Meil
+1. Assuming that this passes, I'll update the RefGuide in the Development chapter. On 3/22/12 2:08 AM, "Anoop Sam John" wrote: >+1 for 100 chars > >From: Li Pi [l...@idle.li] >Sent: Thursday, March 22, 2012 10:55 AM >To: dev@hbase.apache.org; V v la

Re: Bulkload documentation

2012-03-13 Thread Doug Meil
re: "Currently, bulkload documentation is directly provided in HBase home page." I agree that it should be in the book, I'm actually working on that now and expanding it. re: "I think bulkload (importtsv) can be added as a separate section or under" I agree. I will add that. On 3/13/12 5

Re: need a little help with a patch submission

2012-03-12 Thread Doug Meil
I'll update the book with that... On 3/12/12 3:45 PM, "Harsh J" wrote: >Hi, > >Use {{git diff --no-prefix}} when generating your patches, as the QA >bot assumes its an SVN patch and thats how you can make it compatible. > >But please file a JIRA to add such a note to the book where it >recomm

Re: book -> 'ref guide' rename...

2012-02-23 Thread Doug Meil
It's official.. it is now The Reference Guide. On 2/23/12 2:47 PM, "Doug Meil" wrote: > >Hi folks- > >Regarding the rename, the deployment of the book rename will happen by end >of day. > >https://issues.apache.org/jira/browse/HBASE-5465 > >Th

book -> 'ref guide' rename...

2012-02-23 Thread Doug Meil
AM, "Stack" wrote: >On Wed, Feb 22, 2012 at 9:14 PM, lars hofhansl >wrote: >> Either way we need to update the book I think. >> > >Its not 'the book'. Its the 'reference guide'. One if published by >O'Reilly. The latter by our man

Re: Is there a API to get all the columns of a column family

2012-02-14 Thread Doug Meil
There are lots of examples of MapReduce using HBase here... http://hbase.apache.org/book.html#mapreduce On 2/14/12 3:30 AM, "hongqizh" wrote: >>Why not? It stops at a particular region? Can you figure which one. >>Is it not deployed anywhere? Grep its name in master logs to see if >>yo

Re: Is there a API to get all the columns of a column family

2012-02-13 Thread Doug Meil
I'll add this to the book. This comes up from time to time. On 2/13/12 11:04 AM, "Stack" wrote: >On Mon, Feb 13, 2012 at 1:25 AM, hongqizh wrote: >> Hello, >> >> I want to retrieve the structure of a table, and now I know how to get >>the >> column families of a table, >>HTable->HTableDes

Re: How/when is the API Doc on hbase.apache.org generated

2012-02-11 Thread Doug Meil
I've been updating the book/RefGuide and the website, but Stack has been updating the Javadoc. On 2/11/12 5:56 PM, "lars hofhansl" wrote: >With HBASE-5304 and HBASE-5368 I made some classes public that were >formerly package private. >As of today I do not see them in the Javadoc on hbase.ap

Re: hbase unit test issue....

2012-02-03 Thread Doug Meil
range, because you'd expect that to only be relevant to setting up the IDE, not the unit-test runtime environment. On 2/2/12 5:01 PM, "Doug Meil" wrote: > >Even with 'mvn test', many tests run just fine > >--

Re: hbase unit test issue...

2012-02-02 Thread Doug Meil
org.junit.rules.TestWatcher cannot be resolved to a type Hmm On 2/2/12 4:50 PM, "Doug Meil" wrote: > >Yep, I was on trunk. > > > > > >On 2/2/12 4:45 PM, "Ted Yu" wrote: > >>I tried with your command and I got: &

Re: hbase unit test issue...

2012-02-02 Thread Doug Meil
stem/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home >Default locale: en_US, platform encoding: MacRoman >OS name: "mac os x", version: "10.6.8", arch: "x86_64", family: "mac" > >On Thu, Feb 2, 2012 at 1:32 PM, Doug Meil >wrote: > >

hbase unit test issue...

2012-02-02 Thread Doug Meil
er: I didn't update the book with these new instructions) Thanks! Doug Meil Chief Software Architect, Explorys doug.m...@explorys.com

Re: HBase coprocessors blog posted

2012-02-01 Thread Doug Meil
I'll make sure the book links to this. On 2/1/12 3:26 AM, "Mingjie Lai" wrote: >Hi hbasers. > >A hbase blog regarding coprocessors has been posted to apache blog site. >Here is the link: > >https://blogs.apache.org/hbase/entry/coprocessor_introduction > >Your comments are welcome. > >Thanks,

Re: metric questions

2012-01-30 Thread Doug Meil
, flushTime_avg_time, flushTime_num_ops) would be better off being treated as "flush_avg_time", "flush_num_ops", and "flushSize_avg". I updated the metrics where I could in another ticket. On 11/22/11 6:37 PM, "Doug Meil" wrote: > >Thanks Mikael for the review. I&

Re: Please welcome Mikhail as our newest committer!

2012-01-25 Thread Doug Meil
Congrats! On 1/25/12 1:12 PM, "Stack" wrote: >The man has been moving mountains w/ a good while now. About time we >made him a committer. Welcome Mikhail! >St.Ack >

Re: HBASE-5073 impact...

2012-01-17 Thread Doug Meil
these listeners are executed, slowing down the client >eventually, in addition the listeners are prevented from being garbage >collected creating a memory leak. > > >So it's client only, the RSs are not affected by this. > > >- Original Message - >From: Doug Meil

Re: HBASE-5073 impact...

2012-01-17 Thread Doug Meil
Hi folks, I just want to follow-up on this one more time. Is there anything funky happening in the client that "slows things down" when these methods are called, or is it a reflection of RS activity? On 1/11/12 4:37 PM, "Doug Meil" wrote: > >Hi dev-list, > &g

Re: Major Compaction Concerns

2012-01-16 Thread Doug Meil
re: "A suggestion is perhaps to take all those example/explanation and add them to the book for future reference." Absolutely! I've been watching this thread with great interest. On 1/14/12 4:30 PM, "Mikael Sitruk" wrote: >Wow, thank you very much for all those precious explanations, poi

Re: rowlock advice for book

2012-01-12 Thread Doug Meil
, 2012 2:36 PM >> Subject: Re: rowlock advice for book >> >> Row locks aren't deprecated officially but it's really that type of >> feature that you should use at your own risk / you might not enjoy >> life after that. >> >> J-D >> >&

HBASE-5073 impact...

2012-01-11 Thread Doug Meil
Hi dev-list, With respect to HBASE-5073 and invoking the admin API and producing slowdowns, was the workaround (without the patch) that the client be restarted, or the entire cluster? I see the patch has been back-ported to 90.6 but I wanted to doc this if it was warranted. Also, regarding...

rowlock advice for book

2012-01-11 Thread Doug Meil
Hey dev-list, regarding this... re: "Be careful using hbase row locks. They are (unofficially -- we need to make it official) deprecated." ... is this the official advice? Should I update the book with this? On 1/3/12 4:37 PM, "Stack" wrote: >On Tue, Jan 3, 2012 at 12:38 PM, Joe Stei

Re: Changing our logo purple to International Orange (Engineering)

2012-01-11 Thread Doug Meil
"Effete"? I thought purple was supposed to be the color of kings. I could live with International Orange. That's cool too. On 1/11/12 11:42 AM, "Stack" wrote: >I attached to https://issues.apache.org/jira/browse/HBASE-5115 what it >looks like. International Orange (Engineering) is the c

Re: Please welcome Jon Hsieh as an HBase committer

2012-01-09 Thread Doug Meil
Congrats, Jon! On 1/9/12 5:18 PM, "Todd Lipcon" wrote: >I'm happy to announce that the HBase PMC has elected Jonathan Hsieh as >a new HBase committer and PMC member. Jon has done great work on >improving hbck, wrote a new META rebuild tool, and has diagnosed and >fixed a number of tricky bu

Re: ANN: The third hbase 0.92.0 release candidate is available for download

2012-01-04 Thread Doug Meil
+1 On the Tips and Tricks section in Troubleshooting idea. I'd like to keep the FAQ higher-level to point people to the right chapters but not clutter it with too much detail. On 1/3/12 11:34 PM, "lars hofhansl" wrote: >> If stuff gets stuck in transition we at least have decent >> visibili

Re: build time shortened to 1/4 of the original

2012-01-02 Thread Doug Meil
Great stuff! Thanks! On 1/2/12 12:19 AM, "Ted Yu" wrote: >Hi, >Thanks to N Keywal's wonderful work in HBASE-5064, both TRUNK builds and >PreCommit build now take only 29 minutes to complete (assuming reasonable >load on Jenkins build machines). > >See the tail of the following: >https://bu

Re: Rename "book" to "manual", redux

2011-12-06 Thread Doug Meil
2011 at 6:29 PM, Nicolas Spiegelberg >> wrote: >>> +1 >>> >>> On 12/5/11 4:28 PM, "Doug Meil" wrote: >>> >>>> >>>>Hi folks- >>>> >>>>Sorry to reopen this, but hopefully only briefly. I'm f

Rename "book" to "manual", redux

2011-12-05 Thread Doug Meil
rogrammers.html "MySQL Reference Manual" http://dev.mysql.com/doc/refman/5.5/en/ Oracle RDBMS http://www.oracle.com/pls/db111/homepage (Developer's Guide, Java Developer's Guide, Administrator's Guide, Security Guide, etc.) Doug Meil Chief Software Architect, Explorys doug.m...@explorys.com

Re: MaxDirectMemorySize Was: Suspected memory leak

2011-12-05 Thread Doug Meil
If you don't mind, please add to Troubleshooting (as opposed to FAQ) There's a Client section in the Troubleshooting chapter already. http://hbase.apache.org/book.html#trouble.client On 12/5/11 3:12 PM, "Stack" wrote: >On Mon, Dec 5, 2011 at 10:43 AM, Todd Lipcon wrote: >> If the problem

Re: rename "book" to "manual"?

2011-12-03 Thread Doug Meil
+1 On 12/3/11 3:31 AM, "Lars George" wrote: >+1 > >On Dec 3, 2011, at 3:29 AM, Todd Lipcon wrote: > >> Just an idle thought on a Friday evening: I always find it confusing >> that we have two "hbase books". >> - There's the wonderful one that Doug primarily maintains in SVN: >> http://hbase

Re: Index page patch

2011-12-01 Thread Doug Meil
I attached a generated index.html in the ticket so people can see what this looks like (i.e., instead of just looking at the patch file). On 12/1/11 5:29 PM, "Doug Meil" wrote: > >Hi folks- > >I've submitted a patch to the for the HBase home page for some >re

Index page patch

2011-12-01 Thread Doug Meil
everybody thinks via the Jira. Thanks! Doug Meil Chief Software Architect, Explorys doug.m...@explorys.com

Re: security/configuration-related error when trying to create a table

2011-12-01 Thread Doug Meil
Let me know if you need any help on that. On 12/1/11 11:14 AM, "Gary Helmling" wrote: >Yes I'm still interested but probably won't get to it til this weekend. I >think there's an open jira for security docs. I'll put a patch for >book.xml up on that. > >I think it would be great to have an

Re: Compression.Algorithm extensibility?

2011-11-28 Thread Doug Meil
he header of a multi-MB HFile hardly seems expensive. > >Could probably switch this over in a backward-compatible manner pretty >easily if someone has time to do the patch. > >-Todd > >On Mon, Nov 28, 2011 at 9:57 AM, Stack wrote: >> On Mon, Nov 28, 2011 a

Re: unit tests

2011-11-28 Thread Doug Meil
The development chapter is in developer.xml, actually, but I think that adding to the book would be a good idea. On 11/28/11 6:30 PM, "Jesse Yates" wrote: >Alternatively, a good place for this would also be in the book.xml, under >(13) Building and Developing HBase > >-Jesse > >On Mon, Nov 28

Compression.Algorithm extensibility?

2011-11-28 Thread Doug Meil
Algorithm { … which makes the prospect of adding new instances slightly terrifying. Has anybody considered changing the constructor to supply an ordinal value, and that way if anybody adds a custom one they could supply a value like 999 or something hopefully never used by HBase? Doug Meil

Re: metric questions

2011-11-22 Thread Doug Meil
Thanks Mikael for the review. I'll put it in the docs queue. On 11/22/11 5:23 PM, "Mikael Sitruk" wrote: >Hi > >I have enabled metrics on Hbase cluster (0.90.1), and mapped the metrics >to >3 categories (missing, Present but not documented/Incomplete >documentation,Ok) according to their sta

Re: Hbase -question

2011-11-15 Thread Doug Meil
Hi there- You probably want to read these two entries in the book... http://hbase.apache.org/book.html#store http://hbase.apache.org/book.html#wal On 11/15/11 2:00 AM, "Aditya Kumar" wrote: >Thanks for the reply and explanation. > >Can you explain me the following: >HFile is having the raw

Re: unit tests improvement

2011-11-03 Thread Doug Meil
I'll put together a book patch and have you guys comment on it before it goes in. On 11/3/11 12:56 PM, "Jesse Yates" wrote: >On Thu, Nov 3, 2011 at 9:53 AM, N Keywal wrote: > >> > > 2) HBASE-4737 is for the split; as discussed two weeks ago. There >>is a >> > > split proposal. I will apply

Re: Please welcome the dynamic K-squared duo, Kannan and Karthick, our latest hbase committers!

2011-10-31 Thread Doug Meil
Welcome! On 10/31/11 1:19 PM, "Stack" wrote: >These lads had a lot to do with a rather large hbase install and they >have the battle scars to show for it. > >Welcome to the fold boys, > >St.Ack >

Re: Adding a column family restriction

2011-10-28 Thread Doug Meil
esolved?) >Do you know when the 0.92 is planed to be released? > >Thanks >Mikael.S > >On Thu, Oct 27, 2011 at 3:34 PM, Doug Meil >wrote: > >> Online table changes is a feature on TRUNK/.92 (dev-list, please >>comment). >> However, for .90 and before you nee

RE: Adding a column family restriction

2011-10-27 Thread Doug Meil
Online table changes is a feature on TRUNK/.92 (dev-list, please comment). However, for .90 and before you need to disable. Long story short, this has to do with the fact that the CFs metadata needs to be propagated to all the regions. For background, see: http://hbase.apache.org/book.htm

Re: Hbase client do not able to connect with remote Hbase server

2011-10-19 Thread Doug Meil
Why are you setting the hbase.master from the client? http://hbase.apache.org/book.html#client_dependencies The only thing you need to set is the zookeeper quorum. On 10/19/11 3:11 PM, "Yves Langisch" wrote: >Try to specify the hbase.master property without a port. > >config.set("hbase.mas

Re: HBase backups

2011-10-19 Thread Doug Meil
Through this year I've been retiring wiki pages and porting the content to the book (e.g., performance, architecture, etc.). If at all possible, I'd like to avoid adding new wiki content and prefer adding to the book. On 10/19/11 1:27 PM, "Doug Meil" wrote: > >I

Re: HBase backups

2011-10-19 Thread Doug Meil
I updated the book recently with a fair amount of backup info. http://hbase.apache.org/book.html#ops.backup Can you add a patch to this section? On 10/19/11 12:23 PM, "Ted Yu" wrote: >My first edit didn't go in either. >Then I noted the question above the Edit area I must have forgotten to

Re: Speeding up tests

2011-10-18 Thread Doug Meil
Excellent! On 10/18/11 3:36 PM, "N Keywal" wrote: >I've identified a few sleep/wait related stuff, at the end it should cut >the >start/stop time in half

Re: Speeding up tests

2011-10-17 Thread Doug Meil
+1 on what Jesse said about mocking. I'm not particularly crazy about mocking for the reasons he cited, and I'd use them only as a last resort. On 10/17/11 1:40 PM, "Jesse Yates" wrote: >Keywal, > >Thanks for helping out with this. > >Yeah, I've started working on breaking out some of the tes

Re: Maven 2 vs. 3

2011-10-09 Thread Doug Meil
Oops... Sorry, the "Ted" in my message was aimed at Ted Yu. On 10/9/11 6:19 PM, "Doug Meil" wrote: > >Hey Ted, we were working on a ticket a few months ago and I was having >trouble because I was working with Maven 3 and you said it wasn't >supported (o

Re: Maven 2 vs. 3

2011-10-09 Thread Doug Meil
Hey Ted, we were working on a ticket a few months ago and I was having trouble because I was working with Maven 3 and you said it wasn't supported (or didn't work well). If that's not the case anymore I'll update the book. On 10/9/11 4:31 PM, "Ted Dunning" wrote: >The book is already slightl

Re: Please welcome our newest committer, Lars Hofhansl

2011-10-07 Thread Doug Meil
Congrats, and welcome! On 10/7/11 12:53 PM, "Stack" wrote: >One of us! > >As per tradition, your first commit should be adding yourself to the >pom.xml Lars in the committers section -- and don't break the build! >(smile) > >St.Ack

Re: Build failed in Jenkins: HBase-TRUNK #2287

2011-10-04 Thread Doug Meil
>>> >>> > Hey Doug, >>> > Actually this is an issue with maven-site-plugin 2.1 not with the >>> > acid-semantics.xml. Just figured out that moving maven-site-plugin >>>back >>> to >>> > 2.0.1 and downgrading surefire-reports pl

Re: Speeding up tests

2011-10-03 Thread Doug Meil
Thanks Jesse. Great write up! On 10/3/11 4:55 PM, "Jesse Yates" wrote: >Hey everyone, > >There has been a bunch of work recently on speeding up the testing to make >it easier for developers to iterate quickly on new features fixes. Part of >the problem is that the test suite takes anywhere f

Re: Build failed in Jenkins: HBase-TRUNK #2287

2011-10-03 Thread Doug Meil
This is odd, because "acid-semantics.xml" hasn't been changed since May 23, 2011. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:2.1:site (default-site) on project hbase: Error during page generation: Error parsing '

mvn error?

2011-10-03 Thread Doug Meil
chEnhanced(Launcher.java:315) at org.codehaus.classworlds.Launcher.launch(Launcher.java:255) at org.codehaus.classworlds.Launcher.mainWithExitCode(Launcher.java:430) at org.codehaus.classworlds.Launcher.main(Launcher.java:375) [INFO] ----

Re: Better Javadoc HTableDescriptor

2011-10-01 Thread Doug Meil
Be very careful about code-changes that causes compilation failures upon upgrade. Once in a while that may happen on a major upgrade, but it had better be for a very good, explainable, reason that the community is behind. A fourth option is to add Javadoc to the explaining what this method does

Re: Please welcome Ramkrishna S. Vasudevan, our newest hbase committer

2011-09-28 Thread Doug Meil
Welcome! On 9/28/11 12:15 PM, "Stack" wrote: >Please welcome Ramkrishna, our newest hbase committer. Ram has been >going great guns fixing ugly hbase bugs with a good while now. I'm >glad he's on board. > >Good on you Ram, >St.Ack

Re: Running UnitTests before submitting a patch

2011-09-20 Thread Doug Meil
Hi there- https://issues.apache.org/jira/browse/HBASE-4448 I attached a prototype of HBaseTestingUtilityFactory to this ticket. I'd like to get some feedback on the general idea (emphasis on "general idea") and then if the consensus is that it makes sense I will continue and then we can do a mo

Re: Running UnitTests before submitting a patch

2011-09-19 Thread Doug Meil
tCase { On 9/19/11 4:20 PM, "Jesse Yates" wrote: >Cool. > > I'm going to try to get a patch up of the failsafe and package splits up >tonight. > >On Mon, Sep 19, 2011 at 1:18 PM, Doug Meil >wrote: > >> >> I'm glad you like the factory idea -

Re: Running UnitTests before submitting a patch

2011-09-19 Thread Doug Meil
9/11 4:06 PM, "Jesse Yates" wrote: >On Mon, Sep 19, 2011 at 12:18 PM, Doug Meil >wrote: > >> >> I'm not too familiar with the Maven Failsafe plugin, but I've been >> reviewing the timings of some 'client' unit tests and where the unit >>

Re: Running UnitTests before submitting a patch

2011-09-19 Thread Doug Meil
I'm not too familiar with the Maven Failsafe plugin, but I've been reviewing the timings of some 'client' unit tests and where the unit test framework spends it's time... Anything that uses HBaseTestingUtility and does something like... protected void setUp() throws Exception {

Re: Running UnitTests before submitting a patch

2011-09-18 Thread Doug Meil
>From the most recent build the performance is certainly lumpy in a few packages. https://builds.apache.org/job/HBase-TRUNK/2232/testReport/ org.apache.hadoop.hbase.client 13 min org.apache.hadoop.hbase.mapreduce 9 min 42 sec org.apache.hadoop.hbase.master 7 min 14 sec org.apache.hadoop.hbase

Re: HBase and Eclipse under Windows

2011-09-14 Thread Doug Meil
I think adding a link to your blog from the developer section in the Hbase book would be the easiest thing. I'll add it. Is that reasonable? On 9/14/11 10:20 AM, "Michael Morello" wrote: >Hello, > >My purpose was to help people that want to hack HBase with Eclipse from >the >source code, w

Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal

2011-09-06 Thread Doug Meil
There was a discussion over the weekend on the incubator dist-list about Accumulo and describing what was borrowed from Hadoop-core and Hbase. http://mail-archives.apache.org/mod_mbox/incubator-general/201109.mbox/%3C8 96611333.83615.1315154356465.javamail.r...@linzimmb04o.imo.intelink.gov%3E 5

Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal

2011-09-03 Thread Doug Meil
That's a good point. But the fact that Apache HTTPD is implemented in C, and Tomcat is in Java I think is material. While they compete for web server users, they have very different implementations. If ASF had two active Java webserver communities and codebases (e.g., "Tomcat" and "Timdog") I

Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal

2011-09-02 Thread Doug Meil
Just for conversation, if somebody approached ASF incubator with an idea for a framework called "ExtendedSleep" that claimed to be a Java relational-object mapping framework (instead of the crusty object-relational approach that the Hibernate mapping framework provides), would anybody take it seri

Re: [DISCUSSION] Accumulo, another BigTable clone, has shown up on Apache Incubator as a proposal

2011-09-02 Thread Doug Meil
They apparently have a very strong relationship with HBase...;-) "Apache Brand Our interest in releasing this code as an Apache incubator project is due to its strong relationship with other Apache projects, i.e. Hadoop, Zookeeper, and HBase." It's disappointing that these guys watched HBa

Re: New HBase Logo

2011-09-01 Thread Doug Meil
re: "Hopefully we will not have to ever repeat it." +1 to that. That said, I will proudly wear this on a T-shirt. Look forward to the new logo rollout! On 9/1/11 12:30 AM, "Stack" wrote: >Your PMC voted the following as the new HBase logo: > > https://issues.ap

Re: book update in progress (dev list)

2011-08-30 Thread Doug Meil
it's outside of the scope of your jira then don't include there. >Makes it easier to review and support. > >Good stuff, > >J-D > >On Mon, Aug 29, 2011 at 5:59 PM, Doug Meil > wrote: >> >> Hi Dev-List folks- >> >> I'm calling out updates to

FW: book update in progress (dev list)

2011-08-29 Thread Doug Meil
se. :-) It's all in the spirit of cooperation and it leads to a better Hbase! Doug On 8/29/11 5:15 PM, "Doug Meil" wrote: >Hi folks- > >The HBase book has been udpatedŠ http://hbase.apache.org/book.html > >There are a LOT of changes in hereŠ > > * Sche

Re: HBase book possible typo

2011-08-22 Thread Doug Meil
elow > >http://ofps.oreilly.com/titles/9781449396107/architecture.html >Section ( Storage -> Overview) > >Once again sorry for the inconvenience caused > >Cheers, >Akash A > > >On Tue, Aug 23, 2011 at 4:25 AM, Doug Meil >wrote: > >> >> Hi there- >> >&

Re: HBase book possible typo

2011-08-22 Thread Doug Meil
Hi there- Can you point me to the specific section where you saw this? http://hbase.apache.org/book.html I don't see HColumnFamily in there. On 8/22/11 9:46 AM, "Doug Meil" wrote: > >Thanks. I'll follow-up on it. > > > > > >On 8/22/11 2:04 AM,

  1   2   >