[DISCUSSION] Finishing up 0.96 --> WAS Re: 0.95 and 0.96 remaining issues

2013-06-24 Thread Stack
(Changed the subject) On Mon, Jun 24, 2013 at 4:04 PM, Nick Dimiduk wrote: > I want to see initial data type APIs ship out with 0.95.2. A patch for > ordered byte serialization is up (HBASE-8201) and is nearing steady-state. > However, sershe is the only person who's left feedback. I just posted

[jira] [Created] (HBASE-8801) Region level read/write degradation

2013-06-24 Thread Chao Shi (JIRA)
Chao Shi created HBASE-8801: --- Summary: Region level read/write degradation Key: HBASE-8801 URL: https://issues.apache.org/jira/browse/HBASE-8801 Project: HBase Issue Type: Bug Reporter:

Re: Opinions on the 'watcher' script that surrounds launched hbase daemons

2013-06-24 Thread Andrew Purtell
On Mon, Jun 24, 2013 at 4:13 PM, Nick Dimiduk wrote: > It sounds like it's encroaching on BigTop territory. > I agree. Can we handle this there? Point a section of the book on watchers to it? -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein

[jira] [Created] (HBASE-8800) Return non-zero exit codes when a region server aborts

2013-06-24 Thread Jean-Daniel Cryans (JIRA)
Jean-Daniel Cryans created HBASE-8800: - Summary: Return non-zero exit codes when a region server aborts Key: HBASE-8800 URL: https://issues.apache.org/jira/browse/HBASE-8800 Project: HBase

[jira] [Created] (HBASE-8799) TestAccessController#testBulkLoad has been failing for some time on trunk/0.95

2013-06-24 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-8799: - Summary: TestAccessController#testBulkLoad has been failing for some time on trunk/0.95 Key: HBASE-8799 URL: https://issues.apache.org/jira/browse/HBASE-8799 Projec

Re: Opinions on the 'watcher' script that surrounds launched hbase daemons

2013-06-24 Thread Nick Dimiduk
The template approach is cleaner. It sounds like it's encroaching on BigTop territory. On Mon, Jun 24, 2013 at 1:49 PM, Stack wrote: > New in 0.95, when you do a process listing, there are two 'hbase' > processes. There is the old java process itself and then there is the > launcher script that

Re: 0.95 and 0.96 remaining issues

2013-06-24 Thread Nick Dimiduk
I want to see initial data type APIs ship out with 0.95.2. A patch for ordered byte serialization is up (HBASE-8201) and is nearing steady-state. However, sershe is the only person who's left feedback. I just posted an early patch for the data type API itself (HBASE-8693). It should get some eyes f

Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-06-24 Thread Jean-Marc Spaggiari
Oh! Cool! A new toy for the week! ;) Thanks Lars! I will start right now to test it! (And I will do the remaining perf testing just after or in parallel...) 2013/6/24 lars hofhansl : > The 1st 0.94.9 RC is available for download at > http://people.apache.org/~larsh/hbase-0.94.9-rc0/ > Signed wi

[ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download

2013-06-24 Thread lars hofhansl
The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/ Signed with my code signing key: C7CFE328 Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:     [HBASE-8453

Re: Opinions on the 'watcher' script that surrounds launched hbase daemons

2013-06-24 Thread Jean-Daniel Cryans
Yes. J-D On Mon, Jun 24, 2013 at 1:49 PM, Stack wrote: > New in 0.95, when you do a process listing, there are two 'hbase' > processes. There is the old java process itself and then there is the > launcher script that is just hanging around waiting on the java process to > exit so it can clear

Build failed in Jenkins: HBase-0.95 #502

2013-06-24 Thread apurtell
See Changes: [Michael Stack] HBASE-8792 Organize EventType Java Docs [Michael Stack] HBASE-8532 [Webui] Bootstrap based webui compatibility for IE and also fix some page format issues [nkeywal] HBASE-6295 Possible performance improvement in cli

[jira] [Created] (HBASE-8798) Fix a minor bug in shell command with clone_snapshot table error

2013-06-24 Thread Jerry He (JIRA)
Jerry He created HBASE-8798: --- Summary: Fix a minor bug in shell command with clone_snapshot table error Key: HBASE-8798 URL: https://issues.apache.org/jira/browse/HBASE-8798 Project: HBase Issue T

Build failed in Jenkins: HBase-0.95-Hadoop-2 #494

2013-06-24 Thread apurtell
See Changes: [Michael Stack] HBASE-8792 Organize EventType Java Docs [Michael Stack] HBASE-8532 [Webui] Bootstrap based webui compatibility for IE and also fix some page format issues [nkeywal] HBASE-6295 Possible performance improveme

[jira] [Resolved] (HBASE-8656) Rpc call may not be notified in SecureClient

2013-06-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-8656. -- Resolution: Fixed Hadoop Flags: Reviewed > Rpc call may not be notified in SecureClie

Opinions on the 'watcher' script that surrounds launched hbase daemons

2013-06-24 Thread Stack
New in 0.95, when you do a process listing, there are two 'hbase' processes. There is the old java process itself and then there is the launcher script that is just hanging around waiting on the java process to exit so it can clear the process's znode. Clearing the znode will mean the master will

[jira] [Resolved] (HBASE-5083) Backup HMaster should have http infoport open with link to the active master

2013-06-24 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-5083. -- Resolution: Fixed Hadoop Flags: Reviewed > Backup HMaster should have http infoport o

Re: New builds mailing list; all build emissions now pointed there rather than on to dev list

2013-06-24 Thread Olle Mårtensson
OK, thanks. // Olle On Mon, Jun 24, 2013 at 9:26 PM, Stack wrote: > I should have mentioned that if you are interested in seeing build results, > you need to subscribe to the new list: > > builds-subscr...@hbase.apache.org > > St.Ack > > > On Mon, Jun 24, 2013 at 10:59 AM, Stack wrote: > >

Re: New builds mailing list; all build emissions now pointed there rather than on to dev list

2013-06-24 Thread Stack
I should have mentioned that if you are interested in seeing build results, you need to subscribe to the new list: builds-subscr...@hbase.apache.org St.Ack On Mon, Jun 24, 2013 at 10:59 AM, Stack wrote: > Infrastructure created us a new builds mailing list. I'll point all > builds.apache.o

[jira] [Created] (HBASE-8797) Prevent merging regions from moving during online merge

2013-06-24 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HBASE-8797: -- Summary: Prevent merging regions from moving during online merge Key: HBASE-8797 URL: https://issues.apache.org/jira/browse/HBASE-8797 Project: HBase Issue Type:

New builds mailing list; all build emissions now pointed there rather than on to dev list

2013-06-24 Thread Stack
Infrastructure created us a new builds mailing list. I'll point all builds.apache.org and ec2 builds to send mail there instead of to the dev list. St.Ack

Re: Efficiently wiping out random data?

2013-06-24 Thread Jean-Daniel Cryans
Thank you so much for all the answers guys, looks like I should write up something for the ref guide! J-D On Sun, Jun 23, 2013 at 3:31 PM, Andrew Purtell wrote: > Right, compaction followed by a 'secure' HDFS level delete by random > rewrites to nuke the blocks of the remnant. Even then it's dif

[jira] [Resolved] (HBASE-8796) Add mention of new builds mailing list to site

2013-06-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-8796. -- Resolution: Fixed Fix Version/s: 0.95.2 0.98.0 Committed to 0.95 and trunk

[jira] [Created] (HBASE-8796) Add mention of new builds mailing list to site

2013-06-24 Thread stack (JIRA)
stack created HBASE-8796: Summary: Add mention of new builds mailing list to site Key: HBASE-8796 URL: https://issues.apache.org/jira/browse/HBASE-8796 Project: HBase Issue Type: Task Compo

region opening slow on large tables

2013-06-24 Thread Dave Latham
I'd really appreciate some input on HBASE-8778 from the developers. Short summary: When opening regions, the region server (via FSTableDescriptors) scans the entire table directory to find the latest table descriptor file. On large tables this can make region opening slow as it invokes many round

Re: [COMPACTIONS] Anyone seen hbase.hstore.compaction.min.size in trunk/0.95?

2013-06-24 Thread Sergey Shelukhin
My impression was that the purpose of this setting is to auto-include flushes into large compactions that already fit in the ratio. Frankly speaking without running the cluster it's hard to tell what the setting should be. Low value will make sure it rarely includes any files, right? Except for eff

Build failed in Jenkins: HBase-0.95 #501

2013-06-24 Thread apurtell
See -- [...truncated 6974 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.078 sec Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary Tests run: 1, Failures: 0, Err

Re: [COMPACTIONS] Anyone seen hbase.hstore.compaction.min.size in trunk/0.95?

2013-06-24 Thread Sergey Shelukhin
+1 on experimenting with 0. On Mon, Jun 24, 2013 at 9:32 AM, lars hofhansl wrote: > I think it depends on how large we expect the initially flushed HFile to > be (just to state the obvious). > The current default matches the memstore flushsize, so if we mostly flush > because of that limit the c

Build failed in Jenkins: HBase-0.95-Hadoop-2 #493

2013-06-24 Thread apurtell
See -- [...truncated 7759 lines...] Running org.apache.hadoop.hbase.zookeeper.TestHQuorumPeer Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.566 sec Running org.apache.hadoop.hbase.zookeep

0.95 and 0.96 remaining issues

2013-06-24 Thread Stack
Let me freshen up this thread. Let me also petition that we as a project renew our committal to pushing out 0.96. We are almost there. Lets do one last 'Development Release', a 0.95.2, and then a 0.96 release in August? Here is how I see it. Please feel free to add/pushback: + There are no bl

Re: [COMPACTIONS] Anyone seen hbase.hstore.compaction.min.size in trunk/0.95?

2013-06-24 Thread lars hofhansl
I think it depends on how large we expect the initially flushed HFile to be (just to state the obvious). The current default matches the memstore flushsize, so if we mostly flush because of that limit the current default should be good. If we have many column families, where one dominates, we w

[jira] [Created] (HBASE-8795) bin/hbase zkcli cannot take arguments anymore

2013-06-24 Thread Nicolas Liochon (JIRA)
Nicolas Liochon created HBASE-8795: -- Summary: bin/hbase zkcli cannot take arguments anymore Key: HBASE-8795 URL: https://issues.apache.org/jira/browse/HBASE-8795 Project: HBase Issue Type: B

Re: [COMPACTIONS] Anyone seen hbase.hstore.compaction.min.size in trunk/0.95?

2013-06-24 Thread Stack
On Thu, Jun 20, 2013 at 3:43 PM, Stack wrote: > On Thu, Jun 20, 2013 at 2:41 PM, Sergey Shelukhin > wrote: > >> Part of HBASE-7055 patch that we picked includes CompactionConfiguration >> class, which uses a prefix for config values. >> See ::getMinCompactSize on that class, it's still used in c

Re: request to join HBase developer mailing list

2013-06-24 Thread Stack
Hello Feifei Ji: Welcome. All contribs welcome. To subscribe to the mailing list, write dev-subscr...@hbase.apache.org: http://hbase.apache.org/mail-lists.html St.Ack On Sun, Jun 23, 2013 at 11:24 PM, manandsea wrote: > Hi, > > My name is Feifei Ji. I would like to join the HBase developer t

request to join HBase developer mailing list

2013-06-24 Thread manandsea
Hi, My name is Feifei Ji. I would like to join the HBase developer team. I am now a software engineer from Amazon. Also, I did my internship last summer at HBase team at Facebook and learned a lot interesting design philosophy during that period. I am thinking maybe it will be a great experience

Build failed in Jenkins: HBase-0.95 #500

2013-06-24 Thread apurtell
See -- [...truncated 7282 lines...] Downloading: http://people.apache.org/~garyh/mvn/org/apache/maven/shared/file-management/1.1/file-management-1.1.jar Downloading: http://people.apache.org/~garyh/mvn/org/apache/m

Build failed in Jenkins: HBase-0.95-Hadoop-2 #492

2013-06-24 Thread apurtell
See Changes: [mbertozzi] HBASE-8783 RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name -- [...truncated 7764 lines...] Running org.apache.hadoop.hbase.master.Test

[jira] [Created] (HBASE-8794) DependentColumnFilter.toString() throws NullPointerException

2013-06-24 Thread Stefan Seelmann (JIRA)
Stefan Seelmann created HBASE-8794: -- Summary: DependentColumnFilter.toString() throws NullPointerException Key: HBASE-8794 URL: https://issues.apache.org/jira/browse/HBASE-8794 Project: HBase

Build failed in Jenkins: HBase-TRUNK-on-Hadoop-2.0.0 #581

2013-06-24 Thread Apache Jenkins Server
See Changes: [mbertozzi] HBASE-8783 RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name -- [...truncated 8470 lines...] Running org.apache.hadoop.hba

Build failed in Jenkins: hbase-0.95-on-hadoop2 #146

2013-06-24 Thread Apache Jenkins Server
See Changes: [mbertozzi] HBASE-8783 RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name -- [...truncated 24108 lines...] Running org.apache.hadoop.hbase.re

Build failed in Jenkins: HBase-0.95 #499

2013-06-24 Thread apurtell
See Changes: [mbertozzi] HBASE-8783 RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name -- [...truncated 7284 lines...] Downloading: http://people.apache.org/~garyh/mvn/asm

Build failed in Jenkins: HBase-TRUNK-Hadoop-2 #378

2013-06-24 Thread apurtell
See Changes: [mbertozzi] HBASE-8783 RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name [Michael Stack] HBASE-8733 Update our hadoop2 in trunk and 0.95 to 2.0.5-alpha (We are currently 2.0.2)

[jira] [Created] (HBASE-8793) Hbase

2013-06-24 Thread JIRA
Michael Czerwiński created HBASE-8793: - Summary: Hbase Key: HBASE-8793 URL: https://issues.apache.org/jira/browse/HBASE-8793 Project: HBase Issue Type: Bug Components: scripts

Build failed in Jenkins: HBase-0.95-Hadoop-2 #491

2013-06-24 Thread apurtell
See -- [...truncated 7767 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.208 sec Running org.apache.hadoop.hbase.regionserver.TestMasterAddressManager Tests run: 1, Failures: 0,

Jenkins build is back to normal : HBase-0.94 #254

2013-06-24 Thread apurtell
See