[jira] [Created] (HBASE-14826) Small improvement in KVHeap seek() API

2015-11-17 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-14826: -- Summary: Small improvement in KVHeap seek() API Key: HBASE-14826 URL: https://issues.apache.org/jira/browse/HBASE-14826 Project: HBase

Any plan to upgrade log4j to 2.x

2015-11-17 Thread Heng Chen
Some projects begin to use log4j 2.x in my company. The API for Log4j 2 is not compatible with Log4j 1.x, So sometimes hbase client log has some conflicts with our project.

Re: Any plan to upgrade log4j to 2.x

2015-11-17 Thread Nick Dimiduk
That is something we discussed a while back. There was probably a JIRA for it too. I think simply no one was willing to take on the massive search/replace required. IIRC, Mr Purtell experimented with this and found migration of configuration files to not work as expected. It would be good to bite

Re: Any plan to upgrade log4j to 2.x

2015-11-17 Thread Andrew Purtell
See https://issues.apache.org/jira/browse/HBASE-10092 and https://issues.apache.org/jira/browse/HBASE-11284 One major stumbling block was and is the backwards incompatibility of configuration file format changes ( https://logging.apache.org/log4j/2.x/manual/migration.html). Someone who has a

Re: [VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-17 Thread Nick Dimiduk
Indeed. I'll see about finishing my evaluation of both RCs and investigating this behavior this evening. On Monday, November 16, 2015, Andrew Purtell wrote: > Standalone. > > Perhaps if you attach a profiler to the JVM running the test something > interesting will turn

Re: Any plan to upgrade log4j to 2.x

2015-11-17 Thread Sean Busbey
I've been made wary of log4j2 recently due to introducing breaking changes to log output in patch releases[1]. [1]: e.g. https://issues.apache.org/jira/browse/LOG4J2-670 which was referenced in described notes just as "DatePatternConverter ISO8601_PATTERN now conforms to ISO8601." On Tue, Nov

Re: Better code quality with more checkstyles

2015-11-17 Thread Apekshit Sharma
Emm...do no replies mean "don't care" which means silent yes? :-) On Tue, Nov 10, 2015 at 3:11 PM, Apekshit Sharma wrote: > Last sunday, when i was bored, i thought 'let's fix some naive stuff, > oh.. checkstyles!'. After some time and few changes, I realized what can be >

Re: Better code quality with more checkstyles

2015-11-17 Thread Stack
Want to make a patch Appy? Will up our violations count but the set looks reasonable to me. St.Ack On Tue, Nov 17, 2015 at 4:54 PM, Apekshit Sharma wrote: > I agree. Sorry if I my message was lost in the boring sunday story, but > the proposal is only to enable new

Re: Cleanup admin.rb. Shell in general.

2015-11-17 Thread Ted Yu
See this related thread: http://search-hadoop.com/m/YGbbUzRN61T6Wdm1/hbase+shell+2.0=Ruby+shell+versions+for+HBase+2+0 On Tue, Nov 17, 2015 at 6:35 PM, Apekshit Sharma wrote: > (Planning to do this tomorrow as part of our weekly code fixit. Will > appreciate quick feedback.)

Re: Better code quality with more checkstyles

2015-11-17 Thread Apekshit Sharma
I agree. Sorry if I my message was lost in the boring sunday story, but the proposal is only to enable new checkstyles which are listed in the first mail so we can know current state of our codebase and gauge its improvement overtime. On Tue, Nov 17, 2015 at 1:20 PM, Nick Dimiduk

Re: Better code quality with more checkstyles

2015-11-17 Thread Jesse Yates
+1 Sounds reasonable On Tue, Nov 17, 2015 at 5:25 PM Andrew Purtell wrote: > > > > On Nov 17, 2015, at 5:13 PM, Stack wrote: > > > > Want to make a patch Appy? Will up our violations count but the set looks > > reasonable to me. > > St.Ack > > > >>

[jira] [Created] (HBASE-14829) Add more checkstyles

2015-11-17 Thread Appy (JIRA)
Appy created HBASE-14829: Summary: Add more checkstyles Key: HBASE-14829 URL: https://issues.apache.org/jira/browse/HBASE-14829 Project: HBase Issue Type: Improvement Reporter: Appy

Re: [VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-17 Thread Enis Söztutar
I have run PE on the 1.0.3 RC, and most of the handlers were blocked at the getRegionLockInternal() call. Also noticed these in the logs: 015-11-17 18:29:39,717 WARN [B.defaultRpcServer.handler=18,queue=0,port=58215] regionserver.HRegion: Failed getting lock in batch put,

Cleanup admin.rb. Shell in general.

2015-11-17 Thread Apekshit Sharma
(Planning to do this tomorrow as part of our weekly code fixit. Will appreciate quick feedback.) Admin.rb either is a potpourri of functions or it's doing something I don't know yet. Will it make sense to move the function definitions to appropriate "shell/commands/.rb" files? Anything else

Re: [VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-17 Thread Andrew Purtell
Ok, let's sink this RC. On Tue, Nov 17, 2015 at 6:39 PM, Enis Söztutar wrote: > Likely this patch broke something: > > commit 4c4a4353898aef35016c342f997eba6e439cc039 > > Author: Enis Soztutar > > Date: Wed Oct 28 18:16:32 2015 -0700 > > > HBASE-14689

Re: Better code quality with more checkstyles

2015-11-17 Thread Andrew Purtell
> On Nov 17, 2015, at 5:13 PM, Stack wrote: > > Want to make a patch Appy? Will up our violations count but the set looks > reasonable to me. > St.Ack > >> On Tue, Nov 17, 2015 at 4:54 PM, Apekshit Sharma wrote: >> >> I agree. Sorry if I my message was

Re: [VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-17 Thread Enis Söztutar
Likely this patch broke something: commit 4c4a4353898aef35016c342f997eba6e439cc039 Author: Enis Soztutar Date: Wed Oct 28 18:16:32 2015 -0700 HBASE-14689 Addendum and unit test for HBASE-13471 It was supposed to bring the logic around that to be on par with

[jira] [Created] (HBASE-14828) Deprecate stateful REST scanners

2015-11-17 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-14828: -- Summary: Deprecate stateful REST scanners Key: HBASE-14828 URL: https://issues.apache.org/jira/browse/HBASE-14828 Project: HBase Issue Type: Task

[CANCELLED] [VOTE] The 1st HBase 1.0.3 release candidate (RC0) is available

2015-11-17 Thread Andrew Purtell
This vote is cancelled. We will start another for a new RC after some concerns found when testing RC0 have been resolved. On Fri, Nov 13, 2015 at 4:39 PM, Andrew Purtell wrote: > > The 1st HBase 1.0.3 release candidate (RC0) is available for download at >

[jira] [Created] (HBASE-14830) Fix broken links in 0.94 generated docs

2015-11-17 Thread Misty Stanley-Jones (JIRA)
Misty Stanley-Jones created HBASE-14830: --- Summary: Fix broken links in 0.94 generated docs Key: HBASE-14830 URL: https://issues.apache.org/jira/browse/HBASE-14830 Project: HBase Issue

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Andrew Purtell
Ok. > On Nov 17, 2015, at 8:47 PM, Enis Söztutar wrote: > > Thanks Andrew, > > Maybe we can hold off the release announcement at least, and wait until we > investigate further. I'll look at the batching and how row locks are > different between 0.98 and branch-1 tomorrow.

Re: Better code quality with more checkstyles

2015-11-17 Thread Apekshit Sharma
Patch is up. Tests are running. Betting is ON for what the new number will be. (current is ~ 3.8k) :-) Bets so far: Appy 12k Stack 8k Any other guesses? On Tue, Nov 17, 2015 at 5:29 PM, Jesse Yates wrote: > +1 Sounds reasonable > > On Tue, Nov 17, 2015 at 5:25 PM Andrew

Still Failing: HBase Generate Website

2015-11-17 Thread Apache Jenkins Server
Still Failing If successful, the website and docs have been generated. Save the following link and apply it by using the following commands: wget -O- https://builds.apache.org/job/hbase_generate_website/34/artifact/website.patch.zip | bsdtar xf - git checkout asf-site; git pull git am

Re: [VOTE] First release candidate for HBase 1.1.3 (RC0) is available

2015-11-17 Thread Enis Söztutar
-1. I think this RC is also affected by HBASE-14689: A run of bin/hbase pe --latency --nomapred --presplit=10 --valueSize=10 randomWrite 10 results in client hang and a lot of following exceptions. Interesting that, I cannot reproduce this with LTT. java.io.IOException: Timed out waiting

[jira] [Resolved] (HBASE-14823) HBase Ref Guide Refactoring

2015-11-17 Thread Misty Stanley-Jones (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misty Stanley-Jones resolved HBASE-14823. - Resolution: Fixed Hadoop Flags: Reviewed > HBase Ref Guide Refactoring >

Re: [VOTE] First release candidate for HBase 1.1.3 (RC0) is available

2015-11-17 Thread Nick Dimiduk
Okay, good find Enis. On Tuesday, November 17, 2015, Enis Söztutar wrote: > Sorry for the trouble, let me revert the commit. I'll look at the 0.98 RC > as well. > > > Enis > > On Tue, Nov 17, 2015 at 7:32 PM, Enis Söztutar > wrote: > > >

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Andrew Purtell
Thanks Enis. Appreciate the investigation. Yes I did release this. We can make a patch release though if needed. > On Nov 17, 2015, at 8:04 PM, Enis Söztutar wrote: > > I have tried the same pe command without small values, and cannot reproduce > the row lock issue in

Re: [VOTE] First release candidate for HBase 1.1.3 (RC0) is available

2015-11-17 Thread Andrew Purtell
Let's revert this from 0.98 even if the problem isn't manifesting there (or perhaps just not in the same way) > On Nov 17, 2015, at 7:33 PM, Enis Söztutar wrote: > > Sorry for the trouble, let me revert the commit. I'll look at the 0.98 RC > as well. > > > Enis > >> On

Re: [VOTE] First release candidate for HBase 1.1.3 (RC0) is available

2015-11-17 Thread Andrew Purtell
Indeed interesting that LTT doesn't catch it. > On Nov 17, 2015, at 7:32 PM, Enis Söztutar wrote: > > -1. > > I think this RC is also affected by HBASE-14689: > > > A run of > > bin/hbase pe --latency --nomapred --presplit=10 --valueSize=10 randomWrite > 10 > >

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Enis Söztutar
Thanks Andrew, Maybe we can hold off the release announcement at least, and wait until we investigate further. I'll look at the batching and how row locks are different between 0.98 and branch-1 tomorrow. Enis On Tue, Nov 17, 2015 at 8:31 PM, Andrew Purtell wrote: >

Re: [VOTE] First release candidate for HBase 1.1.3 (RC0) is available

2015-11-17 Thread Enis Söztutar
Sorry for the trouble, let me revert the commit. I'll look at the 0.98 RC as well. Enis On Tue, Nov 17, 2015 at 7:32 PM, Enis Söztutar wrote: > -1. > > I think this RC is also affected by HBASE-14689: > > > A run of > > bin/hbase pe --latency --nomapred --presplit=10

[jira] [Reopened] (HBASE-14689) Addendum and unit test for HBASE-13471

2015-11-17 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar reopened HBASE-14689: --- Reopening, since it seems this issue is causing problems with high load. Will revert and test.

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Enis Söztutar
Andrew did you push the artifacts yet? Let me see whether this RC is also affected by https://issues.apache.org/jira/browse/HBASE-14689 Enis On Tue, Nov 17, 2015 at 12:35 PM, Andrew Purtell wrote: > With three +1 votes and no 0 or -1 votes, this vote passes and we have >

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Enis Söztutar
I have tried the same pe command without small values, and cannot reproduce the row lock issue in this RC. Setup is single node with default settings, using a single SSD. bin/hbase pe --latency --nomapred --presplit=10 randomWrite 10 This same exact command, I can reproduce the hang in 1.0.3RC

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Elliott Clark
branch-1 has completely re-written row locks from 0.98 and branch-1.1. See: https://github.com/apache/hbase/commit/bae2a970817d3693946c5b1d4e2382e56b1e94b8 https://github.com/apache/hbase/commit/2c83d8a263ee7c6751448bcc72868da86757f7f2 I'm not sure how much we're going to get by looking at row

[jira] [Created] (HBASE-14831) Remove heapSize from everything except Cell/KV holding classes

2015-11-17 Thread Elliott Clark (JIRA)
Elliott Clark created HBASE-14831: - Summary: Remove heapSize from everything except Cell/KV holding classes Key: HBASE-14831 URL: https://issues.apache.org/jira/browse/HBASE-14831 Project: HBase

Re: [VOTE] The 1st HBase 0.98.16 release candidate (RC0) is available

2015-11-17 Thread Andrew Purtell
With three +1 votes and no 0 or -1 votes, this vote passes and we have 0.98.16. I will send the artifacts onward for distribution and send out a release announcement shortly. Thanks to all who voted on this candidate. On Tue, Nov 10, 2015 at 10:31 AM, Andrew Purtell wrote:

[jira] [Created] (HBASE-14827) Potential memory leak on REST server if state-full scanner is not deleted

2015-11-17 Thread Duo Xu (JIRA)
Duo Xu created HBASE-14827: -- Summary: Potential memory leak on REST server if state-full scanner is not deleted Key: HBASE-14827 URL: https://issues.apache.org/jira/browse/HBASE-14827 Project: HBase

Re: Better code quality with more checkstyles

2015-11-17 Thread Nick Dimiduk
The problem with a fixup "rampage" is it will very like introduce conflicts with any patches that are in review process. We have no issue with general code cleanup. The problem is introducing more work for contributors/reviewers while it's happening. The cleanup needs to happen in tandem with

[jira] [Resolved] (HBASE-14340) Add second bulk load option to Spark Bulk Load to send puts as the value

2015-11-17 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-14340. Resolution: Fixed Hadoop Flags: Reviewed Pushed to master. Thanks for the patch

Fixed: HBase Generate Website

2015-11-17 Thread Apache Jenkins Server
Fixed If successful, the website and docs have been generated. Save the following link and apply it by using the following commands: wget -O- https://builds.apache.org/job/hbase_generate_website/35/artifact/website.patch.zip | bsdtar xf - git checkout asf-site; git pull git am website.patch