Re: Balancer Cutoff

2016-11-14 Thread Stack
Let me try out the below in a unit test. Good on you Lars, S On Wed, Nov 9, 2016 at 2:46 AM, Lars George wrote: > Wait, I am getting more confused (why must this be so hard to read?), > as in HMaster.balance() we have this > > long cutoffTime = System.currentTimeMillis() + maximumBalanceTime; >

Re: HBASE 2.0 release progress

2016-11-14 Thread Anoop John
>- Anyone (Ram, Anoop?) wants to post a high-level writeup on the current up-to-date state of offheaping? Off heaping the read path (HBASE-11425) this is completed some time back. As per my knowledge at least 2 users back ported this work to 1.x based version and even running in production. Am l

[jira] [Created] (HBASE-17097) Documentation for max off heap configuration

2016-11-14 Thread Anoop Sam John (JIRA)
Anoop Sam John created HBASE-17097: -- Summary: Documentation for max off heap configuration Key: HBASE-17097 URL: https://issues.apache.org/jira/browse/HBASE-17097 Project: HBase Issue Type:

Fixed: hbase.apache.org HTML Checker

2016-11-14 Thread Apache Jenkins Server
Fixed If successful, the HTML and link-checking report for http://hbase.apache.org is available at https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/69/artifact/link_report/index.html. If failed, see https://builds.apache.org/job/HBase%20Website%20Link%20Ckecker/69/console.

Re: Please update your jenkins job configs ASAP

2016-11-14 Thread Ted Yu
Looking at a reportedly successful build: https://builds.apache.org/job/HBase-1.4/533/console I don't see the JDK 1.7 / 1.8 builds. The build only took 2 min 44 sec ? On Mon, Nov 14, 2016 at 2:51 PM, Ted Yu wrote: > We used to have JDK 1.8 build named like this: > > https://builds.apache.org/j

[jira] [Created] (HBASE-17096) checkAndMutateApi doesn't work correctly on 0.98.23

2016-11-14 Thread Samarth Jain (JIRA)
Samarth Jain created HBASE-17096: Summary: checkAndMutateApi doesn't work correctly on 0.98.23 Key: HBASE-17096 URL: https://issues.apache.org/jira/browse/HBASE-17096 Project: HBase Issue Typ

[jira] [Created] (HBASE-17095) The ClientSimpleScannr cannot be stopped if the hfile is corrupt or cannot found

2016-11-14 Thread Jingcheng Du (JIRA)
Jingcheng Du created HBASE-17095: Summary: The ClientSimpleScannr cannot be stopped if the hfile is corrupt or cannot found Key: HBASE-17095 URL: https://issues.apache.org/jira/browse/HBASE-17095 Proj

Re: HBASE 2.0 release progress

2016-11-14 Thread Nick Dimiduk
Enis, by your criteria it seems the log4j2 upgrade ticket should be considered for 2.0 as well: HBASE-12341. On Monday, November 14, 2016, Enis Söztutar wrote: > Another way to look at whether a feature is a "blocker" or not for 2.0 is a > simple test: > - Can this feature be committed for 2.1,

[jira] [Created] (HBASE-17094) Add a sitemap for hbase.apache.org

2016-11-14 Thread stack (JIRA)
stack created HBASE-17094: - Summary: Add a sitemap for hbase.apache.org Key: HBASE-17094 URL: https://issues.apache.org/jira/browse/HBASE-17094 Project: HBase Issue Type: Task Reporter: s

Re: Please update your jenkins job configs ASAP

2016-11-14 Thread Nick Dimiduk
@Jon, you think I should follow your lead with 1.1 jobs? On Mon, Nov 14, 2016 at 1:21 PM, Jonathan Hsieh wrote: > Looks like our hbase 1.2 and 1.3[1] jobs seemed to be running ok with the > Hadoop label, so I've updated the 1.4 [2] and master [3] jobs to use the > Hadoop label as well. > > [1] h

Re: HBASE 2.0 release progress

2016-11-14 Thread Ted Yu
Using this lens, backup / restore should come in 2.0 with client facing APIs properly defined. On Mon, Nov 14, 2016 at 2:57 PM, Enis Söztutar wrote: > Another way to look at whether a feature is a "blocker" or not for 2.0 is a > simple test: > - Can this feature be committed for 2.1, 2.2, etc o

Re: HBASE 2.0 release progress

2016-11-14 Thread Enis Söztutar
Another way to look at whether a feature is a "blocker" or not for 2.0 is a simple test: - Can this feature be committed for 2.1, 2.2, etc or not assuming it does not make into 2.0. It is a simple test, but affectively validates whether the feature is client-visible and have backwards compatibili

Re: Please update your jenkins job configs ASAP

2016-11-14 Thread Ted Yu
We used to have JDK 1.8 build named like this: https://builds.apache.org/job/HBase-Trunk_matrix/jdk=JDK%201.8%20(latest),label=yahoo-not-h2/ However, in the latest build: https://builds.apache.org/job/HBase-TRUNK_matrix/1947/console I don't see any JDK 1.8 build - it seemed that no actual build

[jira] [Created] (HBASE-17093) Enhance SecureBulkLoadClient#secureBulkLoadHFiles() to return the family paths of the final hfiles

2016-11-14 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17093: -- Summary: Enhance SecureBulkLoadClient#secureBulkLoadHFiles() to return the family paths of the final hfiles Key: HBASE-17093 URL: https://issues.apache.org/jira/browse/HBASE-17093

[jira] [Created] (HBASE-17092) Both LoadIncrementalHFiles#doBulkLoad() methods should set return value

2016-11-14 Thread Ted Yu (JIRA)
Ted Yu created HBASE-17092: -- Summary: Both LoadIncrementalHFiles#doBulkLoad() methods should set return value Key: HBASE-17092 URL: https://issues.apache.org/jira/browse/HBASE-17092 Project: HBase

[jira] [Created] (HBASE-17091) IntegrationTestZKAndFSPermissions failed with 'KeeperException$NoNodeException'

2016-11-14 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-17091: - Summary: IntegrationTestZKAndFSPermissions failed with 'KeeperException$NoNodeException' Key: HBASE-17091 URL: https://issues.apache.org/jira/browse/HBASE-17091 Pr

Re: Please update your jenkins job configs ASAP

2016-11-14 Thread Jonathan Hsieh
Looks like our hbase 1.2 and 1.3[1] jobs seemed to be running ok with the Hadoop label, so I've updated the 1.4 [2] and master [3] jobs to use the Hadoop label as well. [1] https://builds.apache.org/job/HBase-1.3-JDK8/ [2] https://builds.apache.org/job/HBase-1.4/ [3] https://builds.apache.org/job/

[jira] [Created] (HBASE-17090) Procedure v2 - fast wake if nothing else is running

2016-11-14 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-17090: --- Summary: Procedure v2 - fast wake if nothing else is running Key: HBASE-17090 URL: https://issues.apache.org/jira/browse/HBASE-17090 Project: HBase Iss

Re: Coprocessor metrics

2016-11-14 Thread Enis Söztutar
Thanks everyone, this is really helpful. If we can leverage the work already Josh/Nick did in Avatica in HBase that will be really good. Seems that the consensus is to follow #2 approach, and pay the price at replicating the API layer in HBase for the convenience of coprocessors and not to tie our

Re: HBASE 2.0 release progress

2016-11-14 Thread Mikhail Antonov
Great to see progress here. As I'm reading through the list, here're some high-level questions I have: - Regarding the work on new AssignmentManager - any notes on perf/stability testing? Are you guys running tips of master branch through ITBLL setup? - Anyone (Ram, Anoop?) wants to post a hi

Re: Coprocessor metrics

2016-11-14 Thread Andrew Purtell
+1 We also need to get away from Guava's Service interface for replication endpoint plugins using this same approach (#2): HBASE-15982 On Mon, Nov 14, 2016 at 10:37 AM, Gary Helmling wrote: > > > > > > My current feeling is that external API should never include > > classes/interfaces which you

Re: Coprocessor metrics

2016-11-14 Thread Gary Helmling
> > > My current feeling is that external API should never include > classes/interfaces which you don't "own". Re-building the API that > already exists is pedantic, but I think it's a really good way to pay > down the maintenance debt (whenever the next metrics library "hotness" > takes off). > >

[jira] [Resolved] (HBASE-17089) Add doc on experience running with hedged reads

2016-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-17089. --- Resolution: Fixed Pushed doc change to master. > Add doc on experience running with hedged reads > -

[jira] [Created] (HBASE-17089) Add doc on experience running with hedged reads

2016-11-14 Thread stack (JIRA)
stack created HBASE-17089: - Summary: Add doc on experience running with hedged reads Key: HBASE-17089 URL: https://issues.apache.org/jira/browse/HBASE-17089 Project: HBase Issue Type: Sub-task

Re: Coprocessor metrics

2016-11-14 Thread Josh Elser
Yep -- see avatica-metrics[1], avatica-dropwizard-metrics3[2], and my dropwizard-hadoop-metrics2[3] project for what Nick is referring to. What I ended up doing in Calcite/Avatica was a step beyond your #3, Enis. Instead of choosing a subset of some standard metrics library to expose, I "re-bu

Successful: HBase Generate Website

2016-11-14 Thread Apache Jenkins Server
Build status: Successful If successful, the website and docs have been generated. To update the live site, follow the instructions below. If failed, skip to the bottom of this email. Use the following commands to download the patch and apply it to a clean branch based on origin/asf-site. If yo

[jira] [Created] (HBASE-17088) Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor

2016-11-14 Thread Guanghao Zhang (JIRA)
Guanghao Zhang created HBASE-17088: -- Summary: Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor Key: HBASE-17088 URL: https://issues.apache.org/jira/browse/HBASE-17088 Project: HBase