[ANNOUNCE] New HBase committer Lars Francke

2017-10-25 Thread Lars George
On behalf of the Apache HBase PMC, I am pleased to announce that Lars Francke has accepted the PMC's invitation to become a committer on the project. We appreciate all of Lars' great work thus far and look forward to continued involvement. Please join me in congratulating LarsF! (Opting to use la

HBase Backup Mode

2017-09-01 Thread Lars George
Hi, I stumbled across this: hbase-server/src/main/java/org/apache/hadoop/hbase/backup/example/HFileArchiveManager.java I am wondering what the state of this is. Also, why is this in an _example_ package, if it is usable code. Should be in `util` or so instead? If it isn't really used at all or ju

Max queue size in replication

2017-08-25 Thread Lars George
Hi, I am looking at the replication code, and it has this line: this.queueSizePerGroup = this.conf.getInt("hbase.regionserver.maxlogs", 32); This drives the queue size accepting more WAL files. But we have a different computation now, using the heap size instead, so often have a maxlogs > 32 in

Re: Tags class using wrong length?

2017-08-06 Thread Lars George
; + >>> MAX_TAG_LENGTH); >>>} >>>length = TAG_LENGTH_SIZE + tagLength; >>>bytes = new byte[length]; >>>int pos = Bytes.putAsShort(bytes, 0, tagLength); >>>pos = Bytes.putByte(bytes, pos, tagType); >>>Bytes.putByt

Re: Tags class using wrong length?

2017-08-06 Thread Lars George
|tag type(1 byte)|tag| > > It seems to me that the "bytes[offset + TYPE_LENGTH_SIZE]" is correct. > > On 2017-08-06 16:35, Lars George wrote: >> Hi, >> >> I found this reading through tags in 1.3, but checked in trunk as >> well. There is this code: >> >>

Re: Bug in FIFOCompactionPolicy pre-checks?

2017-08-06 Thread Lars George
Cool, thanks Vlad. Filed https://issues.apache.org/jira/browse/HBASE-18526 On Fri, Aug 4, 2017 at 7:53 PM, Vladimir Rodionov wrote: > Yes, file a JIRA, Lars > > I will take a look > > -Vlad > > > On Thu, Aug 3, 2017 at 11:41 PM, Lars George wrote: > >> Hi, &g

[jira] [Created] (HBASE-18526) FIFOCompactionPolicy pre-check uses wrong scope

2017-08-06 Thread Lars George (JIRA)
Lars George created HBASE-18526: --- Summary: FIFOCompactionPolicy pre-check uses wrong scope Key: HBASE-18526 URL: https://issues.apache.org/jira/browse/HBASE-18526 Project: HBase Issue Type

Tags class using wrong length?

2017-08-06 Thread Lars George
Hi, I found this reading through tags in 1.3, but checked in trunk as well. There is this code: public ArrayBackedTag(byte[] bytes, int offset, int length) { if (length > MAX_TAG_LENGTH) { throw new IllegalArgumentException( "Invalid tag data being passed. Its length can not

Bug in FIFOCompactionPolicy pre-checks?

2017-08-03 Thread Lars George
Hi, See https://issues.apache.org/jira/browse/HBASE-14468 It adds this check to {{HMaster.checkCompactionPolicy()}}: {code} // 1. Check TTL if (hcd.getTimeToLive() == HColumnDescriptor.DEFAULT_TTL) { message = "Default TTL is not supported for FIFO compaction"; throw new IOException(message)

[jira] [Created] (HBASE-18473) VC.listLabels() erroneously closes any connection

2017-07-28 Thread Lars George (JIRA)
Lars George created HBASE-18473: --- Summary: VC.listLabels() erroneously closes any connection Key: HBASE-18473 URL: https://issues.apache.org/jira/browse/HBASE-18473 Project: HBase Issue Type

Re: user_permission output

2017-07-25 Thread Lars George
OK, found that no parameter is treated as asking for the ACLs table. Maybe the shell command should say so? Just a minor nit though, there are bigger tofu blocks to fry. Sent from my iPhone > On 21. Jul 2017, at 13:33, Lars George wrote: > > Hi, > > I am runn

Re: Ident String

2017-07-25 Thread Lars George
Don't think it is necessary, does not to any harm. Sent from my iPhone > On 21. Jul 2017, at 00:10, Stack wrote: > >> On Thu, Jul 20, 2017 at 9:20 PM, Lars George wrote: >> >> Ah ok, I missed that HBASE_IDENT_STR is used to personalize the log and >> pid f

HBASE-11344

2017-07-24 Thread Lars George
Hi, I was looking at https://issues.apache.org/jira/browse/HBASE-11344 which in JIRA is flagged as 0.99 and 2.0. The comments talk about 0.98 and also 1.x. But looking at the commit logs, I cannot see this apart from 2.0. Has this never been committed anywhere else? Should the JIRA be adjusted, or

user_permission output

2017-07-21 Thread Lars George
Hi, I am running the shell's "user_permission" command without any parameter, and with a ".*" wildcard epxression and get two different results back: hbase(main):003:0> user_permission User Namespace,Table,Family,Qualifier:Permission hbasebook hbase,hbase:acl,,:

Re: Ident String

2017-07-20 Thread Lars George
case. Cheers, Lars Sent from my iPad > On 19. Jul 2017, at 22:42, Lars George wrote: > > It dates back to Hadoop: > > https://github.com/apache/hbase/commit/24b065cc91f7bcdab25fc3634699657ac2f27104 > > See this > https://github.com/apache/hadoop/blame/trunk/hadoop-comm

Re: Ident String

2017-07-19 Thread Lars George
hbase master process listing, you'll find this in the long line...: > -Dproc_master > > Etc: > > -Dproc_zookeeper > > -Dproc_resourcemanager > > St.Ack > > >> On Fri, Jul 14, 2017 at 11:55 AM, Lars George wrote: >> >> Hi, >>

Re: Ident String

2017-07-19 Thread Lars George
l find this in the long line...: > -Dproc_master > > Etc: > > -Dproc_zookeeper > > -Dproc_resourcemanager > > St.Ack > > >> On Fri, Jul 14, 2017 at 11:55 AM, Lars George wrote: >> >> Hi, >> >> Was coming across `HBASE_IDENT_STR`

Re: Ident String

2017-07-16 Thread Lars George
Bueller? Anyone? :) On Fri, Jul 14, 2017 at 12:55 PM, Lars George wrote: > Hi, > > Was coming across `HBASE_IDENT_STR` (in hbase-env.sh) which sets > `hbase.id.str` as a command line parameter to the daemon. But I cannot > find where that is used. Could someone point me in the ri

Re: RegionServer info page content

2017-07-16 Thread Lars George
I created https://issues.apache.org/jira/browse/HBASE-18388 On Fri, Jul 14, 2017 at 11:12 PM, Jean-Marc Spaggiari wrote: > Good to know, thanks for the details ;) > > JM > > 2017-07-14 16:51 GMT-04:00 Lars George : > >> Hey JM, >> >> It is not a "random

[jira] [Created] (HBASE-18388) Fix description on region page, explaining what a region name is made of

2017-07-16 Thread Lars George (JIRA)
Lars George created HBASE-18388: --- Summary: Fix description on region page, explaining what a region name is made of Key: HBASE-18388 URL: https://issues.apache.org/jira/browse/HBASE-18388 Project

[jira] [Created] (HBASE-18387) [Thrift] Make principal configurable in DemoClient.java

2017-07-16 Thread Lars George (JIRA)
Lars George created HBASE-18387: --- Summary: [Thrift] Make principal configurable in DemoClient.java Key: HBASE-18387 URL: https://issues.apache.org/jira/browse/HBASE-18387 Project: HBase Issue

Re: RegionServer info page content

2017-07-14 Thread Lars George
s wrong :( Can you provide more dtails? > > JMS > > 2017-07-14 11:33 GMT-04:00 Lars George : > >> Hi, >> >> On the RS status page it has this: >> >> "Region names are made of the containing table's name, a comma, the >> start key,

RegionServer info page content

2017-07-14 Thread Lars George
Hi, On the RS status page it has this: "Region names are made of the containing table's name, a comma, the start key, a comma, and a randomly generated region id. To illustrate, the region named domains,apache.org,5464829424211263407 is party to the table domains, has an id of 5464829424211263407

[jira] [Created] (HBASE-18382) [Thrift] Add transport type info to info server

2017-07-14 Thread Lars George (JIRA)
Lars George created HBASE-18382: --- Summary: [Thrift] Add transport type info to info server Key: HBASE-18382 URL: https://issues.apache.org/jira/browse/HBASE-18382 Project: HBase Issue Type

Ident String

2017-07-14 Thread Lars George
Hi, Was coming across `HBASE_IDENT_STR` (in hbase-env.sh) which sets `hbase.id.str` as a command line parameter to the daemon. But I cannot find where that is used. Could someone point me in the right direction? Cheers, Lars

Service-level AuthZ

2017-04-14 Thread Lars George
Hi, We have SLAs, implementing the Hadoop classes, in HBase that allow to grant or revoke global access to RPC services. What we do _not_ have is the matching `refreshServiceAcl` method, including the wiring into the shell script to trigger it. Is there a reason why? Should we not have the same to

Re: Assigning regions after restart

2017-03-16 Thread Lars George
gt; doing a recovery or not has been there a long time so yeah, a single server > recovery could throw us off, but you make a practical point, that one > server should not destroy locality over the cluster. > > St.Ack > > On Tue, Mar 14, 2017 at 7:09 AM, Lars George wrote: > &g

[jira] [Created] (HBASE-17791) Locality should not be affected for non-faulty region servers at startup

2017-03-15 Thread Lars George (JIRA)
Lars George created HBASE-17791: --- Summary: Locality should not be affected for non-faulty region servers at startup Key: HBASE-17791 URL: https://issues.apache.org/jira/browse/HBASE-17791 Project

Re: Assigning regions after restart

2017-03-14 Thread Lars George
PM, Lars George wrote: > Doh, https://issues.apache.org/jira/browse/HBASE-15251 addresses this > (though I am not sure exactly how, see below). This should be > backported to all 1.x branches! > > As for the patch, I see this > > if (!failover) { >

[jira] [Resolved] (HBASE-14129) If any regionserver gets shutdown uncleanly during full cluster restart, locality looks to be lost

2017-03-14 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George resolved HBASE-14129. - Resolution: Won't Fix Closing as "won't fix" as the hardcoded flag is too in

Re: Assigning regions after restart

2017-03-14 Thread Lars George
n. On Tue, Mar 14, 2017 at 1:54 PM, Lars George wrote: > Hi, > > I had this happened at multiple clusters recently where after the > restart the locality dropped from close to or exactly 100% down to > single digits. The reason is that all regions were completely shuffled >

Assigning regions after restart

2017-03-14 Thread Lars George
Hi, I had this happened at multiple clusters recently where after the restart the locality dropped from close to or exactly 100% down to single digits. The reason is that all regions were completely shuffled and reassigned to random servers. Upon reading the (yet again non-trivial) assignment code

Re: Assigning regions after restart

2017-03-14 Thread Lars George
lly reassigning the user regions. I would have assumed the "assignAllUserRegions()" would have to be called. On Tue, Mar 14, 2017 at 2:21 PM, Lars George wrote: > Looking at the code more... it seems the issue is here > > In AssignmentManager.processDeadServersAndRegionsInTransiti

[jira] [Created] (HBASE-17774) Improve locality info in table details page

2017-03-12 Thread Lars George (JIRA)
Lars George created HBASE-17774: --- Summary: Improve locality info in table details page Key: HBASE-17774 URL: https://issues.apache.org/jira/browse/HBASE-17774 Project: HBase Issue Type

Re: HDFS Balancer

2017-03-10 Thread Lars George
o that one. >> >> Stumbled on this email when searching some follow-throughs, thought I'd >> drop a note. >> >> On Tue, 7 Mar 2017 at 20:18 Ted Yu wrote: >> >> > bq. how that - apparently wrong - information came about >> > >> > Ma

[jira] [Resolved] (HBASE-17635) enable_table_replication script cannot handle replication scope

2017-03-07 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George resolved HBASE-17635. - Resolution: Duplicate Sorry, this was opened just a few weeks earlier in HBASE-17460, closing

Re: HDFS Balancer

2017-03-07 Thread Lars George
ASE-15332 Document how to take advantage of HDFS-6133 in HBase > >> On Mon, Mar 6, 2017 at 6:38 PM, Lars George wrote: >> >> Hi, >> >> I am trying to grok what came out of all these issues about the HDFS >> balancer and being able to avoid it destroying HBase

HDFS Balancer

2017-03-06 Thread Lars George
Hi, I am trying to grok what came out of all these issues about the HDFS balancer and being able to avoid it destroying HBase locality. There is this https://issues.apache.org/jira/browse/HBASE-13021 from JM, and the book http://hbase.apache.org/book.html#_hbase_and_hdfs refers to https://issues.a

Client SSL Authentication

2017-02-27 Thread Lars George
Hi, We have support for two-way authentication over TLS in the HttpServer class, but never use it, nor have a config property that could set it. Hadoop has the same option but exposes it via config. Should we not do the same? Lars

[jira] [Created] (HBASE-17636) Fix speling [sic] error in enable replication script output

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17636: --- Summary: Fix speling [sic] error in enable replication script output Key: HBASE-17636 URL: https://issues.apache.org/jira/browse/HBASE-17636 Project: HBase

[jira] [Created] (HBASE-17635) enable_table_replication script cannot handle replication scope

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17635: --- Summary: enable_table_replication script cannot handle replication scope Key: HBASE-17635 URL: https://issues.apache.org/jira/browse/HBASE-17635 Project: HBase

[jira] [Created] (HBASE-17632) Modify example health script to work on CentOS 6 etc.

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17632: --- Summary: Modify example health script to work on CentOS 6 etc. Key: HBASE-17632 URL: https://issues.apache.org/jira/browse/HBASE-17632 Project: HBase Issue

[jira] [Created] (HBASE-17631) Canary interval too low

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17631: --- Summary: Canary interval too low Key: HBASE-17631 URL: https://issues.apache.org/jira/browse/HBASE-17631 Project: HBase Issue Type: Bug Components

[jira] [Created] (HBASE-17630) Health Script not shutting down server process with certain script behavior

2017-02-11 Thread Lars George (JIRA)
Lars George created HBASE-17630: --- Summary: Health Script not shutting down server process with certain script behavior Key: HBASE-17630 URL: https://issues.apache.org/jira/browse/HBASE-17630 Project

Re: Health Script does not stop region server

2017-02-11 Thread Lars George
Will do, thanks On Sun, Feb 5, 2017 at 3:57 PM, Ted Yu wrote: > Yesterday I tried snmpwalk on CentOS as well - same behavior. > > Lars: > Can you file a JIRA to fix the bug ? > > Thanks > > On Sun, Feb 5, 2017 at 2:22 AM, Lars George wrote: > >> Hi Ted, &

Re: Canary Test Tool and write sniffing

2017-02-11 Thread Lars George
10:38 PM, Enis Söztutar wrote: > Open an issue? > Enis > > On Mon, Feb 6, 2017 at 9:39 AM, Stack wrote: > >> On Sun, Feb 5, 2017 at 2:25 AM, Lars George wrote: >> >> > The next example is wrong too, claiming to show 60 secs, while it >> > shows 600 se

Re: Canary Test Tool and write sniffing

2017-02-05 Thread Lars George
BTW There was a mismatch in the description for this command: (5 seconds > vs. 5 milliseconds) > > ${HBASE_HOME}/bin/hbase canary -daemon -interval 5 -f false > > > On Sat, Feb 4, 2017 at 8:21 AM, Lars George wrote: > >> Oh right, Ted. An earlier patch attache

Re: Health Script does not stop region server

2017-02-05 Thread Lars George
t if > Timeout: No Response from localhost > $ echo $? > 1 > > Looks like the script should parse the output from snmpwalk and provide > some hint if unexpected result is reported. > > Cheers > > On Sat, Feb 4, 2017 at 6:40 AM, Lars George wrote: > >> Hi, >

Re: Canary Test Tool and write sniffing

2017-02-04 Thread Lars George
> FYI > > On Sat, Feb 4, 2017 at 4:06 AM, Lars George wrote: > >> Also, the default interval used to be 60 secs, but is now 6 secs. Does >> that make sense? Seems awfully short for a default, assuming you have >> many regions or servers. >> >> On Sat, Feb 4

Health Script does not stop region server

2017-02-04 Thread Lars George
Hi, I tried the supplied `healthcheck.sh`, but did not have snmpd running. That caused the script to take a long time to error out, which exceed the 10 seconds the check was meant to run. That resets the check and it keeps reporting the error, but never stops the servers: 2017-02-04 05:55:08,962

Re: Canary Test Tool and write sniffing

2017-02-04 Thread Lars George
Also, the default interval used to be 60 secs, but is now 6 secs. Does that make sense? Seems awfully short for a default, assuming you have many regions or servers. On Sat, Feb 4, 2017 at 11:54 AM, Lars George wrote: > Hi, > > Looking at the Canary tool, it tries to ensure that all ca

Canary Test Tool and write sniffing

2017-02-04 Thread Lars George
Hi, Looking at the Canary tool, it tries to ensure that all canary test table regions are spread across all region servers. If that is not the case, it calls: if (numberOfCoveredServers < numberOfServers) { admin.balancer(); } I doubt this will help with the StochasticLoadBalancer, which is kn

Re: copy_table_desc.rb script

2017-02-03 Thread Lars George
se) >> >> JMS >> >> 2017-02-03 7:52 GMT-05:00 Lars George : >> >> > I have two local instances with two different ZK ports. Note that the >> > error occurs already at the first call to HAdmin in the script. >> > Replication works find

Re: copy_table_desc.rb script

2017-02-03 Thread Lars George
ter. > > Do you have two quorums running on the same machine ? > >> On Feb 3, 2017, at 3:05 AM, Lars George wrote: >> >> Hi, >> >> trying to run the `copy_table_desc.rb` script from the >> `bin/replication` directory gives this: >> >> ``` >&

copy_table_desc.rb script

2017-02-03 Thread Lars George
Hi, trying to run the `copy_table_desc.rb` script from the `bin/replication` directory gives this: ``` $ bin/hbase org.jruby.Main bin/replication/copy_tables_desc.rb localhost:2181:hbase localhost:2182:hbase-2 testtable4 ... NativeException: java.io.IOException: java.lang.reflect.InvocationTarget

Re: HBase Service Level Authorization

2017-01-24 Thread Lars George
to me. Maybe we can start the discussion there? Lars On Tue, Jan 24, 2017 at 8:36 AM, Lars George wrote: > Hi, > > Looking at our `PolicyProvider` implementation I see this: > > /** > * Implementation of secure Hadoop policy provider for mapping > * protocol interfaces to hbase-pol

HBase Service Level Authorization

2017-01-23 Thread Lars George
Hi, Looking at our `PolicyProvider` implementation I see this: /** * Implementation of secure Hadoop policy provider for mapping * protocol interfaces to hbase-policy.xml entries. */ @InterfaceAudience.Private public class HBasePolicyProvider extends PolicyProvider { protected final static S

Re: Merge and HMerge

2017-01-14 Thread Lars George
;>> email too). >>>>> It would make perfect sense if it was a tool or was being referenced >>> from >>>>> somewhere, but with lack of either of that, am a bit confused here. >>>>> @Enis, you seem to know everything about them, please educate me

Draining mode and graceful decommissioning

2017-01-01 Thread Lars George
Hi, This is along the lines of https://issues.apache.org/jira/browse/HBASE-10367 Since we have draining mode, should we not in the meantime at least replace the balancer stop/start step in graceful_stop.sh with simply setting the draining mode for the server? This would less impact any other bala

[jira] [Created] (HBASE-17399) region_mover.rb uses different default filename, also needs slight change

2016-12-31 Thread Lars George (JIRA)
Lars George created HBASE-17399: --- Summary: region_mover.rb uses different default filename, also needs slight change Key: HBASE-17399 URL: https://issues.apache.org/jira/browse/HBASE-17399 Project

Re: update_all_config and masters

2016-12-29 Thread Lars George
I also added this for convenience: https://issues.apache.org/jira/browse/HBASE-17391 On Thu, Dec 29, 2016 at 4:32 PM, Lars George wrote: > Done: https://issues.apache.org/jira/browse/HBASE-17390 > > > > On Thu, Dec 29, 2016 at 4:05 PM, Ted Yu wrote: >> Good finding. &g

[jira] [Created] (HBASE-17391) [Shell] Add shell command to get list of servers, with filters

2016-12-29 Thread Lars George (JIRA)
Lars George created HBASE-17391: --- Summary: [Shell] Add shell command to get list of servers, with filters Key: HBASE-17391 URL: https://issues.apache.org/jira/browse/HBASE-17391 Project: HBase

[jira] [Created] (HBASE-17390) Online update of configuration for all servers leaves out masters

2016-12-29 Thread Lars George (JIRA)
Lars George created HBASE-17390: --- Summary: Online update of configuration for all servers leaves out masters Key: HBASE-17390 URL: https://issues.apache.org/jira/browse/HBASE-17390 Project: HBase

Re: update_all_config and masters

2016-12-29 Thread Lars George
n Thu, Dec 29, 2016 at 6:46 AM, Lars George wrote: > >> Hi, >> >> It seems that the update command is only iterating over the region servers: >> >> public void updateConfiguration() throws IOException { >> for (ServerName server : this.ge

update_all_config and masters

2016-12-29 Thread Lars George
Hi, It seems that the update command is only iterating over the region servers: public void updateConfiguration() throws IOException { for (ServerName server : this.getClusterStatus().getServers()) { updateConfiguration(server); } } This leaves out the masters, which you have to trigger

Status of HBASE-4755?

2016-11-09 Thread Lars George
Hi, I am wondering where https://issues.apache.org/jira/browse/HBASE-4755 is up to? Seeing this lasting many years now, why is it not closed? It seems the balancer is in place. What worries me is that the tool to recompute a missing region server location after a failover is having a comment like

Re: Balancer Cutoff

2016-11-09 Thread Lars George
ts again due to the chore firing. In the end, we continuously rearrange the cluster, no? On Wed, Nov 9, 2016 at 11:14 AM, Lars George wrote: > Hi, > > In HMaster.java we have this code (added, mostly, in HBASE-3422): > > private int getBalancerCutoffTime() { > int balancerCu

Balancer Cutoff

2016-11-09 Thread Lars George
Hi, In HMaster.java we have this code (added, mostly, in HBASE-3422): private int getBalancerCutoffTime() { int balancerCutoffTime = getConfiguration().getInt("hbase.balancer.max.balancing", -1); if (balancerCutoffTime == -1) { // No time period set so create one int balancerPerio

[jira] [Created] (HBASE-16815) Low scan ratio in RPC queue tuning triggers divide by zero exception

2016-10-12 Thread Lars George (JIRA)
Lars George created HBASE-16815: --- Summary: Low scan ratio in RPC queue tuning triggers divide by zero exception Key: HBASE-16815 URL: https://issues.apache.org/jira/browse/HBASE-16815 Project: HBase

Re: Merge and HMerge

2016-09-28 Thread Lars George
Just to save you from searching: https://issues.apache.org/jira/browse/HBASE-8219?focusedCommentId=13617529&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13617529 No one replied to Enis it seems? On Wed, Sep 28, 2016 at 4:32 PM, Lars George wrote: &

Re: Merge and HMerge

2016-09-28 Thread Lars George
e redone too (they are often >> first thing broke when major change and putting them back together is >> a headache since they do not follow the usual pattern). >> >> St.Ack >> >> On Sun, Jul 3, 2011 at 12:38 AM, Lars George >> wrote: >> > Hi Ted, &

Re: DiffKeyDeltaEncoder not fully efficient?

2016-09-19 Thread Lars George
ore efficient to > store the diff: > > if (diffTimestampFitsInBytes < timestampFitsInBytes) { > > flag |= (diffTimestampFitsInBytes - 1) << SHIFT_TIMESTAMP_LENGTH; > > flag |= FLAG_TIMESTAMP_IS_DIFF; > > This should achieve good efficienc

DiffKeyDeltaEncoder not fully efficient?

2016-09-18 Thread Lars George
Hi, Reading the key encoder code and noticed this in the DiffKeyDeltaEncoder: if ((flag & FLAG_TIMESTAMP_IS_DIFF) == 0) { ByteBufferUtils.putLong(out, timestamp, timestampFitsInBytes); } else { ByteBufferUtils.putLong(out, diffTimestamp, diffTimestampFitsInBytes); } So if the timestamp is th

Re: hbase:meta blocks in L1?

2016-07-15 Thread Lars George
gt;> > >> > Do you want to log a JIRA ? >> > >> > I checked HTableDescriptor.java in branch-1.1 to branch-1 where >> > setCacheDataInL1(true) is missing. >> > >> > The fix would be a one line change. >> > >> > On Thu, Jul

Re: hbase:meta blocks in L1?

2016-07-14 Thread Lars George
tor() , both column > families have the following: > > .setCacheDataInL1(true), > > Is there something else you were looking for ? > > Cheers > > On Thu, Jul 14, 2016 at 6:59 AM, Lars George wrote: > >> Hey, >> >> HBASE-11364 did add

hbase:meta blocks in L1?

2016-07-14 Thread Lars George
Hey, HBASE-11364 did add `.setCacheDataInL1(true)`, but the later change to use `HTableDescriptor.metaTableDescriptor()` changes the layout of the `hbase:meta` to omit the L1 cache setting. Is this on purpose or an oversight? In other words, are the meta blocks currently never cached in L1? Lars

Cache features in shell missing?

2016-07-14 Thread Lars George
Hi, Looking at `CacheConfig` and noticed that `CACHE_DATA_BLOCKS_COMPRESSED_KEY` and `DROP_BEHIND_CACHE_COMPACTION_KEY` both have no equivalent in `HColumnDescriptor` and hence cannot be set from the Shell or admin API. Is that not an oversight? Should we add this? Lars

[jira] [Resolved] (HBASE-13928) Correct doc bug introduced in HBASE-11735

2016-07-11 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George resolved HBASE-13928. - Resolution: Duplicate Was fixed in HBASE-15528. > Correct doc bug introduced in HBASE-11

[jira] [Reopened] (HBASE-13928) Correct doc bug introduced in HBASE-11735

2016-07-11 Thread Lars George (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars George reopened HBASE-13928: - [~gsbiju] is right, the added {{hbase-default.xml}} key is wrong, and never used. It is missing the

[jira] [Created] (HBASE-16188) Add EventCounter information to log4j properties file

2016-07-06 Thread Lars George (JIRA)
Lars George created HBASE-16188: --- Summary: Add EventCounter information to log4j properties file Key: HBASE-16188 URL: https://issues.apache.org/jira/browse/HBASE-16188 Project: HBase Issue

[jira] [Created] (HBASE-16187) Fix typo in blog post for metrics2

2016-07-06 Thread Lars George (JIRA)
Lars George created HBASE-16187: --- Summary: Fix typo in blog post for metrics2 Key: HBASE-16187 URL: https://issues.apache.org/jira/browse/HBASE-16187 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-16186) Fix AssignmentManager MBean name

2016-07-06 Thread Lars George (JIRA)
Lars George created HBASE-16186: --- Summary: Fix AssignmentManager MBean name Key: HBASE-16186 URL: https://issues.apache.org/jira/browse/HBASE-16186 Project: HBase Issue Type: Bug

Re: MutableQuantiles

2016-06-21 Thread Lars George
of hadoop's > classes) have been removed. They are no longer used. However the ones > hadoop supplies were very slow so instead we use MutableHistogram. > > See: HBASE-15222 > > On Mon, Jun 20, 2016 at 5:19 AM, Lars George wrote: > >> BTW, I am looking at 1.2 bran

Re: MutableQuantiles

2016-06-20 Thread Lars George
BTW, I am looking at 1.2 branch, though here the Hadoop one does exactly the same as what the HBase one does. Where do I see the difference? Master looks the same too. Are you referring to the histogram classes? On Mon, Jun 20, 2016 at 1:36 PM, Lars George wrote: > Ah thanks Andy. It see

Re: MutableQuantiles

2016-06-20 Thread Lars George
bucket rather than > percentile measures at the moment. The former can be used to calculate > mathematically meaningful percentile measures over the whole fleet and over > longer timescales, the latter cannot. > > >> On Jun 19, 2016, at 9:36 AM, Lars George wrote: &

MutableQuantiles

2016-06-19 Thread Lars George
Hi, As per https://issues.apache.org/jira/browse/HBASE-6409 we rolled our own class. Is that still needed? Since 2012 lot's has changed and we should have all in place to use the Hadoop supplied one? Just curious. Cheers, Lars

[jira] [Created] (HBASE-15445) Add support for ACLs for web based UIs

2016-03-10 Thread Lars George (JIRA)
Lars George created HBASE-15445: --- Summary: Add support for ACLs for web based UIs Key: HBASE-15445 URL: https://issues.apache.org/jira/browse/HBASE-15445 Project: HBase Issue Type: Bug

Re: Where to set UI ACLs?

2016-03-10 Thread Lars George
l for the UIs > before. IMHO, they are inherently unsafe except for operator use ("no user > serviceable parts inside") so random folks should not be given network > paths to them. > > On Wed, Mar 9, 2016 at 5:31 AM, Lars George wrote: > >> Hi, >> >> Readi

Where to set UI ACLs?

2016-03-09 Thread Lars George
Hi, Reading the whole HttpServer code base, and while this is a copy it seems from HttpServer2, including the ability to set ACLs with users who are allowed to access (admins), I cannot see this ever being set. Am I missing something, or is there a JIRA documenting that this needs adding? Thanks,

[jira] [Created] (HBASE-15098) Normalizer switch in configuration is not used

2016-01-13 Thread Lars George (JIRA)
Lars George created HBASE-15098: --- Summary: Normalizer switch in configuration is not used Key: HBASE-15098 URL: https://issues.apache.org/jira/browse/HBASE-15098 Project: HBase Issue Type: Bug

Re: Normalizer in 1.2+?

2016-01-13 Thread Lars George
t; try { > > // if data in ZK is null, use default of on. > > return upData == null || parseFrom(upData).getNormalizerOn(); > > So I guess the config parameter hbase.normalizer.enabled can be dropped. > > > Cheers > > On Wed, Jan 13, 2016 at 3:01

Normalizer in 1.2+?

2016-01-13 Thread Lars George
Hi, Just looking through the new properties and seeing this hbase.normalizer.enabled false If set to true, Master will try to keep region size within each table approximately the same. Searching both branches 1.2 and master reveals it is only used in a test to enable it,

[jira] [Created] (HBASE-14864) Add support for bucketing of keys into client library

2015-11-20 Thread Lars George (JIRA)
Lars George created HBASE-14864: --- Summary: Add support for bucketing of keys into client library Key: HBASE-14864 URL: https://issues.apache.org/jira/browse/HBASE-14864 Project: HBase Issue

Re: Opinions wanted: new site skin

2015-10-23 Thread Lars George
Thanks Misty for working on this. I only had a chance to try on my iPhone, but there it looks a bit cramped :( Lars Sent from my iPhone > On 23 Oct 2015, at 07:17, Misty Stanley-Jones > wrote: > > Hi all, > > We are currently using the reFlow Maven site skin. I went looking around > and f

[jira] [Created] (HBASE-14556) Make prefetchOnOpen configurable for index and/or data blocks

2015-10-05 Thread Lars George (JIRA)
Lars George created HBASE-14556: --- Summary: Make prefetchOnOpen configurable for index and/or data blocks Key: HBASE-14556 URL: https://issues.apache.org/jira/browse/HBASE-14556 Project: HBase

[jira] [Created] (HBASE-14409) Clarify use of hbase.hstore.compaction.max.size in ExploringCompactionPolicy

2015-09-11 Thread Lars George (JIRA)
Lars George created HBASE-14409: --- Summary: Clarify use of hbase.hstore.compaction.max.size in ExploringCompactionPolicy Key: HBASE-14409 URL: https://issues.apache.org/jira/browse/HBASE-14409 Project

[jira] [Created] (HBASE-14367) Add normalization support to shell

2015-09-04 Thread Lars George (JIRA)
Lars George created HBASE-14367: --- Summary: Add normalization support to shell Key: HBASE-14367 URL: https://issues.apache.org/jira/browse/HBASE-14367 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-14343) Fix debug message in SimpleRegionNormalizer for small regions

2015-08-31 Thread Lars George (JIRA)
Lars George created HBASE-14343: --- Summary: Fix debug message in SimpleRegionNormalizer for small regions Key: HBASE-14343 URL: https://issues.apache.org/jira/browse/HBASE-14343 Project: HBase

[jira] [Created] (HBASE-14342) Recursive call in RegionMergeTransactionImpl.getJournal()

2015-08-31 Thread Lars George (JIRA)
Lars George created HBASE-14342: --- Summary: Recursive call in RegionMergeTransactionImpl.getJournal() Key: HBASE-14342 URL: https://issues.apache.org/jira/browse/HBASE-14342 Project: HBase

[jira] [Created] (HBASE-14287) Bootstrapping a cluster leaves temporary WAL directory laying around

2015-08-21 Thread Lars George (JIRA)
Lars George created HBASE-14287: --- Summary: Bootstrapping a cluster leaves temporary WAL directory laying around Key: HBASE-14287 URL: https://issues.apache.org/jira/browse/HBASE-14287 Project: HBase

  1   2   3   4   5   >