Re: [VOTE] HBase 1.2.0 RC1

2016-02-02 Thread Stack
It looks like balancer got stuck after Master joined running cluster (it had been killed by Monkey). We then log at a rate of about 10 lines per millisecond. HBASE-15207 St.Ack On Tue, Feb 2, 2016 at 9:51 AM, Stack wrote: > I've been running some cluster loadings on the RC.

[jira] [Created] (HBASE-15207) Stuck balancer; logging ten lines a millisecond

2016-02-02 Thread stack (JIRA)
stack created HBASE-15207: - Summary: Stuck balancer; logging ten lines a millisecond Key: HBASE-15207 URL: https://issues.apache.org/jira/browse/HBASE-15207 Project: HBase Issue Type: Bug

Re: DISCUSS: Protobufs?

2016-02-02 Thread Enis Söztutar
bq. java is second class in flatbuffers). This is an Android project, no? I thought Java is the primary target. On Tue, Feb 2, 2016 at 12:14 PM, Stack wrote: > On Tue, Feb 2, 2016 at 11:47 AM, Enis Söztutar wrote: > > > BTW, we should also be looking at

Re: DISCUSS: Protobufs?

2016-02-02 Thread Enis Söztutar
Google guys over at https://github.com/grpc/grpc-java/issues/1054#issuecomment-147295224 are saying that CIS changes may be coming to 2.x from what I understand. If so, our life would be easier. Even so, I'm 100% sure we have to do shading since Hadoop will not change it's PB dependency anytime

Re: DISCUSS: Protobufs?

2016-02-02 Thread Stack
On Tue, Feb 2, 2016 at 11:47 AM, Enis Söztutar wrote: > BTW, we should also be looking at https://google.github.io/flatbuffers/ or > https://capnproto.org/ for serialization as an option. The idea is to not > allocate objects and prevent allocations altogether. > > Agree

Re: DISCUSS: Protobufs?

2016-02-02 Thread Jean-Marc Spaggiari
My opinion: If this change allows to reduce GC challenges (so more memory can be allocated to the heap) and increases the performance, this might be managable... 2016-02-02 14:47 GMT-05:00 Enis Söztutar : > BTW, we should also be looking at

[jira] [Created] (HBASE-15206) Flakey testSplitDaughtersNotInMeta test

2016-02-02 Thread huaxiang sun (JIRA)
huaxiang sun created HBASE-15206: Summary: Flakey testSplitDaughtersNotInMeta test Key: HBASE-15206 URL: https://issues.apache.org/jira/browse/HBASE-15206 Project: HBase Issue Type: Bug

Re: DISCUSS: Protobufs?

2016-02-02 Thread Stack
On Tue, Feb 2, 2016 at 11:41 AM, Enis Söztutar wrote: > Google guys over at > https://github.com/grpc/grpc-java/issues/1054#issuecomment-147295224 are > saying that CIS changes may be coming to 2.x from what I understand. I read 'master' as PB3 (Will ask up in issue). We'd

Re: DISCUSS: Protobufs?

2016-02-02 Thread Elliott Clark
It looks like flatbuffers breaks binary compat. If we are breaking binary compat then we can look at things other than protobuf descendants. On Tue, Feb 2, 2016 at 1:14 PM, Stack wrote: > On Tue, Feb 2, 2016 at 12:16 PM, Enis Söztutar wrote: > > > bq. java

Re: DISCUSS: Protobufs?

2016-02-02 Thread Enis Söztutar
Great. I'll be happy to help / take on the work. Enis On Tue, Feb 2, 2016 at 1:58 PM, Stack wrote: > Looks like the boys from pb are doing COS only, not CIS, and suggest pull > request. I'll have a go unless someone else wants to. > St.Ack > > On Tue, Feb 2, 2016 at 11:41 AM,

Re: DISCUSS: Protobufs?

2016-02-02 Thread Stack
Looks like the boys from pb are doing COS only, not CIS, and suggest pull request. I'll have a go unless someone else wants to. St.Ack On Tue, Feb 2, 2016 at 11:41 AM, Enis Söztutar wrote: > Google guys over at >

Re: DISCUSS: Protobufs?

2016-02-02 Thread Stack
On Tue, Feb 2, 2016 at 12:16 PM, Enis Söztutar wrote: > bq. java is second class in flatbuffers). > This is an Android project, no? I thought Java is the primary target. > > I was looking at this Enis: https://google.github.io/flatbuffers/flatbuffers_support.html St.Ack >

Re: DISCUSS: Protobufs?

2016-02-02 Thread Vladimir Rodionov
like flatbuffers. -Vlad On Tue, Feb 2, 2016 at 2:04 PM, Enis Söztutar wrote: > Great. I'll be happy to help / take on the work. > > Enis > > On Tue, Feb 2, 2016 at 1:58 PM, Stack wrote: > > > Looks like the boys from pb are doing COS only, not CIS, and

Re: DISCUSS: Protobufs?

2016-02-02 Thread Andrew Purtell
I remember talking over capn proto with Stack and a few others a while ago, when it first got underway. Over the intervening time I think we have seen that Java support is a second or third order concern for them at best. I think the most important factor is getting away from copying. Whatever

[jira] [Created] (HBASE-15208) AsyncProcess seems to rely on regionId() to be unique which is not

2016-02-02 Thread Matteo Bertozzi (JIRA)
Matteo Bertozzi created HBASE-15208: --- Summary: AsyncProcess seems to rely on regionId() to be unique which is not Key: HBASE-15208 URL: https://issues.apache.org/jira/browse/HBASE-15208 Project:

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.7,yahoo-not-h2 #674

2016-02-02 Thread Stack
These tests usually pass. Failure is rare. Keeping an eye on them. St.Ack On Tue, Feb 2, 2016 at 3:36 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-Trunk_matrix/jdk=latest1.7,label=yahoo-not-h2/674/changes > > > > Changes: > > [tedyu]

Re: integration with HDFS centralized caching

2016-02-02 Thread Stack
On Tue, Feb 2, 2016 at 6:03 PM, Jesse Yates wrote: > Hey all, > > I poked around a bit in the archives and in JIRA (as well as random > googling) but couldn't seem to find anything about any integration HBase is > doing with the "new" centralized caching in HDFS >

Re: DISCUSS: Protobufs?

2016-02-02 Thread Enis Söztutar
BTW, we should also be looking at https://google.github.io/flatbuffers/ or https://capnproto.org/ for serialization as an option. The idea is to not allocate objects and prevent allocations altogether. We are allocating PB objects for every Get / Put, then we allocate our Get / Put objects. At

[jira] [Created] (HBASE-15204) Try to estimate the cell count for adding into WALEdit

2016-02-02 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-15204: -- Summary: Try to estimate the cell count for adding into WALEdit Key: HBASE-15204 URL: https://issues.apache.org/jira/browse/HBASE-15204 Project:

[jira] [Created] (HBASE-15205) Do not find the replication scope for every WAL#append()

2016-02-02 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-15205: -- Summary: Do not find the replication scope for every WAL#append() Key: HBASE-15205 URL: https://issues.apache.org/jira/browse/HBASE-15205 Project:

Re: DISCUSS: Protobufs?

2016-02-02 Thread Stack
Thanks Duo. If proto3 had what we wanted, you are suggesting we might move to proto3 setting it to do proto2 support and shade it so we don't clash with other includes of pb? Regards Anoop comment, the note on the end of this issue looks promising but I don't know when it'd see the light of day:

Successful: HBase Generate Website

2016-02-02 Thread Apache Jenkins Server
Build status: Successful If successful, the website and docs have been generated. If failed, skip to the bottom of this email. Use the following commands to download the patch and apply it to a clean branch based on origin/asf-site. If you prefer to keep the hbase-site repo around

Re: [VOTE] HBase 1.2.0 RC1

2016-02-02 Thread Stack
I've been running some cluster loadings on the RC. Last night my logs filled with this (10x256MB log files): 2016-02-01 11:25:26,958 DEBUG [B.defaultRpcServer.handler=9,queue=0,port=16000] balancer.BaseLoadBalancer: Lowest locality region server with non zero regions is

[jira] [Created] (HBASE-15210) Undo crazy load balancer logging at tens of lines per millisecond

2016-02-02 Thread stack (JIRA)
stack created HBASE-15210: - Summary: Undo crazy load balancer logging at tens of lines per millisecond Key: HBASE-15210 URL: https://issues.apache.org/jira/browse/HBASE-15210 Project: HBase Issue

integration with HDFS centralized caching

2016-02-02 Thread Jesse Yates
Hey all, I poked around a bit in the archives and in JIRA (as well as random googling) but couldn't seem to find anything about any integration HBase is doing with the "new" centralized caching in HDFS . I was thinking something like integrating

[jira] [Created] (HBASE-15209) disable table in HBaseTestingUtility.truncateTable

2016-02-02 Thread Appy (JIRA)
Appy created HBASE-15209: Summary: disable table in HBaseTestingUtility.truncateTable Key: HBASE-15209 URL: https://issues.apache.org/jira/browse/HBASE-15209 Project: HBase Issue Type: Bug

Re: DISCUSS: Protobufs?

2016-02-02 Thread 张铎
Since they already implement an unsafeWrap method which breaks immutability so add DBB support for CIS does not break anything else. I think it is easy to make the google guys accept the PR. Let's do it :) 2016-02-03 5:58 GMT+08:00 Stack : > Looks like the boys from pb are