Re: [DISCUSS] What we expect in upgrades to HBase 2.0.0

2017-10-27 Thread Sean Busbey
I'd like to make downgrades a non-goal. I'd love us to support downgrades eventually, but that's a feature in its own right and I don't think we have time to get it done and still have a 2.0.0 GA in a reasonable time frame. On Fri, Oct 27, 2017 at 10:40 PM, Sean Busbey wrote:

[DISCUSS] What we expect in upgrades to HBase 2.0.0

2017-10-27 Thread Sean Busbey
A recent JIRA about our hfile format[1] has got me thinking about expectations for upgrading. The specifics of that JIRA aren't terribly important; it's the general issue I want to talk about. A simplification of the mismatch in expectations between two groups is that some folks place the bar for

Re: [ANNOUNCE] Please welcome new HBase committer Rahul Gidwani (churro)

2017-10-27 Thread Mike Drob
Welcome churro! On Fri, Oct 27, 2017 at 4:49 PM, Sukumar Maddineni < smaddin...@salesforce.com> wrote: > Congrats Rahul... > > On Fri, Oct 27, 2017 at 2:48 PM, Ted Yu wrote: > > > Congratulations, Rahul ! > > > > On Fri, Oct 27, 2017 at 2:44 PM, Andrew Purtell

Re: Moving 2.0 forward

2017-10-27 Thread Mike Drob
Josh - Do you want to kick off a bunch of QA runs? (Do you know how to do it directly on the jenkins job, so you don't have to bother with JIRA uploads) If you're busy, then I can make time tomorrow or Sunday to kick off jobs, but I want to make sure we're not duplicating effort and jenkins

Re: Struggles around Cell#getType()

2017-10-27 Thread Sergey Soldatov
bq. Here is the DataType I was talking about: Ah, thanks, Ted! Forgot to make the pull. According to the HBASE-18927 as well as the discussion that had a place before that, It addresses exactly the topic we are discussing. But actually, it didn't solve the problem and just created more ambiguity.

Re: Moving 2.0 forward

2017-10-27 Thread Josh Elser
My turn to bump ;) By my take: HBASE-18770 and HBASE-19092 are the only issues that remain needing some more work. The rest are just awaiting a good QA run. Unless I hear otherwise, I'll try to keep an eye on things over the weekend, bump them along as necessary, and get them committed.

[jira] [Created] (HBASE-19114) Split out o.a.h.h.zookeeper from hbase-server and hbase-client

2017-10-27 Thread Appy (JIRA)
Appy created HBASE-19114: Summary: Split out o.a.h.h.zookeeper from hbase-server and hbase-client Key: HBASE-19114 URL: https://issues.apache.org/jira/browse/HBASE-19114 Project: HBase Issue Type:

Re: Branch 1.4 update

2017-10-27 Thread Andrew Purtell
Please see HBASE-19099 ​ for the final round of compatibility discussion. Sean and I already had an exchange with a compatibility fixup resulting. ​HBASE-18993 needs someone else to step forward and agree to it. Otherwise I'd like the change held for further discussion, or at least excluded from

Re: [ANNOUNCE] Please welcome new HBase committer Rahul Gidwani (churro)

2017-10-27 Thread Sukumar Maddineni
Congrats Rahul... On Fri, Oct 27, 2017 at 2:48 PM, Ted Yu wrote: > Congratulations, Rahul ! > > On Fri, Oct 27, 2017 at 2:44 PM, Andrew Purtell > wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Rahul > > Gidwani has

Re: [ANNOUNCE] Please welcome new HBase committer Rahul Gidwani (churro)

2017-10-27 Thread Ted Yu
Congratulations, Rahul ! On Fri, Oct 27, 2017 at 2:44 PM, Andrew Purtell wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Rahul > Gidwani has accepted the PMC's invitation to become a committer on the > project. > > We appreciate all of Rahul's

[ANNOUNCE] Please welcome new HBase committer Rahul Gidwani (churro)

2017-10-27 Thread Andrew Purtell
On behalf of the Apache HBase PMC, I am pleased to announce that Rahul Gidwani has accepted the PMC's invitation to become a committer on the project. We appreciate all of Rahul's great work thus far and look forward to continued involvement. Please join me in congratulating Rahul! -- Best

[jira] [Created] (HBASE-19113) Restore dropped constants from TableInputFormatBase for compatability

2017-10-27 Thread Andrew Purtell (JIRA)
Andrew Purtell created HBASE-19113: -- Summary: Restore dropped constants from TableInputFormatBase for compatability Key: HBASE-19113 URL: https://issues.apache.org/jira/browse/HBASE-19113 Project:

Re: Struggles around Cell#getType()

2017-10-27 Thread Josh Elser
Filed the following and tentatively tagged them for beta-1 (sorry, I know that's crappy as these are API things): https://issues.apache.org/jira/browse/HBASE-19111 https://issues.apache.org/jira/browse/HBASE-19112 On 10/27/17 1:40 PM, Chia-Ping Tsai wrote: bq. You agree with Ram's suggestion

[jira] [Created] (HBASE-19112) Suspect methods on Cell to be deprecated

2017-10-27 Thread Josh Elser (JIRA)
Josh Elser created HBASE-19112: -- Summary: Suspect methods on Cell to be deprecated Key: HBASE-19112 URL: https://issues.apache.org/jira/browse/HBASE-19112 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-19111) Add missing CellUtil#isXXX(Cell) methods

2017-10-27 Thread Josh Elser (JIRA)
Josh Elser created HBASE-19111: -- Summary: Add missing CellUtil#isXXX(Cell) methods Key: HBASE-19111 URL: https://issues.apache.org/jira/browse/HBASE-19111 Project: HBase Issue Type: Bug

Re: Struggles around Cell#getType()

2017-10-27 Thread Chia-Ping Tsai
bq. You agree with Ram's suggestion for helper methods as a way forward? Adding the CellUtil#isPut() is ok to me as the PUT is a basic operation in hbase. On 2017-10-28 00:58, Josh Elser wrote: > Re-reading https://issues.apache.org/jira/browse/HBASE-8693 that Sergey >

Re: Struggles around Cell#getType()

2017-10-27 Thread Josh Elser
Re-reading https://issues.apache.org/jira/browse/HBASE-8693 that Sergey pointed out, I more think that the maybe getType() was misintepreted from what Nick originally meant it to be. Maybe intentional, maybe not. I don't think getTimestamp() should be removed -- when we store multiple

Re: Struggles around Cell#getType()

2017-10-27 Thread Josh Elser
Thanks, Ram and others. I think this also the same thing that Sergey is pointing out. I am trying to find something me understand where a Cell "came from" (Put, Delete, etc), but the only thing exposed to me is only somewhat related (DataType and KeyValue.Type have a relationship, but they're

[jira] [Created] (HBASE-19110) Add default for Server#isStopping

2017-10-27 Thread stack (JIRA)
stack created HBASE-19110: - Summary: Add default for Server#isStopping Key: HBASE-19110 URL: https://issues.apache.org/jira/browse/HBASE-19110 Project: HBase Issue Type: Bug Reporter:

Re: [ANNOUNCE] New HBase committer Lars Francke

2017-10-27 Thread Abhishek Singh Chouhan
Congrats Lars!! On Thu, Oct 26, 2017 at 1:57 AM Andrew Purtell wrote: > Congratulations and welcome! > > > On Wed, Oct 25, 2017 at 12:56 PM, Lars George > wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Lars > > Francke

Re: [ANNOUNCE] New HBase Committer Jan Hentschel

2017-10-27 Thread Chia-Ping Tsai
welcome to hbase, Jan! On 2017-10-27 06:39, Stack wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Jan > Hentschel has accepted the PMC's invitation to become a committer on > the project. > > We appreciate all of Jan' great work thus far and look

Re: Struggles around Cell#getType()

2017-10-27 Thread Chia-Ping Tsai
The CellBuilder#Data type is introduced to make sure all components used to builder cell are IA.Public. bq. Best as I can tell, Cell#getType() should be deprecated As i see it, the Cell#getType, #getTimestamp, #getSequenceId, and #getTag should be deprecated as these methods is some kind of

Re: Struggles around Cell#getType()

2017-10-27 Thread Sergey Soldatov
.bq Also we can have DataType#toType(Cell) or so for the conversion purpose. Let me repeat. DataType is the serialization interface for the values and has no relations to the type of KV. .bq This would imply having as many isXX() methods as the number of elements in CellBuilder#DataType Have I

Re: Struggles around Cell#getType()

2017-10-27 Thread Anoop John
I think what we missed in doing DataType is not having a type state and make it align with those in KeyValue#Type. Relying on ordinal might be problematic. Also we can have DataType#toType(Cell) or so for the conversion purpose. This is needed for CPs as noted by Josh's CP eg:s. Thanks for

[jira] [Created] (HBASE-19109) Backup should provide and option to disable backup if full backups have started

2017-10-27 Thread Vishal Khandelwal (JIRA)
Vishal Khandelwal created HBASE-19109: - Summary: Backup should provide and option to disable backup if full backups have started Key: HBASE-19109 URL: https://issues.apache.org/jira/browse/HBASE-19109

[jira] [Created] (HBASE-19108) Backups should understand the frequency of full and incremental backup

2017-10-27 Thread Vishal Khandelwal (JIRA)
Vishal Khandelwal created HBASE-19108: - Summary: Backups should understand the frequency of full and incremental backup Key: HBASE-19108 URL: https://issues.apache.org/jira/browse/HBASE-19108

[jira] [Created] (HBASE-19107) Backup should resume from last failed state

2017-10-27 Thread Vishal Khandelwal (JIRA)
Vishal Khandelwal created HBASE-19107: - Summary: Backup should resume from last failed state Key: HBASE-19107 URL: https://issues.apache.org/jira/browse/HBASE-19107 Project: HBase Issue

[jira] [Created] (HBASE-19106) Backup self validation for its correctness.

2017-10-27 Thread Amit Kabra (JIRA)
Amit Kabra created HBASE-19106: -- Summary: Backup self validation for its correctness. Key: HBASE-19106 URL: https://issues.apache.org/jira/browse/HBASE-19106 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-19105) Add ability to compare backups in HBase backups.

2017-10-27 Thread Amit Kabra (JIRA)
Amit Kabra created HBASE-19105: -- Summary: Add ability to compare backups in HBase backups. Key: HBASE-19105 URL: https://issues.apache.org/jira/browse/HBASE-19105 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-19104) Add filtering during restore in HBase backups.

2017-10-27 Thread Amit Kabra (JIRA)
Amit Kabra created HBASE-19104: -- Summary: Add filtering during restore in HBase backups. Key: HBASE-19104 URL: https://issues.apache.org/jira/browse/HBASE-19104 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-19103) Add BigDecimalComparator for filter

2017-10-27 Thread Qilin Cao (JIRA)
Qilin Cao created HBASE-19103: - Summary: Add BigDecimalComparator for filter Key: HBASE-19103 URL: https://issues.apache.org/jira/browse/HBASE-19103 Project: HBase Issue Type: New Feature

Re: [DISCUSS] Merge hbase-metrics:oahh.metrics.impl into hbase-metrics-api

2017-10-27 Thread Misty Stanley-Jones
On Thu, Oct 26, 2017 at 1:52 PM Josh Elser wrote: > That's the million-dollar question, now isn't it! :) > > Something to hbase-metrics-api/README.md? A chapter in the book? > In the Javadoc makes the most sense to me. I don’t think people would check the book. Apply, where

Re: Re: [ANNOUNCE] New HBase Committer Jan Hentschel

2017-10-27 Thread Misty Stanley-Jones
Thanks for your continued contributions, Jan! On Thu, Oct 26, 2017 at 8:40 PM Jingcheng Du wrote: > Congratulations! > > 2017-10-27 11:37 GMT+08:00 Guanghao Zhang : > > > Congratulations! > > > > 2017-10-27 10:16 GMT+08:00 OpenInx : > >