[jira] [Created] (HBASE-18803) Mapreduce job get failed caused by NoClassDefFoundError: org/apache/commons/lang3/ArrayUtils

2017-09-12 Thread Yi Liang (JIRA)
Yi Liang created HBASE-18803: Summary: Mapreduce job get failed caused by NoClassDefFoundError: org/apache/commons/lang3/ArrayUtils Key: HBASE-18803 URL: https://issues.apache.org/jira/browse/HBASE-18803

[jira] [Created] (HBASE-18802) [C++] Remove hbase-macros.h

2017-09-12 Thread Enis Soztutar (JIRA)
Enis Soztutar created HBASE-18802: - Summary: [C++] Remove hbase-macros.h Key: HBASE-18802 URL: https://issues.apache.org/jira/browse/HBASE-18802 Project: HBase Issue Type: Sub-task

[jira] [Resolved] (HBASE-18733) [compat 1-2] Hide WALKey

2017-09-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-18733. --- Resolution: Fixed Pushed to branch-2 and master. > [compat 1-2] Hide WALKey > > >

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Josh Elser
On 9/12/17 2:51 PM, Andrew Purtell wrote: making backup working in challenging conditions was not a goal of FT design, correct failure handling was a goal. Every real-world production environment has challenging conditions. That said, making progress in the face of failures is only one aspec

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Andrew Purtell
> making backup working in challenging conditions was not a goal of FT design, correct failure handling was a goal. Every real-world production environment has challenging conditions. That said, making progress in the face of failures is only one aspect of FT, and an equally valid one is that fai

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Vladimir Rodionov
Yes, we have already some IT, so will need to upgrade it for scale testing. On Tue, Sep 12, 2017 at 11:28 AM, Ted Yu wrote: > bq. we need a test tool similar to ITBLL > > How about making the following such a tool ? > > hbase-it/src/test/java/org/apache/hadoop/hbase/ > IntegrationTestBackupResto

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Ted Yu
bq. we need a test tool similar to ITBLL How about making the following such a tool ? hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestBackupRestore.java On Tue, Sep 12, 2017 at 11:25 AM, Vladimir Rodionov wrote: > >> Vlad: I'm obviously curious to see what you think about this st

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Vladimir Rodionov
>> Vlad: I'm obviously curious to see what you think about this stuff, in addition to what you already had in mind :) Yes, I think that we need a test tool similar to ITBLL. Btw, making backup working in challenging conditions was not a goal of FT design, correct failure handling was a goal. On T

[jira] [Created] (HBASE-18801) Bulk load cleanup may falsely deem file deletion successful

2017-09-12 Thread Ted Yu (JIRA)
Ted Yu created HBASE-18801: -- Summary: Bulk load cleanup may falsely deem file deletion successful Key: HBASE-18801 URL: https://issues.apache.org/jira/browse/HBASE-18801 Project: HBase Issue Type:

[jira] [Reopened] (HBASE-18010) Connect CellChunkMap to be used for flattening in CompactingMemStore

2017-09-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reopened HBASE-18010: --- Reopen so this set of fixes makes it into 2.0. Resolve after it makes it in. Thanks [~anastas] > Connect CellCh

[jira] [Created] (HBASE-18800) [Propaganda] Push shaded hbase-client as gateway to an hbase cluster going forward

2017-09-12 Thread stack (JIRA)
stack created HBASE-18800: - Summary: [Propaganda] Push shaded hbase-client as gateway to an hbase cluster going forward Key: HBASE-18800 URL: https://issues.apache.org/jira/browse/HBASE-18800 Project: HBase

Re: [DISCUSS] hbase-2.0.0 compatibility expectations

2017-09-12 Thread Stack
Let me put this one on this thread, G1GC on by default in hbase2? St.Ack On Wed, Aug 2, 2017 at 4:38 PM, Stack wrote: > What are our expectations regards compatibility between hbase1 and hbase2? > > Lets have a chat about it. Here are some goal posts. > > + You have to upgrade to hbase-1.x befor

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Josh Elser
Thanks for the quick feedback! On 9/12/17 12:36 PM, Stack wrote: On Tue, Sep 12, 2017 at 9:33 AM, Andrew Purtell wrote: I think those are reasonable criteria Josh. What I would like to see is something like "we ran ITBLL (or custom generator with similar correctness validation if you prefer)

[jira] [Reopened] (HBASE-18733) [compat 1-2] Hide WALKey

2017-09-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack reopened HBASE-18733: --- We are not 'purging' WALKey after all; too much work. Reopening to change audience to Private. > [compat 1-2] H

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Stack
On Tue, Sep 12, 2017 at 9:33 AM, Andrew Purtell wrote: > I think those are reasonable criteria Josh. > > What I would like to see is something like "we ran ITBLL (or custom > generator with similar correctness validation if you prefer) on a dev > cluster (5-10 nodes) for 24 hours with server kill

Re: [DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Andrew Purtell
I think those are reasonable criteria Josh. What I would like to see is something like "we ran ITBLL (or custom generator with similar correctness validation if you prefer) on a dev cluster (5-10 nodes) for 24 hours with server killing chaos agents active, attempted 1,440 backups (one per minu

[DISCUSS] Plan for Distributed testing of Backup and Restore

2017-09-12 Thread Josh Elser
On 9/11/17 11:52 PM, Stack wrote: On Mon, Sep 11, 2017 at 11:07 AM, Vladimir Rodionov wrote: ... That is mostly it. Yes, We have not done real testing with real data on a real cluster yet, except QA testing on a small OpenStack cluster (10 nodes). That is our probably the biggest minus right

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2017-09-12 Thread Josh Elser
On 9/11/17 11:52 PM, Stack wrote: On Mon, Sep 11, 2017 at 11:07 AM, Vladimir Rodionov wrote: My plan is to finish HBASE-17825 (further performance optimizations). This will cut down number of MR jobs during incremental backup from 2*N to 2 (N - number of tables). That will probably take

[jira] [Created] (HBASE-18799) Revisit the AccessControl

2017-09-12 Thread Chia-Ping Tsai (JIRA)
Chia-Ping Tsai created HBASE-18799: -- Summary: Revisit the AccessControl Key: HBASE-18799 URL: https://issues.apache.org/jira/browse/HBASE-18799 Project: HBase Issue Type: Task Re

[jira] [Resolved] (HBASE-18791) HBASE_HOME/lib does not contain hbase-mapreduce-${project.version}-tests.jar

2017-09-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-18791. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.0.0-alpha-3 Pushed to branch-2 and mast

[jira] [Created] (HBASE-18798) Remove the unused methods in RegionServerCoprocessorHost

2017-09-12 Thread Chia-Ping Tsai (JIRA)
Chia-Ping Tsai created HBASE-18798: -- Summary: Remove the unused methods in RegionServerCoprocessorHost Key: HBASE-18798 URL: https://issues.apache.org/jira/browse/HBASE-18798 Project: HBase

[jira] [Created] (HBASE-18797) Deprecate Filter#filterKeyValue and add Filter#filterCell

2017-09-12 Thread Abhishek Singh Chouhan (JIRA)
Abhishek Singh Chouhan created HBASE-18797: -- Summary: Deprecate Filter#filterKeyValue and add Filter#filterCell Key: HBASE-18797 URL: https://issues.apache.org/jira/browse/HBASE-18797 Project:

[jira] [Created] (HBASE-18796) Admin#isTableAvailable returns incorrect result before daughter regions are opened

2017-09-12 Thread Abhishek Singh Chouhan (JIRA)
Abhishek Singh Chouhan created HBASE-18796: -- Summary: Admin#isTableAvailable returns incorrect result before daughter regions are opened Key: HBASE-18796 URL: https://issues.apache.org/jira/browse/HBASE-1

[jira] [Resolved] (HBASE-10944) Remove all kv.getBuffer() and kv.getRow() references existing in the code

2017-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan resolved HBASE-10944. Resolution: Won't Fix We wont't be removing Kv.getBuffer() instead only exp

[jira] [Reopened] (HBASE-10944) Remove all kv.getBuffer() and kv.getRow() references existing in the code

2017-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reopened HBASE-10944: MArking proper resolution. > Remove all kv.getBuffer() and kv.getRow() referen

[jira] [Created] (HBASE-18795) Expose KeyValue.getBuffer() for tests alone

2017-09-12 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created HBASE-18795: -- Summary: Expose KeyValue.getBuffer() for tests alone Key: HBASE-18795 URL: https://issues.apache.org/jira/browse/HBASE-18795 Project: HBase

[jira] [Resolved] (HBASE-7320) Remove KeyValue.getBuffer()

2017-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan resolved HBASE-7320. --- Resolution: Fixed Fix Version/s: 2.0.0-alpha-3 3.0.0

[jira] [Resolved] (HBASE-10944) Remove all kv.getBuffer() and kv.getRow() references existing in the code

2017-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan resolved HBASE-10944. Resolution: Fixed Fix Version/s: (was: 1.5.0) KeyValue.getRow()

[jira] [Created] (HBASE-18794) Remove deprecated methods in MasterObserver

2017-09-12 Thread Chia-Ping Tsai (JIRA)
Chia-Ping Tsai created HBASE-18794: -- Summary: Remove deprecated methods in MasterObserver Key: HBASE-18794 URL: https://issues.apache.org/jira/browse/HBASE-18794 Project: HBase Issue Type: S