Re: Still Failing: HBase Generate Website

2016-10-08 Thread Ted Yu
rence_guide.pdf -rw-rw-r-- 1 hbase hbase 13535029 Oct 8 19:35 ./target/site/apache_hbase_reference_guide.pdf I can attach the generated pdf to the JIRA if you want. It contains the new guide on protobuf 3. The fstat error may be related to the build machine. Cheers On Sat, Oct 8, 2016 at 12:1

Re: Still Failing: HBase Generate Website

2016-10-08 Thread Ted Yu
This error didn't appear when the v1 was committed. Let me see if I can reproduce it locally on Linux. [ERROR] Failed to execute goal org.asciidoctor:asciidoctor-maven-plugin:1.5.3:process-asciidoc (output-pdf) on project hbase: Execution output-pdf of goal

Re: Useless Coprocessors in Split transaction?

2016-10-07 Thread Ted Yu
Please take a look at phoenix-core/src/main/java/org/apache/phoenix/coprocessor/DelegateRegionObserver.java where you can see usage of preSplitBeforePONR and preSplitAfterPONR . In general, we can remove deprecated methods in the next major release. FYI On Fri, Oct 7, 2016 at 12:11 PM, Stephen

[jira] [Resolved] (HBASE-14138) HBase Backup/Restore Phase 3: Security

2016-10-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-14138. Resolution: Later Resolving as Later since implementation is moved to client. > HBase Backup/Rest

Re: Hadoop 3.x profile working for hbase 2.0 [Re: HBASE 2.0]

2016-10-06 Thread Ted Yu
and getting build infrastructure precommit checks in > place so we don't inadvertently introduce new problems. > > Jon. > > On Thu, Oct 6, 2016 at 9:02 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Jon: > > Once the goals you outlined below are achieved, would user

Re: Hadoop 3.x profile working for hbase 2.0 [Re: HBASE 2.0]

2016-10-06 Thread Ted Yu
Jon: Once the goals you outlined below are achieved, would user be able to use build artifacts compiled against hadoop 2.7.1 on a cluster deployed with hadoop 3.0.0-alpha1 ? Cheers On Thu, Oct 6, 2016 at 12:07 AM, Jonathan Hsieh wrote: > I'd like to get the

[jira] [Created] (HBASE-16773) AccessController should access local region if possible

2016-10-05 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16773: -- Summary: AccessController should access local region if possible Key: HBASE-16773 URL: https://issues.apache.org/jira/browse/HBASE-16773 Project: HBase Issue Type

[jira] [Created] (HBASE-16772) Add verbose option to VerifyReplication for logging good rows

2016-10-05 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16772: -- Summary: Add verbose option to VerifyReplication for logging good rows Key: HBASE-16772 URL: https://issues.apache.org/jira/browse/HBASE-16772 Project: HBase Issue

[jira] [Created] (HBASE-16771) VerifyReplication should increase GOODROWS counter if re-comparison passes

2016-10-05 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16771: -- Summary: VerifyReplication should increase GOODROWS counter if re-comparison passes Key: HBASE-16771 URL: https://issues.apache.org/jira/browse/HBASE-16771 Project: HBase

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-10-04 Thread Ted Yu
tool can ask the master to invoke procedures on > the > > > > HBase side that do first mile export and last mile restore. > (Internally > > > the > > > > tool can also use the procedure framework for state durability, > > perhaps, > >

Re: Build failure due to license validation

2016-10-04 Thread Ted Yu
For #1, only javax.annotation.Generated is imported. We can create a similar class in hbase-common which replaces the above import. On Tue, Oct 4, 2016 at 12:40 PM, Guang Yang wrote: > Hello, > While working on the Jetty 9 upgrade patch, after polling in several new >

[jira] [Created] (HBASE-16762) NullPointerException is thrown when constructing sourceTable in verifyrep

2016-10-04 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16762: -- Summary: NullPointerException is thrown when constructing sourceTable in verifyrep Key: HBASE-16762 URL: https://issues.apache.org/jira/browse/HBASE-16762 Project: HBase

Re: Failure: HBase Generate Website

2016-10-04 Thread Ted Yu
I have reverted the patch. Will work with Saravanan to get past the error. FYI On Tue, Oct 4, 2016 at 8:47 AM, Dima Spivak wrote: > Coming so soon after HBASE-16750 got committed worries me. Let me re-run > this and revert if it still fails. > > -Dima > > On Tue, Oct 4,

[jira] [Reopened] (HBASE-16750) hbase compilation failed on power system

2016-10-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-16750: > hbase compilation failed on power system > > >

Re: HBASE 2.0

2016-10-03 Thread Ted Yu
w.r.t. feature, there is also: HBASE-15968 MVCC-sensitive semantics of versions On Mon, Oct 3, 2016 at 3:27 PM, Stephen Jiang wrote: > Hello, All, > > It is time to discuss about the schedule of HBase 2.0 release. HBase 2.0 > release is a big major release. When we

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-03 Thread Ted Yu
to 2.5 and 3.x, respectively) are available, would maven know which one to pick for the hbase-protocol and hbase-protocol-shaded modules ? Cheers On Mon, Oct 3, 2016 at 9:32 AM, Stack <st...@duboce.net> wrote: > On Mon, Oct 3, 2016 at 7:16 AM, Ted Yu <yuzhih...@gmail.com> wrote: &

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-03 Thread Ted Yu
if I am wrong. On Mon, Oct 3, 2016 at 6:58 AM, Ted Yu <yuzhih...@gmail.com> wrote: > The protoc generated files (such as MasterProtos) are checked into source > repo, right ? > > Do we need proto3 on the precommit image(s) ? > > On Mon, Oct 3, 2016 at 5:18 AM, 张铎 <p

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-03 Thread Ted Yu
The protoc generated files (such as MasterProtos) are checked into source repo, right ? Do we need proto3 on the precommit image(s) ? On Mon, Oct 3, 2016 at 5:18 AM, 张铎 wrote: > Then I think we need to file an issue to change the protoc version > installed in the

[jira] [Resolved] (HBASE-16739) Timed out exception message should include encoded region name

2016-10-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16739. Resolution: Fixed > Timed out exception message should include encoded region n

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-02 Thread Ted Yu
I just installed protobuf 3 on my Mac. In case anyone doesn't have protobuf-2.5.0 source locally, please remember to backup protoc executable before running 'sudo make install' under the protobuf 3 dir. Cheers On Sun, Oct 2, 2016 at 10:18 AM, Andrew Purtell wrote: >

[jira] [Created] (HBASE-16745) HttpDoAsClient should handle failure in retrieving Subject

2016-10-01 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16745: -- Summary: HttpDoAsClient should handle failure in retrieving Subject Key: HBASE-16745 URL: https://issues.apache.org/jira/browse/HBASE-16745 Project: HBase Issue Type

[jira] [Created] (HBASE-16739) Timed out exception message should include encoded region name

2016-09-30 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16739: -- Summary: Timed out exception message should include encoded region name Key: HBASE-16739 URL: https://issues.apache.org/jira/browse/HBASE-16739 Project: HBase Issue

[jira] [Created] (HBASE-16736) Add getter to ResizableBlockCache for max size

2016-09-29 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16736: -- Summary: Add getter to ResizableBlockCache for max size Key: HBASE-16736 URL: https://issues.apache.org/jira/browse/HBASE-16736 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-16725) Don't let flushThread hang in TestHRegion

2016-09-28 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16725: -- Summary: Don't let flushThread hang in TestHRegion Key: HBASE-16725 URL: https://issues.apache.org/jira/browse/HBASE-16725 Project: HBase Issue Type: Test

Re: Merge and HMerge

2016-09-28 Thread Ted Yu
fine now. It is also the only one of the two flagged as > being a tool. Should HMerge be removed? At least deprecated? > > Cheers, > Lars > > > On Thu, Jul 7, 2011 at 2:03 AM, Ted Yu <yuzhih...@gmail.com> wrote: > >>> there is already an issue to do this but

[jira] [Reopened] (HBASE-16691) Optimize KeyOnlyFilter by utilizing KeyOnlyCell

2016-09-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-16691: > Optimize KeyOnlyFilter by utilizing KeyOnlyC

[jira] [Resolved] (HBASE-16709) Drop hadoop-1.1 profile in pom.xml for master branch

2016-09-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16709. Resolution: Duplicate > Drop hadoop-1.1 profile in pom.xml for master bra

[jira] [Created] (HBASE-16709) Drop hadoop-1.1 profile in pom.xml for master branch

2016-09-26 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16709: -- Summary: Drop hadoop-1.1 profile in pom.xml for master branch Key: HBASE-16709 URL: https://issues.apache.org/jira/browse/HBASE-16709 Project: HBase Issue Type: Bug

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
ment this as a client - driven tool set. > > -Vlad > > On Sat, Sep 24, 2016 at 12:11 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > The standalone service so far seems to be middle ground having the > > following advantages: > > > > 1. utilization of ex

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
rvice to coordinate backups is not a good > idea. We have already a lot of them. > > On Sat, Sep 24, 2016 at 11:20 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > bq. don't call out to an external framework we don't own from master (or > > regionserver) code > > > &g

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
th MR > >> like shipping data off cluster or moving remote data in place and > preparing > >> it for import. These activities do not need procedure coordination and > >> involvement of the HBase master. Only the first and last mile of the > >> process needs atomicity with

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
re coordination and > involvement of the HBase master. Only the first and last mile of the > process needs atomicity within the HBase deploy. Please let me know if I > have misstated this. > > > > On Sep 24, 2016, at 8:17 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > &

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
t of backup manifest. Cheers On Sat, Sep 24, 2016 at 7:59 AM, Matteo Bertozzi <theo.berto...@gmail.com> wrote: > On Sat, Sep 24, 2016 at 7:19 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Ideally the export should have one job running which does the retry (on > > fai

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
d that should be ok. > > > > Matteo > > > On Sat, Sep 24, 2016 at 6:54 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Master is involved in this discussion because currently only Master > > instantiates ProcedureExecutor which runs the 3 Procedures for backup /

Re: Backup Implementation (WAS => Re: [DISCUSSION] MR jobs started by Master or RS)

2016-09-24 Thread Ted Yu
> > > > > > from what I can gather, a rule that may satisfy everyone can be: > > > > > > - we don't want any core feature (e.g. compaction/log-split/log- > > > > reply) > > > > > > over MR, because some cluster may not want or may h

[jira] [Created] (HBASE-16696) TestBlockEvictionFromClient fails in master branch

2016-09-23 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16696: -- Summary: TestBlockEvictionFromClient fails in master branch Key: HBASE-16696 URL: https://issues.apache.org/jira/browse/HBASE-16696 Project: HBase Issue Type: Bug

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-23 Thread Ted Yu
That's why I'm very nervous when somebody wants to add new features or add > external dependencies to HMaster, especially add more works for the start > up processing... > > Thanks. > > 2016-09-23 20:02 GMT+08:00 Ted Yu <yuzhih...@gmail.com>: > > > I read through HA

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-23 Thread Ted Yu
all > > > design/arch point of view (maybe code review is still pending from > > Matteo). > > > If in the future, we find better ways of doing this without using MR, > we > > > can certainly consider that. But IMO don't think w

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Ted Yu
, 2016 at 8:32 PM, 张铎 <palomino...@gmail.com> wrote: > So what about a standalone service other than master? You can use your own > procedure store in that service? > > 2016-09-23 11:28 GMT+08:00 Ted Yu <yuzhih...@gmail.com>: > > > An earlier

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Ted Yu
jobs from Master and > RSs > >>> > code?" since this will be the first time we do this > >>> > > >>> > Matteo > >>> > > >>> > > >>> >> On Thu, Sep 22, 2016 at 2:49 PM, Devaraj Das <d...@hortonwor

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread Ted Yu
I agree - backup / restore is in the same category as import / export. On Thu, Sep 22, 2016 at 1:58 PM, Andrew Purtell wrote: > Backup is extra tooling around core in my opinion. Like import or export. > Or the optional MOB tool. It's fine. > > > On Sep 22, 2016, at

[jira] [Created] (HBASE-16685) Revisit execution of SnapshotCopy in MapReduceBackupCopyService

2016-09-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16685: -- Summary: Revisit execution of SnapshotCopy in MapReduceBackupCopyService Key: HBASE-16685 URL: https://issues.apache.org/jira/browse/HBASE-16685 Project: HBase Issue

[jira] [Created] (HBASE-16683) Address review comments for backup / restore feature

2016-09-22 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16683: -- Summary: Address review comments for backup / restore feature Key: HBASE-16683 URL: https://issues.apache.org/jira/browse/HBASE-16683 Project: HBase Issue Type: Bug

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-22 Thread Ted Yu
in NPE The updated doc has been attached to HBASE-16574. Cheers On Thu, Sep 22, 2016 at 8:53 AM, Stack <st...@duboce.net> wrote: > On Wed, Sep 21, 2016 at 7:43 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Are there more (review) comments ? > > > > > Ar

[jira] [Created] (HBASE-16675) Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved

2016-09-21 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16675: -- Summary: Average region size may be incorrect when there is region whose RegionLoad cannot be retrieved Key: HBASE-16675 URL: https://issues.apache.org/jira/browse/HBASE-16675

[jira] [Created] (HBASE-16672) Add option for bulk load to copy hfile(s) instead of renaming

2016-09-21 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16672: -- Summary: Add option for bulk load to copy hfile(s) instead of renaming Key: HBASE-16672 URL: https://issues.apache.org/jira/browse/HBASE-16672 Project: HBase Issue

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-21 Thread Ted Yu
Matteo > > > On Wed, Sep 21, 2016 at 7:43 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Are there more (review) comments ? > > > > Thanks > > > > On Tue, Sep 20, 2016 at 10:02 AM, Devaraj Das <d...@hortonworks.com> > > wrote: > > > &

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-21 Thread Ted Yu
ject: Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912 > > On Mon, Sep 12, 2016 at 12:19 PM, Ted Yu <yuzhih...@gmail.com> wrote: > > > Mega patch (rev 18) is on HBASE-14123. > > > > Please comment on HBASE-14123 on how you want to review. > > &

[jira] [Resolved] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16655. Resolution: Fixed Hadoop Flags: Reviewed > hbase backup describe with incorrect backup id resu

[jira] [Created] (HBASE-16655) hbase backup describe with incorrect backup id results in NPE

2016-09-19 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16655: -- Summary: hbase backup describe with incorrect backup id results in NPE Key: HBASE-16655 URL: https://issues.apache.org/jira/browse/HBASE-16655 Project: HBase Issue

Re: DiffKeyDeltaEncoder not fully efficient?

2016-09-18 Thread Ted Yu
In compressSingleKeyValue(), we compute the number of bytes to store timestamp: timestampFitsInBytes = ByteBufferUtils.longFitsIn(timestamp); Then the number of bytes to store the diff between the timestamp of previous cell and current timestamp is computed: diffTimestampFitsInBytes

[jira] [Created] (HBASE-16646) Enhance LoadIncrementalHFiles to accept store file paths as input

2016-09-16 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16646: -- Summary: Enhance LoadIncrementalHFiles to accept store file paths as input Key: HBASE-16646 URL: https://issues.apache.org/jira/browse/HBASE-16646 Project: HBase Issue

[jira] [Created] (HBASE-16640) TimeoutBlockingQueue#remove() should return whether the entry is removed

2016-09-15 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16640: -- Summary: TimeoutBlockingQueue#remove() should return whether the entry is removed Key: HBASE-16640 URL: https://issues.apache.org/jira/browse/HBASE-16640 Project: HBase

[jira] [Created] (HBASE-16639) TestProcedureInMemoryChore#testChoreAddAndRemove occasionally fails

2016-09-15 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16639: -- Summary: TestProcedureInMemoryChore#testChoreAddAndRemove occasionally fails Key: HBASE-16639 URL: https://issues.apache.org/jira/browse/HBASE-16639 Project: HBase

[jira] [Created] (HBASE-16638) Reduce the number of Connection's created in classes of hbase-spark module

2016-09-15 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16638: -- Summary: Reduce the number of Connection's created in classes of hbase-spark module Key: HBASE-16638 URL: https://issues.apache.org/jira/browse/HBASE-16638 Project: HBase

[jira] [Created] (HBASE-16637) Add endpoint coprocessor to speed up queries to hbase:backup table

2016-09-15 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16637: -- Summary: Add endpoint coprocessor to speed up queries to hbase:backup table Key: HBASE-16637 URL: https://issues.apache.org/jira/browse/HBASE-16637 Project: HBase

[jira] [Resolved] (HBASE-16620) Fix backup command-line tool usability issues

2016-09-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16620. Resolution: Fixed Thanks for the addendum, Vlad. > Fix backup command-line tool usability iss

[jira] [Resolved] (HBASE-16620) Fix backup command-line tool usability issues

2016-09-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16620. Resolution: Fixed Thanks for the patch, Vlad. > Fix backup command-line tool usability iss

Re: Consider adding the issue number in commit message

2016-09-13 Thread Ted Yu
che.org > >> <javascript:;>> wrote: > >> > >>> +1 on not force pushing. The git repo is sync'ed to multiple places > (like > >>> github, etc) so force pushes should be avoided unless a feature branch. > >>> > >>> Should we extend the

Re: Consider adding the issue number in commit message

2016-09-13 Thread Ted Yu
Interesting. I can try to write a script which: given JIRA number (e.g. 16491), emits HBASE-xyz Description (author) The output can then be copy-pasted in commit. Cheers On Tue, Sep 13, 2016 at 12:57 PM, Jerry He wrote: > I have made similar mistakes on the commit

[jira] [Created] (HBASE-16627) AssignmentManager#isDisabledorDisablingRegionInRIT should check whether table exists

2016-09-13 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16627: -- Summary: AssignmentManager#isDisabledorDisablingRegionInRIT should check whether table exists Key: HBASE-16627 URL: https://issues.apache.org/jira/browse/HBASE-16627 Project

[jira] [Resolved] (HBASE-16602) Avoid creating Connection in BackupLogCleaner#getDeletableFiles()

2016-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16602. Resolution: Fixed Thanks for the review, Vlad. > Avoid creating Connection in BackupLogClea

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-12 Thread Ted Yu
t). Vladimir did a list of what is in each of the phases above which > > would serve as a good start. > > + Is this feature 'experimental' (Matteo asks above). I'd prefer it is > > not. If it is, it should be labelled all over that it is so. I see > current > > state cal

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-12 Thread Ted Yu
> >> want third party resources for using a major and important feature of > > the > > >> project, I want us to provide end users with what they need to get the > > job > > >> done. > > >> > > >> I see some calls for patience on the

[jira] [Resolved] (HBASE-16603) Detect unavailability of hbase:backup table to avoid extraneous logging

2016-09-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16603. Resolution: Fixed Assignee: Ted Yu Hadoop Flags: Reviewed Thanks for the review, Stephen

[jira] [Resolved] (HBASE-16595) Remove reference to Admin from backup / restore server code

2016-09-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16595. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Stephen. > Remove refere

[jira] [Created] (HBASE-16603) Detect unavailability of hbase:backup table to avoid extraneous logging

2016-09-09 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16603: -- Summary: Detect unavailability of hbase:backup table to avoid extraneous logging Key: HBASE-16603 URL: https://issues.apache.org/jira/browse/HBASE-16603 Project: HBase

[jira] [Created] (HBASE-16602) Avoid creating Connection in BackupLogCleaner#getDeletableFiles()

2016-09-09 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16602: -- Summary: Avoid creating Connection in BackupLogCleaner#getDeletableFiles() Key: HBASE-16602 URL: https://issues.apache.org/jira/browse/HBASE-16602 Project: HBase Issue

Re: [VOTE] The 1st HBase 0.98.22 release candidate (RC0) is available

2016-09-09 Thread Ted Yu
+1 Checked layout Ran test suite - got test failure in ReplicationAdminTest which seems intermittent (HBASE-16600) Ran LoadTestTool Exercised basic shell commands On Sat, Sep 3, 2016 at 8:34 AM, Andrew Purtell wrote: > The 1st HBase 0.98.2 > ​2 release candidate (RC0) is

[jira] [Created] (HBASE-16600) [0.98] ReplicationAdminTest occasionally fails

2016-09-09 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16600: -- Summary: [0.98] ReplicationAdminTest occasionally fails Key: HBASE-16600 URL: https://issues.apache.org/jira/browse/HBASE-16600 Project: HBase Issue Type: Test

Re: [VOTE] The 1st HBase 0.98.22 release candidate (RC0) is available

2016-09-09 Thread Ted Yu
I ran the test suite which failed at TestShell : 1) Error: test_add_peer:_single_zk_cluster_key(Hbase::ReplicationAdminTest): NativeException: org.apache.hadoop.hbase.replication.ReplicationException: Could not remove peer with id=1

[jira] [Created] (HBASE-16595) Remove reference to Admin from backup / restore server code

2016-09-09 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16595: -- Summary: Remove reference to Admin from backup / restore server code Key: HBASE-16595 URL: https://issues.apache.org/jira/browse/HBASE-16595 Project: HBase Issue Type

[jira] [Resolved] (HBASE-16588) Remove ConnectionFactory#createConnection from backup / restore server code

2016-09-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16588. Resolution: Fixed Hadoop Flags: Reviewed All backup tests passed. Thanks for the review, Stephen

[jira] [Resolved] (HBASE-16497) Add test for backup / restore involving MOB table

2016-09-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16497. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Vlad. > Add test for bac

[jira] [Reopened] (HBASE-16505) Add AsyncRegion interface to pass deadline and support async operations

2016-09-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HBASE-16505: Reverted from master branch due to open comments. bq. There are no guarantees for coprocessor compatibility

[jira] [Created] (HBASE-16588) Remove ConnectionFactory#createConnection from backup / restore server code

2016-09-08 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16588: -- Summary: Remove ConnectionFactory#createConnection from backup / restore server code Key: HBASE-16588 URL: https://issues.apache.org/jira/browse/HBASE-16588 Project: HBase

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-08 Thread Ted Yu
Is there any concern which is not addressed ? Do we need another Vote thread ? Thanks On Thu, Sep 8, 2016 at 9:21 AM, Andrew Purtell wrote: > Vlad, > > I apologize for using the term 'half-baked' in a way that could seem a > description of HBASE-7912. I meant that as a

"Contributors 1" group added

2016-09-07 Thread Ted Yu
Hi, Through INFRA-12487, "Contributors 1" group has been added which has the same permissions as "Contributors". FYI

[jira] [Created] (HBASE-16579) Concurrent backup / restore support

2016-09-07 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16579: -- Summary: Concurrent backup / restore support Key: HBASE-16579 URL: https://issues.apache.org/jira/browse/HBASE-16579 Project: HBase Issue Type: Improvement

[jira] [Resolved] (HBASE-16566) Add nonce support to TableBackupProcedure

2016-09-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16566. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Stephen. > Add nonce supp

[jira] [Resolved] (HBASE-15565) Rewrite restore with Procedure V2

2016-09-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-15565. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Stephen. > Rewrite rest

Re: branch-2: Judgement Day

2016-09-07 Thread Ted Yu
There is work of introducing AsyncRegion (see HBASE-16505). This would be done by the end of September. On Wed, Sep 7, 2016 at 10:03 AM, Matteo Bertozzi wrote: > the idea of end of semptember is to cut the branch, to be able to work on > fixing stuff. > AM, backup,

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-07 Thread Ted Yu
Adding more tests around backup / restore is in the works. e.g. I will start with HBASE-16497 this week. I agree that developers of the feature should try out typical scenarios so that user experience is better. 30 minute of unit tests runtime for backup / restore is for machine with SSDs. For

[jira] [Created] (HBASE-16574) Add backup / restore feature to refguide

2016-09-07 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16574: -- Summary: Add backup / restore feature to refguide Key: HBASE-16574 URL: https://issues.apache.org/jira/browse/HBASE-16574 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-16571) Consider locking target table(s) during restore operation

2016-09-07 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16571: -- Summary: Consider locking target table(s) during restore operation Key: HBASE-16571 URL: https://issues.apache.org/jira/browse/HBASE-16571 Project: HBase Issue Type

Re: [ANNOUNCE] Duo Zhang (张铎) joins the Apache HBase PMC

2016-09-06 Thread Ted Yu
Congratulations, Duo. > On Sep 6, 2016, at 9:26 PM, Stack wrote: > > On behalf of the Apache HBase PMC I am pleased to announce that 张铎 > has accepted our invitation to become a PMC member on the Apache > HBase project. Duo has healthy notions on where the project should be >

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-06 Thread Ted Yu
Andrew: Do you think you would have some time this week ? Thanks On Thu, Sep 1, 2016 at 8:47 AM, Andrew Purtell <andrew.purt...@gmail.com> wrote: > Busy at work, aiming for next week. > > > On Sep 1, 2016, at 8:44 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > &

[jira] [Created] (HBASE-16566) Add nonce support to TableBackupProcedure

2016-09-06 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16566: -- Summary: Add nonce support to TableBackupProcedure Key: HBASE-16566 URL: https://issues.apache.org/jira/browse/HBASE-16566 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-16565) Add metrics for backup / restore

2016-09-06 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16565: -- Summary: Add metrics for backup / restore Key: HBASE-16565 URL: https://issues.apache.org/jira/browse/HBASE-16565 Project: HBase Issue Type: Improvement

[jira] [Resolved] (HBASE-15449) HBase Backup Phase 3: Support physical table layout change

2016-09-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-15449. Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review, Vlad. > HBase Backup Phas

[jira] [Resolved] (HBASE-16545) Add backup test where data is ingested during backup procedure

2016-09-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16545. Resolution: Fixed Assignee: Ted Yu Hadoop Flags: Reviewed Thanks for the review, Vlad

Re: There are some errors with hbase java example

2016-09-05 Thread Ted Yu
Xi: Thanks for spotting these. snappy requires some setup - setting compression type to others would be easier for first time users. Please open a JIRA to modify refguide. Cheers On Mon, Sep 5, 2016 at 12:31 PM, Xi Yang wrote: > Hi , > > There are some errors with

[jira] [Created] (HBASE-16557) UI for backup / restore

2016-09-03 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16557: -- Summary: UI for backup / restore Key: HBASE-16557 URL: https://issues.apache.org/jira/browse/HBASE-16557 Project: HBase Issue Type: Improvement Reporter

Re: org.apache.hadoop.hbase.client Table#batch Javadoc clarification

2016-09-03 Thread Ted Yu
For the last point, please take a look at AsyncProcess#createAsyncRequestFuture() protected AsyncRequestFutureImpl createAsyncRequestFuture( TableName tableName, List actions, long nonceGroup, ExecutorService pool, Batch.Callback callback, Object[] results, boolean

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-02 Thread Ted Yu
would like to mention that "robust snapshots" and "table > backup/restore" > >> are totally separate features, but we have separate JIRA for fault > >> tolerance (HBASE-14413). > >> > >> -Vlad > >> > >> On Thu, Sep 1, 2016 at

[jira] [Created] (HBASE-16545) Add backup test where data is ingested during backup procedure

2016-09-01 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16545: -- Summary: Add backup test where data is ingested during backup procedure Key: HBASE-16545 URL: https://issues.apache.org/jira/browse/HBASE-16545 Project: HBase Issue

[jira] [Created] (HBASE-16542) Skip full backup in selected backup tests

2016-09-01 Thread Ted Yu (JIRA)
Ted Yu created HBASE-16542: -- Summary: Skip full backup in selected backup tests Key: HBASE-16542 URL: https://issues.apache.org/jira/browse/HBASE-16542 Project: HBase Issue Type: Test

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-01 Thread Ted Yu
Sean: Please see HBASE-14413 for the last question. FYI On Thu, Sep 1, 2016 at 9:24 AM, Sean Busbey wrote: > On Sat, Aug 20, 2016 at 12:59 PM, Vladimir Rodionov > wrote: > > Not sure what do you mean, Andrew by "trying out the branch via the IT", >

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

2016-09-01 Thread Ted Yu
ready > for > >> commit Ted. > >> > >> I will be able to spend some time next week trying out the branch via > the > >> IT, and poking around with the new tools. After that I feel like I'll be > >> informed enough to vote on a branch merge vote. > &g

[jira] [Resolved] (HBASE-16255) Backup/Restore IT

2016-08-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HBASE-16255. Resolution: Fixed > Backup/Restore IT > - > > Key:

<    4   5   6   7   8   9   10   11   12   13   >