[jira] [Resolved] (HBASE-23657) AsyncAdmin does not throw table operation exceptions

2020-01-07 Thread Nick Dimiduk (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-23657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nick Dimiduk resolved HBASE-23657.
--
Resolution: Invalid

not a problem. [~zhangduo] and [~bharathv] showed me the error of my ways. 
thanks lads.

> AsyncAdmin does not throw table operation exceptions
> 
>
> Key: HBASE-23657
> URL: https://issues.apache.org/jira/browse/HBASE-23657
> Project: HBase
>  Issue Type: Bug
>  Components: asyncclient, Client
>Reporter: Nick Dimiduk
>Priority: Major
> Attachments: 23657-demo-tests.patch
>
>
> {{AsyncAdmin}} does not propagate table operation exceptions back to the 
> caller.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[REPORT] HBase Quarterly report Oct-Dec 2019

2020-01-07 Thread Duo Zhang
Hi all,

HBase submits a report to the ASF board once a quarter, to inform the board
about project health. I'm sending the report to the user@ and dev@ mailing
lists because you are the project, and for transparency. If you have any
questions about the report or the running of the project, you can pose them
to any PMC member or committer, or send an email to priv...@hbase.apache.org
,
which every PMC member subscribes to.


## Description:
Apache HBase is an open-source, distributed, versioned, non-relational
database. Apache HBase gives you low latency random access to billions of
rows
with millions of columns atop non-specialized hardware.

hbase-thirdparty is a set of internal artifacts used by the project to
mitigate the impact of our dependency choices on the wider ecosystem.

hbase-connectors is a collection of integration points with other projects.
The initial release includes artifacts for use with Apache Kafka and Apache
Spark.

hbase-filesystem contains HBase project-specific implementations of the
Apache
Hadoop FileSystem API. It is currently experimental and internal to the
project.

hbase-operator-tools is a collection of tools for HBase operators. Now it is
mainly for hosting HBCK2.

hbase-native-client is a client library in C/C++, in its early days.

## Issues:

## Membership Data:
Apache HBase was founded 2010-04-21 (10 years ago)
There are currently 87 committers and 52 PMC members in this project.
The Committer-to-PMC ratio is roughly 3:2.

Community changes, past quarter:
- Guangxu Cheng was added to the PMC on 2019-12-09
- Balazs Meszaros was added to the PMC on 2019-10-24
- Sakthi was added to the PMC on 2019-10-23
- Wellington Chevreuil was added to the PMC on 2019-10-23
- Ankit Singhal was added as committer on 2019-11-13
- Viraj Jasani was added as committer on 2019-12-27

## Project Activity:
Recent releases:

2.1.8 was released on 2019-12-03.
1.4.12 was released on 2019-11-29.
2.2.2 was released on 2019-10-25.
1.4.11 was released on 2019-10-24.
1.3.6 was released on 2019-10-20.
2.1.7 was released on 2019-10-08.

There are lots of users still on branch-1.x, there were some discussions
about
the release plan for branch-1.x.

About the versioning and 1.5.1 release
https://s.apache.org/krmcu

About the EOL of branch-1.3
https://s.apache.org/b2jac

We decided to use GitHub PR instead of Review Board officially, since Review
Board is only available to committers now.
https://s.apache.org/mkkld

We decided to cut branch-2.3 soon and EOL branch-2.1, Nick Dimiduk
volunteered
to be the release manager of branch-2.3.
https://s.apache.org/bwr9g

We discussed the hadoop versions and release plan for 3.0.0, Sean Busbey
volunteered to be the release manager of 3.0.0 and start to make alpha
releases for 3.0.0.
https://s.apache.org/gih8e
https://s.apache.org/u4lfo

## Community Health:
- Mailing list activity:
dev@hbase.apache.org:
990 subscribers(1015 in the previous quarter)
1157 emails sent to list(1297 in the previous quarter)

u...@hbase.apache.org:
2121 subscribers(2150 in the previous quarter)
144 emails sent to list(268 in the previous quarter)

- JIRA activity:
312 issues opened in JIRA, past quarter (-37% decrease)
211 issues closed in JIRA, past quarter (-46% decrease)

- Commit activity:
834 commits in the past quarter (-53% decrease)
73 code contributors in the past quarter (-22% decrease)

- GitHub PR activity:
297 PRs opened on GitHub, past quarter (-27% decrease)
267 PRs closed on GitHub, past quarter (-36% decrease)

I think the number decreasing is partly because the long holiday in China in
October, and also the Chrismas holiday in some western countries in
December.
And also, since branch-2 gets more and more stable, the number of bug fixes
will also be decreased day by day. We have already started to make the 3.0.0
release and bring more new features to the community.


[jira] [Created] (HBASE-23658) Fix flaky TestSnapshotFromMaster

2020-01-07 Thread Guanghao Zhang (Jira)
Guanghao Zhang created HBASE-23658:
--

 Summary: Fix flaky TestSnapshotFromMaster
 Key: HBASE-23658
 URL: https://issues.apache.org/jira/browse/HBASE-23658
 Project: HBase
  Issue Type: Bug
Reporter: Guanghao Zhang


testAsyncSnapshotWillNotBlockSnapshotHFileCleaner is flaky.  The assert may 
fail.
{code:java}
assertTrue(master.getSnapshotManager().isTakingAnySnapshot());
future.get(); // in branch-2.2, here is Thread.sleep
assertFalse(master.getSnapshotManager().isTakingAnySnapshot());
{code}
See 
[https://builds.apache.org/job/HBase-Flaky-Tests/job/master/5227/testReport/junit/org.apache.hadoop.hbase.master.cleaner/TestSnapshotFromMaster/testAsyncSnapshotWillNotBlockSnapshotHFileCleaner/]

 

[https://builds.apache.org/view/H-L/view/HBase/job/HBase-Find-Flaky-Tests/job/branch-2.2/lastSuccessfulBuild/artifact/dashboard.html]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HBASE-23657) AsyncAdmin does not throw table operation exceptions

2020-01-07 Thread Nick Dimiduk (Jira)
Nick Dimiduk created HBASE-23657:


 Summary: AsyncAdmin does not throw table operation exceptions
 Key: HBASE-23657
 URL: https://issues.apache.org/jira/browse/HBASE-23657
 Project: HBase
  Issue Type: Bug
  Components: asyncclient, Client
Reporter: Nick Dimiduk


{{AsyncAdmin}} does not propagate table operation exceptions back to the caller.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Requesting an invite for hbase slack channel

2020-01-07 Thread Ankit Singhal
Hi Amarnath,

Just sent you the invitation.

Regards,
Ankit Singhal

On Tue, Jan 7, 2020 at 11:12 AM Amarnath Ramamoorthi 
wrote:

> Hi Team,
>
> Please add me on the slack channel https://apache-hbase.slack.com/
>
> You can know more about me using LinkedIn:
> https://www.linkedin.com/in/amarnath-r
>
> Looking forward for the invitation.
>
> Kind regards,
> Amar.
>


Requesting an invite for hbase slack channel

2020-01-07 Thread Amarnath Ramamoorthi
Hi Team,

Please add me on the slack channel https://apache-hbase.slack.com/

You can know more about me using LinkedIn:
https://www.linkedin.com/in/amarnath-r

Looking forward for the invitation.

Kind regards,
Amar.


[jira] [Created] (HBASE-23656) [MERGETOOL]JDHBASE Support Merge region by pattern

2020-01-07 Thread zhengsicheng (Jira)
zhengsicheng created HBASE-23656:


 Summary: [MERGETOOL]JDHBASE Support Merge region by pattern
 Key: HBASE-23656
 URL: https://issues.apache.org/jira/browse/HBASE-23656
 Project: HBase
  Issue Type: New Feature
  Components: master
Reporter: zhengsicheng
 Fix For: 3.0.0


Usage: bin/hbase onlinemerge [--tableName=] [--startRegion=] [--stopRegion=] 
[--maxRegionSize=] [--maxRegionCreateTime=] [--numMaxMergePlans=] 
[--targetRegionCount=] [--printExecutionPlan=] [--configMergePauseTime=]

Options:
--h or --h print help
--tableName table name must be not null
--startRegion start region
--stopRegion stop region
--maxRegionSize max region size Unit GB
--maxRegionCreateTime max Region Create Time /MM/dd HH:mm:ss
--numMaxMergePlans num MaxMerge Plans
--targetRegionCount target Region Count
--configMergePauseTime config Merge Pause Time In milliseconds
--printExecutionPlan Value default is true print execution plans false is 
execution merge

Examples:
bin/hbase onlinemerge --tableName=test:test1 
--startRegion=test:test1,,1576835912332.01d0d6c2b41e204104524d9aec6074fb. 
--stopRegion=test:test1,,1573044786980.0c9b5bd93f3b19eb9bd1a1011ddff66f.
 --maxRegionSize=0 --maxRegionCreateTime=/MM/dd HH:mm:ss 
--numMaxMergePlans=2 --targetRegionCount=4 --printExecutionPlan=false



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Make ClusterManager interface and it's implementations as Consumable Public API

2020-01-07 Thread Lokesh Khurana
Hi HBase Devs,

Currently, Chaos Monkey does all the destructive actions by using
passwordless-ssh with the help of HbaseClusterManager Class.
This class uses RemoteShell and CommandProvider classes to perform
these actions.

In our test framework,we are trying to bypass passwordless-ssh to perform
destructive actions of Chaos Monkey.
For these, we want to extend HBaseClusterManager Class (or ClusterManager
interface) so we can create task in ZooKeeper,
which will be executed by our framework as local action for intended hosts.

Here ClusterManager Interface and its implementation HBaseClusterManager
class are InterfaceAudience.Private, so they are not visible outside
package level access.
Also any implementation of ClusterManager needs to be merged with hbase-it
package.
CommandProvider Class, which creates commands for ssh based actions, has
access type default in HBaseClusterManager class, because of that we can
not re-use CommandProvider class.

To have our own implementation outside hbase-testing-util, we wanted to
make this classes InterfaceAudience.Public. As discussed on HBASE-23640
, it would be an
anti-pattern to expose these API directly.
Currently We have thought of below improvements to do in hbase-it package
to achieve our goal :-

1. Move ClusterManager interface and its implementation out of hbase-it
package and create a separate artifact (Exposing them directly won't be a
right approach)
2. Make ClusterManager interface as well as it's implementation public so
it can be extended with minimum effort.
3. Separate out CommandProvider Class

Currently we have filled two JIRAs :- HBASE-23639
 HBASE-23640


It would be helpful to get more suggestions for theses changes and how to
implement them like weather we need to move this into separate
hbase-package.

-- 
Thanks,
Lokesh


[jira] [Created] (HBASE-23655) Fix flaky TestRSGroupsKillRS: should wait the SCP to finish

2020-01-07 Thread Guanghao Zhang (Jira)
Guanghao Zhang created HBASE-23655:
--

 Summary: Fix flaky TestRSGroupsKillRS: should wait the SCP to 
finish
 Key: HBASE-23655
 URL: https://issues.apache.org/jira/browse/HBASE-23655
 Project: HBase
  Issue Type: Bug
Affects Versions: 2.2.2
Reporter: Guanghao Zhang






--
This message was sent by Atlassian Jira
(v8.3.4#803005)