Fwd: Error while running github feature from .asf.yaml in hbase-connectors!

2021-08-24 Thread Peter Somogyi
Hi,

I merged a commit to hbase-connectors from GitHub and got this automated
email from Infra.
The .asf.yaml files look identical in hbase [1] and hbase-connectors [2]
repositories.
Do you have any idea what could be the problem?

- Peter

[1] https://github.com/apache/hbase/blob/master/.asf.yaml
[2] https://github.com/apache-connectors/hbase/blob/master/.asf.yaml


-- Forwarded message -
From: Apache Infrastructure 
Date: Tue, Aug 24, 2021 at 11:00 AM
Subject: Error while running github feature from .asf.yaml in
hbase-connectors!
To: , 



An error occurred while running github feature in .asf.yaml!:
dump_all() got an unexpected keyword argument 'sort_keys'


[jira] [Created] (HBASE-26219) Negative time is logged while waiting on regionservers

2021-08-24 Thread Peter Somogyi (Jira)
Peter Somogyi created HBASE-26219:
-

 Summary: Negative time is logged while waiting on regionservers
 Key: HBASE-26219
 URL: https://issues.apache.org/jira/browse/HBASE-26219
 Project: HBase
  Issue Type: Bug
Reporter: Peter Somogyi


On Master startup when waiting on RegionServers to report in the log message 
displays a negative time for the lastChange time.
 
{noformat}
2021-07-30 06:49:02,882 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=1502ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-1502ms
2021-07-30 06:49:03,693 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:04,384 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=3004ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-3004ms
2021-07-30 06:49:04,694 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:05,694 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:05,886 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=4506ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-4506ms
2021-07-30 06:49:06,695 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:07,389 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=6009ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-6009ms
2021-07-30 06:49:07,695 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:08,700 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:08,891 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=7511ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-7511ms
2021-07-30 06:49:09,701 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:10,393 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=9013ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-9013ms
2021-07-30 06:49:10,701 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:11,702 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:11,896 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=10516ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-10516ms
2021-07-30 06:49:12,702 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:13,398 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=12018ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-12018ms
2021-07-30 06:49:13,703 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:14,703 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:14,900 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=13520ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-13520ms
2021-07-30 06:49:15,704 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:16,402 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=0; waited=15022ms, expecting min=1 server(s), 
max=NO_LIMIT server(s), timeout=4500ms, lastChange=-15022ms
2021-07-30 06:49:16,704 WARN 
org.apache.hadoop.hbase.master.assignment.AssignmentManager: No servers 
available; cannot place 1 unassigned regions.
2021-07-30 06:49:16,778 INFO org.apache.hadoop.hbase.master.ServerManager: 
Registering regionserver=example.com,16020,1627627573364
2021-07-30 06:49:16,803 INFO org.apache.hadoop.hbase.master.ServerManager: 
Waiting on regionserver count=1; waited=15423ms, expecting min=1 server(s), 
max=NO_LIMIT server

[jira] [Created] (HBASE-26220) Use P2P communicate between region servers to sync the list for bootstrap node

2021-08-24 Thread Duo Zhang (Jira)
Duo Zhang created HBASE-26220:
-

 Summary: Use P2P communicate between region servers to sync the 
list for bootstrap node
 Key: HBASE-26220
 URL: https://issues.apache.org/jira/browse/HBASE-26220
 Project: HBase
  Issue Type: Sub-task
Reporter: Duo Zhang


For returning bootstrap nodes to client, we do not need to always track exactly 
the current live region server. But now, we just set a watcher on zookeeper to 
watch all the live region servers, on every region server, for large cluster, 
it will be a big pressure for zookeeper.

So here I think, we could let region servers to communicate with each other to 
sync the available bootstrap node, like a P2P network.

Will put a simple design doc soon.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (HBASE-26173) Return only a sub set of region servers as bootstrap nodes

2021-08-24 Thread Duo Zhang (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-26173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang resolved HBASE-26173.
---
Hadoop Flags: Reviewed
Assignee: Duo Zhang
  Resolution: Fixed

Pushed to master and branch-2.

Thanks [~bharathv] for reviewing.

> Return only a sub set of region servers as bootstrap nodes
> --
>
> Key: HBASE-26173
> URL: https://issues.apache.org/jira/browse/HBASE-26173
> Project: HBase
>  Issue Type: Sub-task
>  Components: Client
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> For some large clusters we may have thousands of region servers, I do not 
> think we need to return all the region servers as bootstrap nodes. For me I 
> think ten servers is enough for a client usually?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (HBASE-26135) Backport HBASE-25616 "Upgrade opentelemetry to 1.0.0" to branch-2

2021-08-24 Thread Tak-Lon (Stephen) Wu (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-26135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tak-Lon (Stephen) Wu resolved HBASE-26135.
--
Resolution: Fixed

> Backport HBASE-25616 "Upgrade opentelemetry to 1.0.0" to branch-2
> -
>
> Key: HBASE-26135
> URL: https://issues.apache.org/jira/browse/HBASE-26135
> Project: HBase
>  Issue Type: Sub-task
>  Components: tracing
>Affects Versions: 2.5.0
>Reporter: Tak-Lon (Stephen) Wu
>Assignee: Tak-Lon (Stephen) Wu
>Priority: Major
> Fix For: 2.5.0
>
>
> 12/17 commits of HBASE-22120, original commits 
> [{{8399293}}|https://github.com/apache/hbase/commit/8399293e21127df3ffdcb757242e4cb5964c7e99]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Resolved] (HBASE-26136) Backport HBASE-25723 "Temporarily remove the trace support for RegionScanner.next" to branch-2

2021-08-24 Thread Tak-Lon (Stephen) Wu (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-26136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tak-Lon (Stephen) Wu resolved HBASE-26136.
--
Resolution: Fixed

commit pushed to 
[https://github.com/apache/hbase/commit/817cfe1bf2c23de8cae178e0f96462ab5da33a59]

Thanks [~zhangduo] for reviewing.

> Backport HBASE-25723 "Temporarily remove the trace support for 
> RegionScanner.next" to branch-2
> --
>
> Key: HBASE-26136
> URL: https://issues.apache.org/jira/browse/HBASE-26136
> Project: HBase
>  Issue Type: Sub-task
>  Components: tracing
>Affects Versions: 2.5.0
>Reporter: Tak-Lon (Stephen) Wu
>Assignee: Tak-Lon (Stephen) Wu
>Priority: Major
> Fix For: 2.5.0
>
>
> 13/17 commits of HBASE-22120, original commit 
> [{{7f90c22}}|https://github.com/apache/hbase/commit/7f90c2201f6a17d2e2d031505c35ae7c2b1ed7ea]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HBASE-26221) Report flaky jenkins job should have the ability to submit flaky tests manually

2021-08-24 Thread Duo Zhang (Jira)
Duo Zhang created HBASE-26221:
-

 Summary: Report flaky jenkins job should have the ability to 
submit flaky tests manually
 Key: HBASE-26221
 URL: https://issues.apache.org/jira/browse/HBASE-26221
 Project: HBase
  Issue Type: Improvement
  Components: jenkins, test
Reporter: Duo Zhang


Recently our pre commit result is very unstable due to some flaky tests, such 
as TestReplicationDroppedTable, but it never fails in nightly builds so we 
never include it in the flaky list.

I think our find flaky jenkins job should allow submitting tests manually.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (HBASE-26222) Backport HBASE-26204 to branch-2:

2021-08-24 Thread Shinya Yoshida (Jira)
Shinya Yoshida created HBASE-26222:
--

 Summary: Backport HBASE-26204 to branch-2: 
 Key: HBASE-26222
 URL: https://issues.apache.org/jira/browse/HBASE-26222
 Project: HBase
  Issue Type: Sub-task
Reporter: Shinya Yoshida






--
This message was sent by Atlassian Jira
(v8.3.4#803005)