Reconcile recovered items too high for some of my peers
Hi, It has been probably raised in the past as a question, but I’m wondering what the issue might be that some of my peers are sending quite a lot of updates to my cluster. See attached graph for clarity. Question is, do I miss some `master` commits in my Hockeypuck build or some settings to prevent this from happening. Majority of the traffic to the cluster is now recon. Not that it matters as I’m not charged by traffic volume but bandwidth. Thanks for your help in advance, Martin Dobrev
Re: Reconcile recovered items too high for some of my peers
On 16/12/2021 13:38, Martin Dobrev wrote: Hi, It has been probably raised in the past as a question, but I’m wondering what the issue might be that some of my peers are sending quite a lot of updates to my cluster. See attached graph for clarity. Question is, do I miss some `master` commits in my Hockeypuck build or some settings to prevent this from happening. Majority of the traffic to the cluster is now recon. Not that it matters as I’m not charged by traffic volume but bandwidth. Can you tell which of your peers are reporting the large deltas? Are they predominantly SKS or Hockeypuck? -- Andrew Gallagher OpenPGP_signature Description: OpenPGP digital signature
Re: Reconcile recovered items too high for some of my peers
> On 16 Dec 2021, at 13:57, Andrew Gallagher wrote: > > On 16/12/2021 13:38, Martin Dobrev wrote: >> Hi, >> It has been probably raised in the past as a question, but I’m wondering >> what the issue might be that some of my peers are sending quite a lot of >> updates to my cluster. See attached graph for clarity. Question is, do I >> miss some `master` commits in my Hockeypuck build or some settings to >> prevent this from happening. Majority of the traffic to the cluster is now >> recon. Not that it matters as I’m not charged by traffic volume but >> bandwidth. > > Can you tell which of your peers are reporting the large deltas? Are they > predominantly SKS or Hockeypuck? Two of the peers are SKS, third one is Hockeypuck. And a bit of detail - first two entries from the graph belong to the same cluster, just having two real IPs assigned. > > -- > Andrew Gallagher >
Re: Reconcile recovered items too high for some of my peers
On 16/12/2021 14:06, Martin Dobrev wrote: Two of the peers are SKS, third one is Hockeypuck. And a bit of detail - first two entries from the graph belong to the same cluster, just having two real IPs assigned. There are two possible causes of this, and I suspect both are at work to some extent. The first, which will mostly affect your SKS peers, is the growing number of oversized keys that are accumulating on the SKS side of the graph and will never reconcile with any modern Hockeypuck (although what counts as "oversized" is a local parameter and so varies a bit). The second (and more concerning IMO) issue is churn, which appears to affect to varying degrees any peer relationship involving at least one Hockeypuck server. I suspect (but cannot yet prove) that Hockeypuck calculates key hashes (which are NOT fingerprints) inconsistently in some cases, perhaps due to packet reordering. I don't currently understand the code well enough to debug this properly (but perhaps somebody else here does?). -- Andrew Gallagher OpenPGP_signature Description: OpenPGP digital signature
