[tor-relays] Consensus Weight Dropping/Authority Issues?

[John Ricketts]

Hello,

I have been watching the consensus weight and bandwidth of all of my 50 exit 
nodes drop consistently over the past few months. I have not made any hardware 
changes in my data center and actual customers have not complained about any 
performance issues.

Operating systems and Tor version are up to date. I'm dedicating a significant 
portion of bandwidth to these nodes - 10gbit/sec.

Am I having issues with the bandwidth authorities?

I'm growing frustrated with my performance to resources ratio, I should be 
doing far better than this.

Please throw ideas at me - open to any ideas.

Thanks!
John
Quintex Alliance Consulting
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[Toralf Förster]

On 1/7/20 1:57 PM, John Ricketts wrote:
> I have been watching the consensus weight and bandwidth of all of my 50 exit 
> nodes drop consistently over the past few months. I have not made any 
> hardware changes in my data center


Which correlates to https://metrics.torproject.org/bandwidth.html - your 
fraction just decreases if more and more relays join the party.

-- 
Toralf



signature.asc
Description: OpenPGP digital signature
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[John Ricketts]

It seems disproportionate though.  I'm only using 2gbit/sec of my circuit and I 
have plenty of hardware ceiling left. Feels like i'm doing something else wrong.



> On Jan 7, 2020, at 07:30, Toralf Förster  wrote:
> 
> On 1/7/20 1:57 PM, John Ricketts wrote:
>> I have been watching the consensus weight and bandwidth of all of my 50 exit 
>> nodes drop consistently over the past few months. I have not made any 
>> hardware changes in my data center
> 
> 
> Which correlates to https://metrics.torproject.org/bandwidth.html - your 
> fraction just decreases if more and more relays join the party.
> 
> -- 
> Toralf
> 
> ___
> tor-relays mailing list
> tor-relays@lists.torproject.org
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[John Ricketts]

I also would like to add to this - if it were just the Tor network increasing 
in size I could see my consensus weight dropping and my bandwidth staying the 
same.  I'm simply not getting the 7-8gbit/sec traffic I was.  Truly odd.

-Original Message-
From: tor-relays  On Behalf Of Toralf 
Förster
Sent: Tuesday, January 7, 2020 7:30 AM
To: tor-relays@lists.torproject.org
Subject: Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

On 1/7/20 1:57 PM, John Ricketts wrote:
> I have been watching the consensus weight and bandwidth of all of my 50 exit 
> nodes drop consistently over the past few months. I have not made any 
> hardware changes in my data center


Which correlates to https://metrics.torproject.org/bandwidth.html - your 
fraction just decreases if more and more relays join the party.

-- 
Toralf

___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[r1610091651]

consensus means what fraction of traffic will pass over your nodes,
statistically speaking.
Hence a steady drop of consensus value, with no infra changes on your end,
could also be explained by a stead rise of total bandwidth available: since
your part is fixed and total grows, your fraction reduces.


Regards

On Tue, 7 Jan 2020 at 14:04, John Ricketts  wrote:

> Hello,
>
> I have been watching the consensus weight and bandwidth of all of my 50
> exit nodes drop consistently over the past few months. I have not made any
> hardware changes in my data center and actual customers have not complained
> about any performance issues.
>
> Operating systems and Tor version are up to date. I'm dedicating a
> significant portion of bandwidth to these nodes - 10gbit/sec.
>
> Am I having issues with the bandwidth authorities?
>
> I'm growing frustrated with my performance to resources ratio, I should be
> doing far better than this.
>
> Please throw ideas at me - open to any ideas.
>
> Thanks!
> John
> Quintex Alliance Consulting
> ___
> tor-relays mailing list
> tor-relays@lists.torproject.org
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
>
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[niftybunny]

Months ago John beat my exit consensus weight. The Tor network didn’t grew 
substantially in this timeframe but he lost around 2/3 of his traffic while I 
was stable.

> On 7. Jan 2020, at 14:30, Toralf Förster  wrote:
> 
> Signed PGP part
> On 1/7/20 1:57 PM, John Ricketts wrote:
>> I have been watching the consensus weight and bandwidth of all of my 50 exit 
>> nodes drop consistently over the past few months. I have not made any 
>> hardware changes in my data center
> 
> 
> Which correlates to https://metrics.torproject.org/bandwidth.html - your 
> fraction just decreases if more and more relays join the party.
> 
> --
> Toralf
> 
> 
> 



signature.asc
Description: Message signed with OpenPGP
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[r1610091651]

Consensus & usage are independent
consensus: based on available bandwidth
load: based on usage by tor clients.

if total available bw increases but load doesn't, observed load on a node
will drop.

On Tue, 7 Jan 2020 at 17:27, John Ricketts  wrote:

> I also would like to add to this - if it were just the Tor network
> increasing in size I could see my consensus weight dropping and my
> bandwidth staying the same.  I'm simply not getting the 7-8gbit/sec traffic
> I was.  Truly odd.
>
> -Original Message-
> From: tor-relays  On Behalf Of
> Toralf Förster
> Sent: Tuesday, January 7, 2020 7:30 AM
> To: tor-relays@lists.torproject.org
> Subject: Re: [tor-relays] Consensus Weight Dropping/Authority Issues?
>
> On 1/7/20 1:57 PM, John Ricketts wrote:
> > I have been watching the consensus weight and bandwidth of all of my 50
> exit nodes drop consistently over the past few months. I have not made any
> hardware changes in my data center
>
>
> Which correlates to https://metrics.torproject.org/bandwidth.html - your
> fraction just decreases if more and more relays join the party.
>
> --
> Toralf
>
> ___
> tor-relays mailing list
> tor-relays@lists.torproject.org
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
>
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[John Ricketts]

Totally agree with your analysis on this- my concern is that if that were true 
I'd see Nifty's 15 percent drop like a rock too...  and drop from 7-8gbit/sec 
to 2-3gb/sec is weird.

You'd think that I'd be saturated.  I've been running these nodes approximately 
three years and I've never seen this.

John

On Jan 7, 2020, at 11:28, r1610091651  wrote:

?
consensus means what fraction of traffic will pass over your nodes, 
statistically speaking.
Hence a steady drop of consensus value, with no infra changes on your end, 
could also be explained by a stead rise of total bandwidth available: since 
your part is fixed and total grows, your fraction reduces.


Regards

On Tue, 7 Jan 2020 at 14:04, John Ricketts 
mailto:j...@quintex.com>> wrote:
Hello,

I have been watching the consensus weight and bandwidth of all of my 50 exit 
nodes drop consistently over the past few months. I have not made any hardware 
changes in my data center and actual customers have not complained about any 
performance issues.

Operating systems and Tor version are up to date. I'm dedicating a significant 
portion of bandwidth to these nodes - 10gbit/sec.

Am I having issues with the bandwidth authorities?

I'm growing frustrated with my performance to resources ratio, I should be 
doing far better than this.

Please throw ideas at me - open to any ideas.

Thanks!
John
Quintex Alliance Consulting
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[niftybunny]

> On 7. Jan 2020, at 18:20, r1610091651  wrote:
> 
> Consensus & usage are independent
> consensus: based on available bandwidth
> load: based on usage by tor clients.
> 
> if total available bw increases but load doesn't, observed load on a node 
> will drop.

We are talking about Exists.


  b n
> 
> On Tue, 7 Jan 2020 at 17:27, John Ricketts  <mailto:j...@quintex.com>> wrote:
> I also would like to add to this - if it were just the Tor network increasing 
> in size I could see my consensus weight dropping and my bandwidth staying the 
> same.  I'm simply not getting the 7-8gbit/sec traffic I was.  Truly odd.
> 
> -Original Message-
> From: tor-relays  <mailto:tor-relays-boun...@lists.torproject.org>> On Behalf Of Toralf Förster
> Sent: Tuesday, January 7, 2020 7:30 AM
> To: tor-relays@lists.torproject.org <mailto:tor-relays@lists.torproject.org>
> Subject: Re: [tor-relays] Consensus Weight Dropping/Authority Issues?
> 
> On 1/7/20 1:57 PM, John Ricketts wrote:
> > I have been watching the consensus weight and bandwidth of all of my 50 
> > exit nodes drop consistently over the past few months. I have not made any 
> > hardware changes in my data center
> 
> 
> Which correlates to https://metrics.torproject.org/bandwidth.html 
> <https://metrics.torproject.org/bandwidth.html> - your fraction just 
> decreases if more and more relays join the party.
> 
> --
> Toralf
> 
> ___
> tor-relays mailing list
> tor-relays@lists.torproject.org <mailto:tor-relays@lists.torproject.org>
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays 
> <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays>
> ___
> tor-relays mailing list
> tor-relays@lists.torproject.org
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays



signature.asc
Description: Message signed with OpenPGP
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[nusenu]

Do you have any insights in your DNS performance (response time, cache hitrate) 
and qps rate over time?

(please don't publish it)



-- 
https://mastodon.social/@nusenu
https://twitter.com/nusenu



signature.asc
Description: OpenPGP digital signature
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[starlight . 2018q2]

The rating shift experienced by your relays and many others is likely a 
consequence of the gradual phase-in of the SBWS scanner implementation in place 
of TorFlow.  I for one find SWBS unimpressive.

>Hello,
>
>I have been watching the consensus weight and bandwidth of all of my 50 exit 
>nodes drop consistently over the past few months. I have not made any hardware 
>changes in my data center and actual 
>customers have not complained about any performance issues.
>
>Operating systems and Tor version are up to date. I'm dedicating a significant 
>portion of bandwidth to these nodes - 10gbit/sec.
>
>Am I having issues with the bandwidth authorities?
>
>I'm growing frustrated with my performance to resources ratio, I should be 
>doing far better than this.
>
>Please throw ideas at me - open to any ideas.
>
>Thanks!
>John
>Quintex Alliance Consulting

___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[John Ricketts]

Thank you for your thoughts. :)

> On Feb 1, 2020, at 20:05, "starlight.201...@binnacle.cx" 
>  wrote:
> 
> The rating shift experienced by your relays and many others is likely a 
> consequence of the gradual phase-in of the SBWS scanner implementation in 
> place of TorFlow.  I for one find SWBS unimpressive.
> 
>> Hello,
>> 
>> I have been watching the consensus weight and bandwidth of all of my 50 exit 
>> nodes drop consistently over the past few months. I have not made any 
>> hardware changes in my data center and actual 
>> customers have not complained about any performance issues.
>> 
>> Operating systems and Tor version are up to date. I'm dedicating a 
>> significant portion of bandwidth to these nodes - 10gbit/sec.
>> 
>> Am I having issues with the bandwidth authorities?
>> 
>> I'm growing frustrated with my performance to resources ratio, I should be 
>> doing far better than this.
>> 
>> Please throw ideas at me - open to any ideas.
>> 
>> Thanks!
>> John
>> Quintex Alliance Consulting
> 
> ___
> tor-relays mailing list
> tor-relays@lists.torproject.org
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[teor]

Hi John,

>> On 2 Feb 2020, at 14:15, John Ricketts  wrote:
>> 
>> I have been watching the consensus weight and bandwidth of all of my 50 exit 
>> nodes drop consistently over the past few months. I have not made any 
>> hardware changes in my data center and actual
>> customers have not complained about any performance issues.
>> 
>> Operating systems and Tor version are up to date. I'm dedicating a 
>> significant portion of bandwidth to these nodes - 10gbit/sec.
>> 
>> Am I having issues with the bandwidth authorities?
>> 
>> I'm growing frustrated with my performance to resources ratio, I should be 
>> doing far better than this.
>> 
>> Please throw ideas at me - open to any ideas.
> 
> On Feb 1, 2020, at 20:05, "starlight.201...@binnacle.cx" 
>  wrote:
> 
> The rating shift experienced by your relays and many others is likely a 
> consequence of the gradual phase-in of the SBWS scanner implementation in 
> place of TorFlow.  I for one find SWBS unimpressive.

There are known bugs in both bandwidth authority implementations,
sbws and torflow. Here's a list of the critical sbws bugs:
https://trac.torproject.org/projects/tor/query?status=!closed&keywords=~sbws-majority-blocker

We're working on getting some funding to fix these bugs in sbws.

(Torflow is very old and hard to install, most of its dependencies are
unsupported. So we aren't tracking torflow bugs in detail any more.)

I don't think we've added any sbws instances for a few months. And I
haven't seen any specific evidence that sbws (or torflow) is
responsible for these issues.

If you give us a timeframe, we might be able to help more.

It's also possible that there are more exits in the Tor network, or
that the routing between the bandwidth authorities and your network
has become slower.

There are some other common explanations for slow relays, listed on
this wiki page:
https://trac.torproject.org/projects/tor/wiki/doc/MyRelayIsSlow

You might find some of the tips on that page helpful.

Also, if you can find some authorities that are giving your relays
low measurements, we might be able to find out why.

You can see a copy of all the bandwidth authority measurements here:
https://consensus-health.torproject.org/consensus-health.html

T

--
teor
--



signature.asc
Description: Message signed with OpenPGP
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[teor]

Hi John,

> On 7 Jan 2020, at 22:57, John Ricketts  wrote:
> 
> I have been watching the consensus weight and bandwidth of all of my 50 exit 
> nodes drop consistently over the past few months. I have not made any 
> hardware changes in my data center and actual customers have not complained 
> about any performance issues.
> 
> Operating systems and Tor version are up to date. I'm dedicating a 
> significant portion of bandwidth to these nodes - 10gbit/sec.
> 
> Am I having issues with the bandwidth authorities?
> 
> I'm growing frustrated with my performance to resources ratio, I should be 
> doing far better than this.

Did you ever find an answer here?

What have you analysed?
Have you tried any config changes?

Can you tell us which directory authorities are measuring your relays lower
than they were before?

The most likely scenarios are:
* Routing changes between your relays and the bandwidth authorities
* The Torflow to sbws transition
* Did you upgrade your tor version?
  Most of the network upgraded to tor 0.4.1 and 0.4.2 recently:
  https://metrics.torproject.org/versions.html?start=2019-09-01&end=2020-03-16

Did the consensus weight drop first, or did the observed bandwidth drop first?

You've probably read this wiki page before, but just in case:
https://trac.torproject.org/projects/tor/wiki/doc/MyRelayIsSlow#FindingOutwhatisLimitingaRelay

T



signature.asc
Description: Message signed with OpenPGP
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

Re: [tor-relays] Consensus Weight Dropping/Authority Issues?

[Sebastian Hahn]

Hi all,

> On 16. Mar 2020, at 07:43, teor  wrote:
>> On 7 Jan 2020, at 22:57, John Ricketts  wrote:
>> 
>> I have been watching the consensus weight and bandwidth of all of my 50 exit 
>> nodes drop consistently over the past few months. I have not made any 
>> hardware changes in my data center and actual customers have not complained 
>> about any performance issues.
>> 
>> Operating systems and Tor version are up to date. I'm dedicating a 
>> significant portion of bandwidth to these nodes - 10gbit/sec.
>> 
>> Am I having issues with the bandwidth authorities?
>> 
>> I'm growing frustrated with my performance to resources ratio, I should be 
>> doing far better than this.
> 
> Did you ever find an answer here?
> 
> What have you analysed?
> Have you tried any config changes?
> 
> Can you tell us which directory authorities are measuring your relays lower
> than they were before?
> 
> The most likely scenarios are:
> * Routing changes between your relays and the bandwidth authorities
> * The Torflow to sbws transition
> * Did you upgrade your tor version?
>  Most of the network upgraded to tor 0.4.1 and 0.4.2 recently:
>  https://metrics.torproject.org/versions.html?start=2019-09-01&end=2020-03-16
> 
> Did the consensus weight drop first, or did the observed bandwidth drop first?
> 
> You've probably read this wiki page before, but just in case:
> https://trac.torproject.org/projects/tor/wiki/doc/MyRelayIsSlow#FindingOutwhatisLimitingaRelay
> 
> T

Also I want to take this opportunity to say I'm desperately trying to
resurrect the old-style bw scanner on gabelmoo, but it isn't going too
well. Sorry if this outage is causing any kind of issues for anyone :(

Cheers
Sebastian
___
tor-relays mailing list
tor-relays@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays