Re: [tor-dev] additional triggers for DocTor?

2015-06-05 Thread Damian Johnson 
Hi nusenu. DocTor's current sybil checker [1] is quite simple and
there's a lot of directions in which it can be improved. You and
others are more than welcome to improve it - patches very welcome. :)

[1] https://gitweb.torproject.org/doctor.git/tree/sybil_checker.py


On Fri, Jun 5, 2015 at 9:38 AM, nusenu  wrote:
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA512
>
> Hi Damian,
>
> does DocTor's design allow for triggers that alert if a certain amount
> of relays signed up within one day or within a week (instead of within
> one hour)?
>
> Another trigger could be the last_restarted timestamp.
>
> If that makes sense I would file feature requests on trac and provide
> some possible thresholds.
>
> Example of an event that would trigger then (2015-04-01):
> https://lists.torproject.org/pipermail/tor-talk/2015-April/037384.html
> -BEGIN PGP SIGNATURE-
>
> iQIcBAEBCgAGBQJVcdCSAAoJEFv7XvVCELh0l5IP/R0NeXImuchqastZcg4T4PK7
> Qy5VmFrWBdG9AOnypxIMgzVF5/M+hKjRgbbAp9/VrRXqpbFCgnChnQvqyJcW1nB0
> AYGfqEUfavTBthbtTfq6g43BLBZke0olBMVFlKHaAYTidXMabrY0OlZ3QjdHt1Sx
> DovQ/zGVX263VR1YZimXom1xokCDm7J51vPURjx9BLrBQ2zdEGvOWWwdT+w1CiaK
> iH4I0AGUPZfLxxLU7rCorFAIV2AyKTT97EN9lQlD3TtPmoDiZdhPthR2MRKVruEP
> 3Kt76VDMRPro6oKo2d3sk5UFuyh0Hg+yqJhTJhjdZ0w/ZQtbIjlkHbnfSqgthEPL
> fi2XKQrX1BSfbQpsig70FRFHgKEQVzplXLlca9o1sn52GrwdY8fzNLc0p8xZiFSc
> xoognuyER4IgLP10c2QsYSoCx50yfpYOxDZIEFVIelDDKGIqVQzR/rGRwBfXBcn/
> 598SPhka+h0BK/NudG/k5qRlsdWpQdygeAfDBUUO6AxHaIH2P96Pe1CfxNkoMGX4
> TWZ2+pTXye6wdiFhdhDYGPuCtmOgI5GQ5alHEvsk3s7/n0YitRRNHNiNe3SGw7UN
> hX6HQuWmxD5J/D1fcj5gC/gJZxkeluTRO6iOP1AoNAqP9XGgQeT7uwhL+FzT65V5
> GlMIH20AeBn2FWIesaxf
> =Ia4Q
> -END PGP SIGNATURE-
> ___
> tor-dev mailing list
> tor-dev@lists.torproject.org
> https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev

[tor-dev] additional triggers for DocTor?

2015-06-05 Thread nusenu 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

Hi Damian,

does DocTor's design allow for triggers that alert if a certain amount
of relays signed up within one day or within a week (instead of within
one hour)?

Another trigger could be the last_restarted timestamp.

If that makes sense I would file feature requests on trac and provide
some possible thresholds.

Example of an event that would trigger then (2015-04-01):
https://lists.torproject.org/pipermail/tor-talk/2015-April/037384.html
-BEGIN PGP SIGNATURE-

iQIcBAEBCgAGBQJVcdCSAAoJEFv7XvVCELh0l5IP/R0NeXImuchqastZcg4T4PK7
Qy5VmFrWBdG9AOnypxIMgzVF5/M+hKjRgbbAp9/VrRXqpbFCgnChnQvqyJcW1nB0
AYGfqEUfavTBthbtTfq6g43BLBZke0olBMVFlKHaAYTidXMabrY0OlZ3QjdHt1Sx
DovQ/zGVX263VR1YZimXom1xokCDm7J51vPURjx9BLrBQ2zdEGvOWWwdT+w1CiaK
iH4I0AGUPZfLxxLU7rCorFAIV2AyKTT97EN9lQlD3TtPmoDiZdhPthR2MRKVruEP
3Kt76VDMRPro6oKo2d3sk5UFuyh0Hg+yqJhTJhjdZ0w/ZQtbIjlkHbnfSqgthEPL
fi2XKQrX1BSfbQpsig70FRFHgKEQVzplXLlca9o1sn52GrwdY8fzNLc0p8xZiFSc
xoognuyER4IgLP10c2QsYSoCx50yfpYOxDZIEFVIelDDKGIqVQzR/rGRwBfXBcn/
598SPhka+h0BK/NudG/k5qRlsdWpQdygeAfDBUUO6AxHaIH2P96Pe1CfxNkoMGX4
TWZ2+pTXye6wdiFhdhDYGPuCtmOgI5GQ5alHEvsk3s7/n0YitRRNHNiNe3SGw7UN
hX6HQuWmxD5J/D1fcj5gC/gJZxkeluTRO6iOP1AoNAqP9XGgQeT7uwhL+FzT65V5
GlMIH20AeBn2FWIesaxf
=Ia4Q
-END PGP SIGNATURE-
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev

Re: [tor-dev] onionoo: bug in family set detection?

2015-06-05 Thread nusenu 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

saitos...@ymail.com:
> I ran some tests to investigate said onionoo bug.

thanks.

Please see the relevant trac entry for the current situation:
https://trac.torproject.org/projects/tor/ticket/16276

to make it short: onionoo displays descriptor data (declared but not
effective/verified family sets)

Until leeroy's tra post I believed onionoo's documentation.

So the things are clear, it just needs someone to fix it.
-BEGIN PGP SIGNATURE-

iQIcBAEBCgAGBQJVccaIAAoJEFv7XvVCELh0j7wP/jlTGEiZCxdjAtuN3tK9935O
12+kWmAV8RfujNLBgfZNOFf7Xu51IF0lTFDAtcbBtu33VyZIS+vdNgozS8h7wI31
cxyi2RkamtzoNRDP/gEDZgbeoArGm4MT9LjI2zbV1nC/L7LZtdxgXjAzAprFkfN2
fUOiOqzXsjmsYtw24mzu5tdH+TwP9GSinZ8Hnli0GsO6CBP0RvF95AY5bOFPURL3
HtGVTyUWwiFPBxBcpd7MJA3nv/tjI2vxs/p/2o+2hTt8y1c2rY/gDduktoHsmVAQ
uATRg2SaYRvfyFJD4zmKSeramoyHinSPVl4HuYsswX6M+NxC0lkrS7e1SLNRbK5g
sL+WgDG0hdxc/H3rHQc5GJ9SwZ/l1ImMiX1lILOMQDCgT0+Xb9149++OZbnbTlWJ
cz46YRDj+ve2rWfmJ3lfCi7B45P9TLZHDeGNr3jMKbbomWPce+gynXHSrAhcHsTb
kKGMKWPJLLRbsPxKfk2h7b8Eaa18MQa2oP6DO8j4t4jX65kyraS924YGWpLvsSr9
e4w0Z7an0wSZT5Cg1crZ17xz9p+P8u0VzHd4eosZdUJm7AY0XYhogsetQvfImL4/
004vpOVRgqVlhf8QyjSB+JBp/5uGpl4cU/lyrcOu06YV/l215PQuqY+SyB3TmSGW
jy4GYEnXGH562b7V6o6H
=dX3W
-END PGP SIGNATURE-
___
tor-dev mailing list
tor-dev@lists.torproject.org
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev

Re: [tor-dev] onionoo: bug in family set detection?

2015-06-05 Thread saitosean 
I ran some tests to investigate said onionoo bug.

My test case is simply as follows:

Get the set of all running relays from onionoo (ignore non-running relays for 
the sake of convenience)
For each relay (relay A) in the set, and for each relay (relay B) in relay A’s 
family, check to see whether relay A is included in relay B’s family. If not, 
there is no bidirectionality.


The results (Number of running relays = 6774):


Number of bidirectional pairs: 5911

Number of non-bidirectional pairs: 532

Number of pairs where either relay has not family list at all: 49



Sean



From: tor-dev-requ...@lists.torproject.org
Sent: ‎Wednesday‎, ‎June‎ ‎3‎, ‎2015 ‎9‎:‎00‎ ‎PM
To: tor-dev@lists.torproject.org

Send tor-dev mailing list submissions to
 tor-dev@lists.torproject.org

To subscribe or unsubscribe via the World Wide Web, visit
 https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-dev
or, via email, send a message with subject or body 'help' to
 tor-dev-requ...@lists.torproject.org

You can reach the person managing the list at
 tor-dev-ow...@lists.torproject.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of tor-dev digest..."


Today's Topics:

   1. Re: onionoo: bug in family set detection? (teor)
   2. Re: onionoo: bug in family set detection? (nusenu)
   3. Re: onionoo: bug in family set detection? (l.m)
   4. Researching Tor: Quantifying anonymity against a global
  passive adversary (Florian R?chel)


--

Message: 1
Date: Wed, 3 Jun 2015 07:11:48 +1000
From: teor 
To: tor-dev@lists.torproject.org
Subject: Re: [tor-dev] onionoo: bug in family set detection?
Message-ID: <9bc4820f-a4e9-4168-bfcf-0e292524b...@gmail.com>
Content-Type: text/plain; charset="us-ascii"

Date: Tue, 02 Jun 2015 16:52:00 +
From: nusenu 
> 
> teor:
> > MyFamily requires bidirectional declarations to be effective.
> 
> I'm aware of that fact ;)
> 
> > In this case: OnionOO appears to correctly implement the
> > bidirectional MyFamily logic
> 
> Apparently it doesn't.
> 
> Since onionoo says there is a bidirectional "connection" (family) between
> 5510FC1736B16D46D3F2DDA5011995C478D42594 =>
> 0C77421C890D16B6D201283A2244F43DF5BC89DD
> 
> but there is none.. (as explained in my last email)
> 
> Compass does *not* say that there is a bidirectional connection
> between those relays..  onionoo says there is one even though I can't
> see it, do you see it?

I'm sorry, I must have got the onionoo and Compass results mixed up somehow.

In Compass, I see that:
5510FC1736B16D46D3F2DDA5011995C478D42594 has no family.

In Globe/Atlas (based on onionoo), I see that:
5510FC1736B16D46D3F2DDA5011995C478D42594 has a very large family.

So my criticism of Compass actually applies to onionoo.

teor

teor2345 at gmail dot com
pgp 0xABFED1AC
https://gist.github.com/teor2345/d033b8ce0a99adbc89c5

teor at blah dot im
OTR D5BE4EC2 255D7585 F3874930 DB130265 7C9EBBC7

-- next part --
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 832 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: 


--

Message: 2
Date: Tue, 02 Jun 2015 21:58:52 +
From: nusenu 
To: tor-dev@lists.torproject.org
Subject: Re: [tor-dev] onionoo: bug in family set detection?
Message-ID: <556e271c.20...@openmailbox.org>
Content-Type: text/plain; charset=windows-1252

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512

https://trac.torproject.org/projects/tor/ticket/16276
-BEGIN PGP SIGNATURE-

iQIcBAEBCgAGBQJVbiccAAoJEFv7XvVCELh0/rUP/i7Q/cZwYaklkvHAaqmsDffK
x8J77/21/5ppN1kyPd8jI7M8ktOC+1uqhV4mlf5CyidKR+2kAhhPYjfX57xQ1sbv
OJwDq33EbQiTk/ed3DLQdQpbrt7fqaAzZi3+q2NIKMx2/GFRs6Sxnp7D9b69TEt3
WgW2sEuAuexl//HU01dKxPXp6+5EiW6UBz0eUJcTz4WUf/+CltRBg4sbBXImls3w
J5mLqMNwyrRT/StTZB5oSMHsOfxQGgGGJppT0l91onQLzpM1A38ZtgN2zs5tD6T9
OSl7hwhUJHaWR3mg9vDywXO0CQ8tTadfZLGtDU0q5H88vU00jTRW1XA7bKLxtLqY
INu9APIjnOhaatVTRGhJMMvP/Vuk6OE/L9n2FBw5FAPxmJ3Tn0+NwElamYizq7o8
AMNpWcfjHxAiH7R9PEuhwYyNktlBz3Swm4uNFvSGPaJsm99lxJLmd7ko9qrxd5Cm
WcmQvPpfXN9Ym5iTWlMpu17MLmBGb2YgshFv+fTViCY1JwaEqAlTP+5/m2XmnM2x
8CZgNHjL1C7QWffx6AQYqcoAP183ClR3MD9poan7LMYfaqxXIbLceCzMOKeu9Ptt
KPAdPAvACngB9kz43oQeJanE/nmjW90j/hr5oPezL57ayJEvpRiT+cmkkRTT2RvB
Aj2Q3IqrXhOzTJkR+N94
=pTF3
-END PGP SIGNATURE-


--

Message: 3
Date: Tue, 02 Jun 2015 19:47:33 -0400
From: "l.m" 
To: tor-dev@lists.torproject.org
Subject: Re: [tor-dev] onionoo: bug in family set detection?
Message-ID: <20150602234733.2d552e0...@smtp.hushmail.com>
Content-Type: text/plain; charset="utf-8"

Hello,

DirAuth's can cache multiple versions of the descriptor  and serve
what appears to be the newest in a given consensus interval.  This
coupled with routers publishing descriptors at least every 18  hours,
but potentia