#19437: Find more reliable and universal way to get ASN and ASorg mappings -------------------------------------------------+------------------------- Reporter: twim | Owner: Type: project | Status: new Priority: Medium | Milestone: Component: Metrics/Onionoo | Version: Severity: Normal | Resolution: Keywords: asn, as, geoip, maxmind, bgp, | Actual Points: organisations, diversity | Points: Parent ID: | Sponsor: Reviewer: | -------------------------------------------------+-------------------------
Comment (by cypherpunks): As a stopgap solution for the currently broken MaxMind DB, I trying to repair at least nameless maxmind entries with data from http://thyme.apnic.net/current/data-used-autnums quick'n dirty solution (this reduces nameless AS entries by 49k records): {{{ #convert data-used-autnums into a csv file and prefix AS numbers with "AS" sed 's/^[ \t]*//' data-used-autnums.orig | sed 's/ /,/'|sed 's/"//g'|awk '{ print "AS" $0 }'|sort -t, -k 1b,1 > data-used-autnums.csv #get all maxmind entries without AS names grep -v '"' GeoIPASNum2.csv.orig |sort -t, -k 3 > nameless_AS_entries join -o 1.1,1.2,1.3,2.2 -a 1 -t, -1 3 -2 1 nameless_AS_entries data- used-autnums.csv|awk -F, '{ print $1 "," $2 ",." $3 " " $4 "."}'|sed 's,\.,",g' > repaired_entries grep '"' GeoIPASNum2.csv.orig > entries_with_names cat entries_with_names repaired_entries > GeoIPASNum2.csv.partially- repaired }}} Note: also records with AS names are broken (but I'm not touching them) https://lists.torproject.org/pipermail/tor-dev/2016-June/011095.html would be great to have at least a workaround deployed soon - otherwise I'll have to postprocess onionoo data before using it. -- Ticket URL: <https://trac.torproject.org/projects/tor/ticket/19437#comment:6> Tor Bug Tracker & Wiki <https://trac.torproject.org/> The Tor Project: anonymity online _______________________________________________ tor-bugs mailing list tor-bugs@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs