Re: An appeal for more bandwidth to the Internet Archive
Internet Archive primary office is located at 300 Funston in San Francisco. This was a Christian Science church so it has the roman columns you would expect for a church / library. You can see it on Google Street Views at: https://www.google.com/maps/place/300+Funston+Ave,+San+Francisco,+CA+94118 Although they serve content out of this site, their primary site for bandwidth is at 2512 Florida Ave, Richmond, CA. IA does have satellite offices around the world for scanning, etc., the public facing servers are location in these two locations. Tim On 5/12/20 9:24 PM, Terrence Koeman wrote: Aren't they in a former church or something? I vaguely remember their location to be significant for some reason or another. So location may weigh heavily. -- Regards, Terrence Koeman, PhD/MTh/BPsy Darkness Reigns (Holding) B.V. Please quote relevant replies. Spelling errors courtesy of my 'smart'phone. *From:* David Hubbard *Sent:* Wednesday, 13 May 2020 06:02 *To:* nanog@nanog.org *Subject:* Re: An appeal for more bandwidth to the Internet Archive Could the operation be moved out of California to achieve dramatically reduced operating costs and perhaps solve some problems via cost savings vs increased donation? I have to imagine with the storage and processing requirements that the footprint and power usage in SFO is quite costly. I have equipment in a few California colo's and it's easily 3x what I pay for similar in Nevada, before even getting into tax abatement advantages. On 5/12/20, 1:33 PM, "NANOG on behalf of colin johnston" wrote: Is the increased usage due to more users or more existing users having higher bandwidth at home to request faster ? Would be interested if IPS configured firewall used to block out invalid traffic/spam traffic and if such traffic increased when back end network capacity increased ? What countries are requesting the most data and does this analysis throw up questions as to why ? Are there high network usage hitters which raise question as to why asking for so much data time and time again and is this valid traffic use ? Colin > On 12 May 2020, at 17:33, Tim Požár wrote: > > Jared... > > Thanks for sharing this. I was the first Director of Operations from '96 to '98, at was was then Internet Archive/Alex. I was the network architect back then got them their ASN and original address space. Folks may also know, I help start SFMIX with Matt Peterson. > > A bit more detail in this... Some of this I got from Jonah Edwards who is the current Network Architect at IA. Yes, the bottle neck was the line cards. They have upgraded and that has certainly helped the bandwidth of late. > > Peering would be a big help for IA. At this point they have two 10Gb LAG interfaces that show up on SFMIX that was turned up last February. Looking at the last couple of weeks the 95th percentile on this 20Gb LAG is 3 Gb. As they just turned up on SFMIX, they are just starting to get peers turned up there. Eyeball networks that show up on SFMIX are highly encouraged to start peering with them. Alas, they are v4 only at this point. > > Additionally, if folks do have some fat pipes that can donate bandwidth at 200 Paul, I am sure Jonah won't turn it down. > > Tim > > On 5/12/20 4:45 AM, Jared Brown wrote: >> Hello all! >> Last week the Internet Archive upgraded their bandwidth 30% from 47 Gbps to 62 Gbps. It was all gobbled up immediately. There's a lovely solid green graph showing how usage grows vertically as each interface comes online until it too is 100% saturated. Looking at the graph legend you can see that their usage for the past 24 hours averages 49.76G on their 50G of transport. >> To see the pretty pictures follow the below link: >> https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/ >> Relevant parts from the blog post: >> "A year ago, usage was 30Gbits/sec. At the beginning of this year, we were at 40Gbits/sec, and we were handling it. ... >> Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our network infrastructure’s ability to handle it. So much so, our network statistics probes had difficulty collecting data (hence the white spots in the graphs). >> We bought a second router with new line cards, and got it installed and running (and none of this is easy during a pandemic), and increased our capacity from 47Gbits/sec peak to 62Gbits/sec peak. And we are handling it better, but it is still consumed." >> It is
Re: An appeal for more bandwidth to the Internet Archive
Aren't they in a former church or something? I vaguely remember their location to be significant for some reason or another. So location may weigh heavily. -- Regards, Terrence Koeman, PhD/MTh/BPsy Darkness Reigns (Holding) B.V. Please quote relevant replies. Spelling errors courtesy of my 'smart'phone. From: David Hubbard Sent: Wednesday, 13 May 2020 06:02 To: nanog@nanog.org Subject: Re: An appeal for more bandwidth to the Internet Archive > Could the operation be moved out of California to achieve dramatically > reduced operating costs and perhaps solve some problems via cost savings vs > increased donation? I have to imagine with the storage and processing > requirements that the footprint and power usage in SFO is quite costly. I > have equipment in a few California colo's and it's easily 3x what I pay for > similar in Nevada, before even getting into tax abatement advantages. > > > > On 5/12/20, 1:33 PM, "NANOG on behalf of colin johnston" > wrote: > > Is the increased usage due to more users or more existing users having > higher bandwidth at home to request faster ? > Would be interested if IPS configured firewall used to block out invalid > traffic/spam traffic and if such traffic increased when back end network > capacity increased ? > What countries are requesting the most data and does this analysis throw > up questions as to why ? > Are there high network usage hitters which raise question as to why > asking for so much data time and time again and is this valid traffic use ? > > Colin > > > > On 12 May 2020, at 17:33, Tim Požár wrote: > > > > Jared... > > > > Thanks for sharing this. I was the first Director of Operations from > '96 to '98, at was was then Internet Archive/Alex. I was the network > architect back then got them their ASN and original address space. Folks may > also know, I help start SFMIX with Matt Peterson. > > > > A bit more detail in this... Some of this I got from Jonah Edwards who > is the current Network Architect at IA. Yes, the bottle neck was the line > cards. They have upgraded and that has certainly helped the bandwidth of > late. > > > > Peering would be a big help for IA. At this point they have two 10Gb > LAG interfaces that show up on SFMIX that was turned up last February. > Looking at the last couple of weeks the 95th percentile on this 20Gb LAG is 3 > Gb. As they just turned up on SFMIX, they are just starting to get peers > turned up there. Eyeball networks that show up on SFMIX are highly encouraged > to start peering with them. Alas, they are v4 only at this point. > > > > Additionally, if folks do have some fat pipes that can donate bandwidth > at 200 Paul, I am sure Jonah won't turn it down. > > > > Tim > > > > On 5/12/20 4:45 AM, Jared Brown wrote: > >> Hello all! > >> Last week the Internet Archive upgraded their bandwidth 30% from 47 > Gbps to 62 Gbps. It was all gobbled up immediately. There's a lovely solid > green graph showing how usage grows vertically as each interface comes online > until it too is 100% saturated. Looking at the graph legend you can see that > their usage for the past 24 hours averages 49.76G on their 50G of transport. > >> To see the pretty pictures follow the below link: > >> > https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/ > > >> Relevant parts from the blog post: > >> "A year ago, usage was 30Gbits/sec. At the beginning of this year, we > were at 40Gbits/sec, and we were handling it. ... > >> Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our > network infrastructure’s ability to handle it. So much so, our network > statistics probes had difficulty collecting data (hence the white spots in > the graphs). > >> We bought a second router with new line cards, and got it installed > and running (and none of this is easy during a pandemic), and increased our > capacity from 47Gbits/sec peak to 62Gbits/sec peak. And we are handling it > better, but it is still consumed." > >> It is obvious that the Internet Archive needs more bandwidth to power > the Wayback machine and to fulfill its mission of being the Internet library > and the historic archive of our times. > >> The Internet Archive is present at Digital Realty SFO (200 Paul) and a > member of the San Francisco Metropolitan Internet Exchange (SFMIX). > >> I appeal to all list members present or capable of getting to these > facilities to peer with and/or donate bandwidth to the Internet Archive. > >> I appeal to all vendors and others with equipment that they can donate > to the Internet Archive to contact them so that they can scale their services > and sustain their growth. > >> The Internet Archive is currently running 10G equipment. If you can > hel
FCC Report on 2019 Nationwide Emergency Alert Test
FCC published its 2019 nationwide EAS test report. The issues haven't changed, and some improved. "With respect to the single largest complication reported from the 2019 nationwide EAS test results – namely, issues with monitoring source failures – FEMA notes that it is actively taking measures to improve PEP performance going forward. In particular, FEMA has begun working with SECCs in several states to conduct state-level tests on a monthly basis and station-level tests on a weekly basis through the PEP stations. FEMA emphasizes that continued testing of the PEP stations will improve EAS performance over time, as this testing will help ensure the PEP stations are relaying messages properly through the EAS and allow stakeholders to make ongoing improvements and adjustments as needed." FCC's Public Safety and Homeland Security Bureau issues a report on the August 7, 2019 nationwide Emergency Alert System test https://www.fcc.gov/document/fcc-report-2019-nationwide-emergency-alert-test
Re: An appeal for more bandwidth to the Internet Archive
Heh. I just did this recently as I started a low power FM station (KPEA-LP). I did a bulk download of about 10,000 cuts of IA's 78 collection from 1923 and earlier as those recordings are all in the public domain. Tim On 5/12/20 11:50 AM, Tom Hayward wrote: On Tue, May 12, 2020 at 10:32 AM colin johnston wrote: Is the increased usage due to more users or more existing users having higher bandwidth at home to request faster ? Would be interested if IPS configured firewall used to block out invalid traffic/spam traffic and if such traffic increased when back end network capacity increased ? What countries are requesting the most data and does this analysis throw up questions as to why ? Are there high network usage hitters which raise question as to why asking for so much data time and time again and is this valid traffic use ? Amongst a certain group of users, bulk downloading of the archive is popular: https://www.reddit.com/r/DataHoarder/comments/an8srw/is_there_anyway_to_bulk_download_collections_from/ Tom
Re: An appeal for more bandwidth to the Internet Archive
Could the operation be moved out of California to achieve dramatically reduced operating costs and perhaps solve some problems via cost savings vs increased donation? I have to imagine with the storage and processing requirements that the footprint and power usage in SFO is quite costly. I have equipment in a few California colo's and it's easily 3x what I pay for similar in Nevada, before even getting into tax abatement advantages. On 5/12/20, 1:33 PM, "NANOG on behalf of colin johnston" wrote: Is the increased usage due to more users or more existing users having higher bandwidth at home to request faster ? Would be interested if IPS configured firewall used to block out invalid traffic/spam traffic and if such traffic increased when back end network capacity increased ? What countries are requesting the most data and does this analysis throw up questions as to why ? Are there high network usage hitters which raise question as to why asking for so much data time and time again and is this valid traffic use ? Colin > On 12 May 2020, at 17:33, Tim Požár wrote: > > Jared... > > Thanks for sharing this. I was the first Director of Operations from '96 to '98, at was was then Internet Archive/Alex. I was the network architect back then got them their ASN and original address space. Folks may also know, I help start SFMIX with Matt Peterson. > > A bit more detail in this... Some of this I got from Jonah Edwards who is the current Network Architect at IA. Yes, the bottle neck was the line cards. They have upgraded and that has certainly helped the bandwidth of late. > > Peering would be a big help for IA. At this point they have two 10Gb LAG interfaces that show up on SFMIX that was turned up last February. Looking at the last couple of weeks the 95th percentile on this 20Gb LAG is 3 Gb. As they just turned up on SFMIX, they are just starting to get peers turned up there. Eyeball networks that show up on SFMIX are highly encouraged to start peering with them. Alas, they are v4 only at this point. > > Additionally, if folks do have some fat pipes that can donate bandwidth at 200 Paul, I am sure Jonah won't turn it down. > > Tim > > On 5/12/20 4:45 AM, Jared Brown wrote: >> Hello all! >> Last week the Internet Archive upgraded their bandwidth 30% from 47 Gbps to 62 Gbps. It was all gobbled up immediately. There's a lovely solid green graph showing how usage grows vertically as each interface comes online until it too is 100% saturated. Looking at the graph legend you can see that their usage for the past 24 hours averages 49.76G on their 50G of transport. >> To see the pretty pictures follow the below link: >> https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/ >> Relevant parts from the blog post: >> "A year ago, usage was 30Gbits/sec. At the beginning of this year, we were at 40Gbits/sec, and we were handling it. ... >> Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our network infrastructure’s ability to handle it. So much so, our network statistics probes had difficulty collecting data (hence the white spots in the graphs). >> We bought a second router with new line cards, and got it installed and running (and none of this is easy during a pandemic), and increased our capacity from 47Gbits/sec peak to 62Gbits/sec peak. And we are handling it better, but it is still consumed." >> It is obvious that the Internet Archive needs more bandwidth to power the Wayback machine and to fulfill its mission of being the Internet library and the historic archive of our times. >> The Internet Archive is present at Digital Realty SFO (200 Paul) and a member of the San Francisco Metropolitan Internet Exchange (SFMIX). >> I appeal to all list members present or capable of getting to these facilities to peer with and/or donate bandwidth to the Internet Archive. >> I appeal to all vendors and others with equipment that they can donate to the Internet Archive to contact them so that they can scale their services and sustain their growth. >> The Internet Archive is currently running 10G equipment. If you can help them gain 100G connectivity, 100G routing, 100G switching and/or 100G DWDM capabilities, please reach out to them. They have the infrastructure and dark fiber to transition to 100G, but lack the equipment. You can find the Internet Archive's contact information below or you can contact Jonah at the Archive Org directly either by email or via the contact information available on his Twitter profile @jonahedwards. >> You can also donate at https://archive.org/donate/ >> The Internet Archive is a 501(c)(3) non-profit. Donations are tax-deductible. >> Contact information: >> https://archive.org/about/contact.php >> Volunteering: >> https://archive.o
Re: An appeal for more bandwidth to the Internet Archive
Is the increased usage due to more users or more existing users having higher bandwidth at home to request faster ? Would be interested if IPS configured firewall used to block out invalid traffic/spam traffic and if such traffic increased when back end network capacity increased ? What countries are requesting the most data and does this analysis throw up questions as to why ? Are there high network usage hitters which raise question as to why asking for so much data time and time again and is this valid traffic use ? Colin > On 12 May 2020, at 17:33, Tim Požár wrote: > > Jared... > > Thanks for sharing this. I was the first Director of Operations from '96 to > '98, at was was then Internet Archive/Alex. I was the network architect back > then got them their ASN and original address space. Folks may also know, I > help start SFMIX with Matt Peterson. > > A bit more detail in this... Some of this I got from Jonah Edwards who is > the current Network Architect at IA. Yes, the bottle neck was the line > cards. They have upgraded and that has certainly helped the bandwidth of > late. > > Peering would be a big help for IA. At this point they have two 10Gb LAG > interfaces that show up on SFMIX that was turned up last February. Looking at > the last couple of weeks the 95th percentile on this 20Gb LAG is 3 Gb. As > they just turned up on SFMIX, they are just starting to get peers turned up > there. Eyeball networks that show up on SFMIX are highly encouraged to start > peering with them. Alas, they are v4 only at this point. > > Additionally, if folks do have some fat pipes that can donate bandwidth at > 200 Paul, I am sure Jonah won't turn it down. > > Tim > > On 5/12/20 4:45 AM, Jared Brown wrote: >> Hello all! >> Last week the Internet Archive upgraded their bandwidth 30% from 47 Gbps to >> 62 Gbps. It was all gobbled up immediately. There's a lovely solid green >> graph showing how usage grows vertically as each interface comes online >> until it too is 100% saturated. Looking at the graph legend you can see that >> their usage for the past 24 hours averages 49.76G on their 50G of transport. >> To see the pretty pictures follow the below link: >> https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/ >> Relevant parts from the blog post: >> "A year ago, usage was 30Gbits/sec. At the beginning of this year, we were >> at 40Gbits/sec, and we were handling it. ... >> Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our network >> infrastructure’s ability to handle it. So much so, our network statistics >> probes had difficulty collecting data (hence the white spots in the graphs). >> We bought a second router with new line cards, and got it installed and >> running (and none of this is easy during a pandemic), and increased our >> capacity from 47Gbits/sec peak to 62Gbits/sec peak. And we are handling it >> better, but it is still consumed." >> It is obvious that the Internet Archive needs more bandwidth to power the >> Wayback machine and to fulfill its mission of being the Internet library and >> the historic archive of our times. >> The Internet Archive is present at Digital Realty SFO (200 Paul) and a >> member of the San Francisco Metropolitan Internet Exchange (SFMIX). >> I appeal to all list members present or capable of getting to these >> facilities to peer with and/or donate bandwidth to the Internet Archive. >> I appeal to all vendors and others with equipment that they can donate to >> the Internet Archive to contact them so that they can scale their services >> and sustain their growth. >> The Internet Archive is currently running 10G equipment. If you can help >> them gain 100G connectivity, 100G routing, 100G switching and/or 100G DWDM >> capabilities, please reach out to them. They have the infrastructure and >> dark fiber to transition to 100G, but lack the equipment. You can find the >> Internet Archive's contact information below or you can contact Jonah at the >> Archive Org directly either by email or via the contact information >> available on his Twitter profile @jonahedwards. >> You can also donate at https://archive.org/donate/ >> The Internet Archive is a 501(c)(3) non-profit. Donations are >> tax-deductible. >> Contact information: >> https://archive.org/about/contact.php >> Volunteering: >> https://archive.org/about/volunteerpositions.php >> Disclaimer: I am not affiliated with the Internet Archive. Nobody asked me >> to write this post. If something angers you about this post, be angry at me. >> I merely think that the Internet Archive is a good thing and deserves our >> support. >> Jared
Re: An appeal for more bandwidth to the Internet Archive
Jared... Thanks for sharing this. I was the first Director of Operations from '96 to '98, at was was then Internet Archive/Alex. I was the network architect back then got them their ASN and original address space. Folks may also know, I help start SFMIX with Matt Peterson. A bit more detail in this... Some of this I got from Jonah Edwards who is the current Network Architect at IA. Yes, the bottle neck was the line cards. They have upgraded and that has certainly helped the bandwidth of late. Peering would be a big help for IA. At this point they have two 10Gb LAG interfaces that show up on SFMIX that was turned up last February. Looking at the last couple of weeks the 95th percentile on this 20Gb LAG is 3 Gb. As they just turned up on SFMIX, they are just starting to get peers turned up there. Eyeball networks that show up on SFMIX are highly encouraged to start peering with them. Alas, they are v4 only at this point. Additionally, if folks do have some fat pipes that can donate bandwidth at 200 Paul, I am sure Jonah won't turn it down. Tim On 5/12/20 4:45 AM, Jared Brown wrote: Hello all! Last week the Internet Archive upgraded their bandwidth 30% from 47 Gbps to 62 Gbps. It was all gobbled up immediately. There's a lovely solid green graph showing how usage grows vertically as each interface comes online until it too is 100% saturated. Looking at the graph legend you can see that their usage for the past 24 hours averages 49.76G on their 50G of transport. To see the pretty pictures follow the below link: https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/ Relevant parts from the blog post: "A year ago, usage was 30Gbits/sec. At the beginning of this year, we were at 40Gbits/sec, and we were handling it. ... Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our network infrastructure’s ability to handle it. So much so, our network statistics probes had difficulty collecting data (hence the white spots in the graphs). We bought a second router with new line cards, and got it installed and running (and none of this is easy during a pandemic), and increased our capacity from 47Gbits/sec peak to 62Gbits/sec peak. And we are handling it better, but it is still consumed." It is obvious that the Internet Archive needs more bandwidth to power the Wayback machine and to fulfill its mission of being the Internet library and the historic archive of our times. The Internet Archive is present at Digital Realty SFO (200 Paul) and a member of the San Francisco Metropolitan Internet Exchange (SFMIX). I appeal to all list members present or capable of getting to these facilities to peer with and/or donate bandwidth to the Internet Archive. I appeal to all vendors and others with equipment that they can donate to the Internet Archive to contact them so that they can scale their services and sustain their growth. The Internet Archive is currently running 10G equipment. If you can help them gain 100G connectivity, 100G routing, 100G switching and/or 100G DWDM capabilities, please reach out to them. They have the infrastructure and dark fiber to transition to 100G, but lack the equipment. You can find the Internet Archive's contact information below or you can contact Jonah at the Archive Org directly either by email or via the contact information available on his Twitter profile @jonahedwards. You can also donate at https://archive.org/donate/ The Internet Archive is a 501(c)(3) non-profit. Donations are tax-deductible. Contact information: https://archive.org/about/contact.php Volunteering: https://archive.org/about/volunteerpositions.php Disclaimer: I am not affiliated with the Internet Archive. Nobody asked me to write this post. If something angers you about this post, be angry at me. I merely think that the Internet Archive is a good thing and deserves our support. Jared
Re: Alternative for Google Safe Browsing for Network Administrators?
I didn't even know that was a thing. I just went to sign up to see what it was like before it disappeared. They appear to be using a very old database. One of our ASNs that we've had for five years still has the old entity's contact information for the verification. Another (32-bit) ASN that I've had for five years doesn't show up at all. I hope that when they transition to a paid service that it is ran a bit better. - Mike Hammett Intelligent Computing Solutions http://www.ics-il.com Midwest-IX http://www.midwest-ix.com - Original Message - From: "David Hubbard" To: nanog@nanog.org Sent: Tuesday, May 12, 2020 7:20:49 AM Subject: Alternative for Google Safe Browsing for Network Administrators? Just received notice that Google is eliminating the Safe Browsing for Network Administrators service…. in favor of a new paid alternative; imagine that. Are there recommended similar services out there that will send netblock owners alerts related to suspected compromised websites, malware distribution, C&C, etc. activity? Thanks
Alternative for Google Safe Browsing for Network Administrators?
Just received notice that Google is eliminating the Safe Browsing for Network Administrators service…. in favor of a new paid alternative; imagine that. Are there recommended similar services out there that will send netblock owners alerts related to suspected compromised websites, malware distribution, C&C, etc. activity? Thanks
An appeal for more bandwidth to the Internet Archive
Hello all! Last week the Internet Archive upgraded their bandwidth 30% from 47 Gbps to 62 Gbps. It was all gobbled up immediately. There's a lovely solid green graph showing how usage grows vertically as each interface comes online until it too is 100% saturated. Looking at the graph legend you can see that their usage for the past 24 hours averages 49.76G on their 50G of transport. To see the pretty pictures follow the below link: https://blog.archive.org/2020/05/11/thank-you-for-helping-us-increase-our-bandwidth/ Relevant parts from the blog post: "A year ago, usage was 30Gbits/sec. At the beginning of this year, we were at 40Gbits/sec, and we were handling it. ... Then Covid-19 hit and demand rocketed to 50Gbits/sec and overran our network infrastructure’s ability to handle it. So much so, our network statistics probes had difficulty collecting data (hence the white spots in the graphs). We bought a second router with new line cards, and got it installed and running (and none of this is easy during a pandemic), and increased our capacity from 47Gbits/sec peak to 62Gbits/sec peak. And we are handling it better, but it is still consumed." It is obvious that the Internet Archive needs more bandwidth to power the Wayback machine and to fulfill its mission of being the Internet library and the historic archive of our times. The Internet Archive is present at Digital Realty SFO (200 Paul) and a member of the San Francisco Metropolitan Internet Exchange (SFMIX). I appeal to all list members present or capable of getting to these facilities to peer with and/or donate bandwidth to the Internet Archive. I appeal to all vendors and others with equipment that they can donate to the Internet Archive to contact them so that they can scale their services and sustain their growth. The Internet Archive is currently running 10G equipment. If you can help them gain 100G connectivity, 100G routing, 100G switching and/or 100G DWDM capabilities, please reach out to them. They have the infrastructure and dark fiber to transition to 100G, but lack the equipment. You can find the Internet Archive's contact information below or you can contact Jonah at the Archive Org directly either by email or via the contact information available on his Twitter profile @jonahedwards. You can also donate at https://archive.org/donate/ The Internet Archive is a 501(c)(3) non-profit. Donations are tax-deductible. Contact information: https://archive.org/about/contact.php Volunteering: https://archive.org/about/volunteerpositions.php Disclaimer: I am not affiliated with the Internet Archive. Nobody asked me to write this post. If something angers you about this post, be angry at me. I merely think that the Internet Archive is a good thing and deserves our support. Jared
