Re: [PLUG] Moving 15 GB ... in 1970

2023-11-18 Thread Russell Senior
On Fri, Nov 17, 2023 at 8:57 PM Russell Senior wrote: > > > On Fri, Nov 17, 2023 at 7:02 PM Keith Lofstrom wrote: > >> > On Fri, Nov 17, 2023 at 08:26:21AM -0800, Rich Shepard wrote: >> > > I need to download ~15G of data from a web site. Using a PLUG mail >> list >> >> Apropos of not much, when

Re: [PLUG] Using wget to download all files from a web site

2023-11-18 Thread Rich Shepard
On Sat, 18 Nov 2023, Robert Citek wrote: Hope it helps. Thanks, Robert. Looking at files I downloaded I learned that I don't need all of them. The EPA requires all data to be analyzed using the wrong statistical paradigm. I want to select a few geochemical constituents and the benthic macroin

Re: [PLUG] Using wget to download all files from a web site

2023-11-18 Thread Robert Citek
Greetings, Rich. Hope it helps. A few notes: - I modified the notebook and ran it again to capture more data - I added headers to the notebook so that there is a minimal Table of Contents to make jumping around easier - the notebook mirrored the site in just under 5 minutes in the CoLab environme

Re: [PLUG] Moving 15 GB ... in 1970

2023-11-18 Thread Michael Ewan
Which is why, ages ago, we had the saying, "never underestimate the throughput of a station wagon full of tapes." Much more recently, in the early 2000's, after benchmarking a connection to South East Asia, we found that a daily transfer of large amounts of data was faster on DVD's and FedEx. On

Re: [PLUG] Moving 15 GB ... in 1970

2023-11-18 Thread John Sechrest
I was entirely surprised recently in Romania , when I was getting 590 Mps. It made the video edit and upload much much less painful. The difference of 50M and 500M was astonishing On Sat, Nov 18, 2023, 5:57 AM Russell Senior wrote: > On Fri, Nov 17, 2023 at 7:02 PM Keith Lofstrom wrote: > > >

Re: [PLUG] email services supporting IMAP

2023-11-18 Thread Rich Shepard
On Sat, 18 Nov 2023, Ted Mittelstaedt wrote: Ziply has no restrictions on individuals at home getting business accounts, Rich. That's true. I've run my business from my house for 30 years and have had a static IP address with all ISPs. Rich

Re: [PLUG] Moving 15 GB ... in 1970

2023-11-18 Thread Ted Mittelstaedt
Ooops For example the top of the line Netgear Nighthawk series only runs at 1 s/gigabit/gigahertz/ clock speed. That kills throughput. Ted

Re: [PLUG] email services supporting IMAP

2023-11-18 Thread Ted Mittelstaedt
Ziply has no restrictions on individuals at home getting business accounts, Rich. Another option is get a cheap virtual server on AWS and instead of paying a mail provider, setup a mailserver there. Or on Rapidspace or any other other cloud providers. Or you can get a bit more creative. I hav

Re: [PLUG] email services supporting IMAP

2023-11-18 Thread Rich Shepard
On Sat, 18 Nov 2023, Ted Mittelstaedt wrote: Or, you can do what I do and get a static IP and run your own mail server. Ted, FWIW, unless Ziply changed their policy only business domains can be assigned a static IP address (for $10/month); they don't support static IP addresses for personal d

Re: [PLUG] email services supporting IMAP

2023-11-18 Thread Ted Mittelstaedt
Or, you can do what I do and get a static IP and run your own mail server. Ted -Original Message- From: PLUG On Behalf Of Kevin Williams Sent: Friday, November 17, 2023 6:56 PM To: PLUG ; Galen Seitz ; plug Subject: Re: [PLUG] email services supporting IMAP Correction: $20/yr for Runb

Re: [PLUG] Using wget to download all files from a web site (2)

2023-11-18 Thread Ted Mittelstaedt
-Original Message- From: PLUG On Behalf Of Keith Lofstrom Sent: Friday, November 17, 2023 7:20 PM >There may be ways to rate-limit your bulk data request, so it doesn't trigger their rate-limits, and looks more like an obsessed human user. >I hypothesize; there are web provider proce

Re: [PLUG] Moving 15 GB ... in 1970

2023-11-18 Thread Ted Mittelstaedt
-Original Message- From: PLUG On Behalf Of Russell Senior Sent: Friday, November 17, 2023 8:57 PM To: Portland Linux/Unix Group Subject: Re: [PLUG] Moving 15 GB ... in 1970 >a) the bandwidth your plan claims does not factor in the speed at which the >rest of the internet will delive

Re: [PLUG] Using wget to download all files from a web site

2023-11-18 Thread Rich Shepard
On Sat, 18 Nov 2023, Robert Citek wrote: I was able to mirror the site in Google's Colab. Here's a gist with a notebook describing what I did and its output: https://gist.github.com/rwcitek/8d3035f6d2931d80f0569d3964fa6e28 In the notebook, you can click on the "Open in Colab" button to run th

Re: [PLUG] Using wget to download all files from a web site

2023-11-18 Thread Robert Citek
I was able to mirror the site in Google's Colab. Here's a gist with a notebook describing what I did and its output: https://gist.github.com/rwcitek/8d3035f6d2931d80f0569d3964fa6e28 In the notebook, you can click on the "Open in Colab" button to run the commands in your own Colab environment. R