On 2018-08-24 18:45, Lee wrote: > On 8/24/18, Steven Penny <svnp...@gmail.com> wrote: >> On Fri, 24 Aug 2018 19:30:10, Lee wrote: >>> In retrospect, I should have created the file some other way, but still.. >>> - grab the top 1M hosts from from >>> http://s3-us-west-1.amazonaws.com/umbrella-static/index.html >>> - open w/ libreoffice >>> - select the host name column, right click & select copy (all 1 million >>> lines) >>> - (mintty 2.9.0 window already open) vi /tmp/hosts >>> - i (get into insert mode) >>> - right click (which I have set to "paste") >>> >>> data is still scrolling by & it's not even up to 100K lines yet :( >>> >>> Is there some way to make a paste operation faster in mintty (or vim >>> or whatever the slowpoke is)? >> >> Use the right tool for the job: >> >> $ time awk -F, '{print $2}' top-1m.csv > hosts.txt >> real 0m0.686s > > I'd forgotten how slow pasting is in cygwin.. otherwise I'd have just > deleted column 1, saved as text & dos2unix'ed the file > > Oh well... I was hoping I'd set up something wrong in cygwin, but at > least I remember why not to paste lots o lines in cygwin.
Don't save what you don't need: $ time curl -LSs http://s3-us-west-1.amazonaws.com/umbrella-static/top-1m.csv.zip | funzip | awk -F, '{print $2}' > hosts.txt real 0m6.396s user 0m3.046s sys 0m0.372s If you need to save intermediate files, insert tee commands. -- Take care. Thanks, Brian Inglis, Calgary, Alberta, Canada This email may be disturbing to some readers as it contains too much technical detail. Reader discretion is advised. -- Problem reports: http://cygwin.com/problems.html FAQ: http://cygwin.com/faq/ Documentation: http://cygwin.com/docs.html Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple