RE: Can't find how to fetch from the web
> Date: Fri, 15 Aug 2008 11:02:38 -0700 > From: [EMAIL PROTECTED] > To: cygwin@cygwin.com > Subject: RE: Can't find how to fetch from the web > > > In my experience, I have never run into a URL that was too long. the only > thing that I have had problems with in the past are, links timing out, or if > it is ftp you sometimes must specify a username and password. You know now > that I think about it some websites block the use of file retrievers, could > that be the problem? I'm not at my normal computer but IIRC this occurs when retrieving patents. I have a bunch of scripts that need to extract stuff from html from document servers that don't have an API. The patent script generates long URL's and bombs every few hundred-to-thousand fetches IIRC. The few times I looked I thought the URL length was suspect but I suppose it could be something related to my install ( previously noted to have problems) or I'm not remembering it correctly. Since you were discussing it, I only brought it up to determine if there was a known problem with any versions. I used to use lynx all the time then switched to wget if I don't need parsing and now mostly use curl in new code. > > > Mike Marchywka-2 wrote: >> >> >> btw, is there a known problem with lynx that causes it to die when the url >> is too long? >> I don't have an example right now but I've noticed several times, and it >> appears to be >> with long urls, that lynx dies for no obvious reason. I use something like >> lynx -dump -width 1200 url. I don't think this normally violates the >> command line length constraint which I thought was >> many k. Is there a server response that can provoke an abnormal >> termination ( want to say >> seg fault or access violation but can't remember)? >> >> Thanks. >> >> >> >>> Date: Fri, 15 Aug 2008 08:50:21 -0700 >>> From: [EMAIL PROTECTED] >>> To: cygwin@cygwin.com >>> Subject: Re: Can't find how to fetch from the web >>> >>> >>> are you talking about using wget to download files or webpages? >>> >>> all you have to do is open the setup.exe and the new package you want is >>> under WEB>>(select)wget >>> >>> then google wget to see how to use it... it pretty simple and a good way >>> to >>> get data or other things from the web. >>> >>> I hope this what you were going for. >>> >>> Garret >>> >>> >>> >>> defn noob wrote: >>>> >>>> Believe me I have googled and read the faqs but I can't find how to >>>> download from the web. >>>> >>>> I have installed cygwin and it works but I think I need a package >>>> although >>>> web was default in my download. >>>> >>>> 1. how do I install packages once I already have installed cygwin? >>>> >>>> 2. what do I write do download from a specific internetadress. >>>> >>>> best regards cirfu >>>> >>>> >>>> >>>> __ >>>> Ta semester! - sök efter resor hos Kelkoo. >>>> Jämför pris på flygbiljetter och hotellrum här: >>>> http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052 >>>> >>>> >>>> -- >>>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >>>> Problem reports: http://cygwin.com/problems.html >>>> Documentation: http://cygwin.com/docs.html >>>> FAQ: http://cygwin.com/faq/ >>>> >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html >>> Sent from the Cygwin list mailing list archive at Nabble.com. >>> >>> >>> -- >>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >>> Problem reports: http://cygwin.com/problems.html >>> Documentation: http://cygwin.com/docs.html >>> FAQ: http://cygwin.com/faq/ >>> >> >> _ >> Get ideas on sharing photos from people like you. Find new ways to share. >> http://www.windowslive.com/explore/photogallery/posts?ocid=TXT_TAGLM_WL_Photo_Gallery_082008 >> >> -- >> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >> Problem reports: http://cygwin.com/problems.html >> Documentation: http://cygwin.com/docs.html >> FAQ: http://cygwin.com/faq/ >> >> >> > > -- > View this message in context: > http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19003069.html > Sent from the Cygwin list mailing list archive at Nabble.com. > > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > _ Be the filmmaker you always wanted to be—learn how to burn a DVD with Windows®. http://clk.atdmt.com/MRT/go/108588797/direct/01/ -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
RE: Can't find how to fetch from the web
> >> Is there a >> server response that can provoke an abnormal termination ( want to say >> seg fault or access violation but can't remember)? > > Absolutely not! Why on earth would anyone want to let a remote server > crash their software? No, you just get a nice friendly error status code > (e.g. 404) which your browser is supposed to display to you. > I was asking about known bugs, which become design features if they don't have an impact under any condition someone cares about. If I'm going to get a 404, I don't really care if I get an access violation as long as "$?" is non-zero. I was being somewhat facetious but within the scope of my original premise. You have to prioritize fixes and this certainly wouldn't get a big item if it existed. Things like buffer overflows have been known to create vulnerabilities but in this context probably not a big issue. LOL. > > cheers, > DaveK > -- > Can't think of a witty .sigline today > > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > _ See what people are saying about Windows Live. Check out featured posts. http://www.windowslive.com/connect?ocid=TXT_TAGLM_WL_connect2_082008 -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
RE: Can't find how to fetch from the web
Mike Marchywka wrote on 15 August 2008 17:56: > btw, is there a known problem with lynx that causes it to die when the > url is too long? There have been such problems in the past; I notice that the distro version we have is 2.8.5rel5, and there have been two buffer overflows fixed upstream since then, according to the CHANGES file. > I don't have an example right now but I've noticed several times, and it > appears to be with long urls, that lynx dies for no obvious reason. Next time it happens, please keep a note of the URL and I'll look into it if you like. Any stackdumps you have lying around might be useful as well. (Feel free to contact me offlist about this if you're concerned with security.) > I use something > like lynx -dump -width 1200 url. I don't think this normally violates the > command line length constraint which I thought was many k. No, it doesn't, and even if it did, you ought to just get an error from bash, not a crash. > Is there a > server response that can provoke an abnormal termination ( want to say > seg fault or access violation but can't remember)? Absolutely not! Why on earth would anyone want to let a remote server crash their software? No, you just get a nice friendly error status code (e.g. 404) which your browser is supposed to display to you. cheers, DaveK -- Can't think of a witty .sigline today -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
RE: Can't find how to fetch from the web
In my experience, I have never run into a URL that was too long. the only thing that I have had problems with in the past are, links timing out, or if it is ftp you sometimes must specify a username and password. You know now that I think about it some websites block the use of file retrievers, could that be the problem? Mike Marchywka-2 wrote: > > > btw, is there a known problem with lynx that causes it to die when the url > is too long? > I don't have an example right now but I've noticed several times, and it > appears to be > with long urls, that lynx dies for no obvious reason. I use something like > lynx -dump -width 1200 url. I don't think this normally violates the > command line length constraint which I thought was > many k. Is there a server response that can provoke an abnormal > termination ( want to say > seg fault or access violation but can't remember)? > > Thanks. > > > >> Date: Fri, 15 Aug 2008 08:50:21 -0700 >> From: [EMAIL PROTECTED] >> To: cygwin@cygwin.com >> Subject: Re: Can't find how to fetch from the web >> >> >> are you talking about using wget to download files or webpages? >> >> all you have to do is open the setup.exe and the new package you want is >> under WEB>>(select)wget >> >> then google wget to see how to use it... it pretty simple and a good way >> to >> get data or other things from the web. >> >> I hope this what you were going for. >> >> Garret >> >> >> >> defn noob wrote: >>> >>> Believe me I have googled and read the faqs but I can't find how to >>> download from the web. >>> >>> I have installed cygwin and it works but I think I need a package >>> although >>> web was default in my download. >>> >>> 1. how do I install packages once I already have installed cygwin? >>> >>> 2. what do I write do download from a specific internetadress. >>> >>> best regards cirfu >>> >>> >>> >>> __ >>> Ta semester! - sök efter resor hos Kelkoo. >>> Jämför pris på flygbiljetter och hotellrum här: >>> http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052 >>> >>> >>> -- >>> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >>> Problem reports: http://cygwin.com/problems.html >>> Documentation: http://cygwin.com/docs.html >>> FAQ: http://cygwin.com/faq/ >>> >>> >>> >> >> -- >> View this message in context: >> http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html >> Sent from the Cygwin list mailing list archive at Nabble.com. >> >> >> -- >> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >> Problem reports: http://cygwin.com/problems.html >> Documentation: http://cygwin.com/docs.html >> FAQ: http://cygwin.com/faq/ >> > > _ > Get ideas on sharing photos from people like you. Find new ways to share. > http://www.windowslive.com/explore/photogallery/posts?ocid=TXT_TAGLM_WL_Photo_Gallery_082008 > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > > > -- View this message in context: http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19003069.html Sent from the Cygwin list mailing list archive at Nabble.com. -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
RE: Can't find how to fetch from the web
btw, is there a known problem with lynx that causes it to die when the url is too long? I don't have an example right now but I've noticed several times, and it appears to be with long urls, that lynx dies for no obvious reason. I use something like lynx -dump -width 1200 url. I don't think this normally violates the command line length constraint which I thought was many k. Is there a server response that can provoke an abnormal termination ( want to say seg fault or access violation but can't remember)? Thanks. > Date: Fri, 15 Aug 2008 08:50:21 -0700 > From: [EMAIL PROTECTED] > To: cygwin@cygwin.com > Subject: Re: Can't find how to fetch from the web > > > are you talking about using wget to download files or webpages? > > all you have to do is open the setup.exe and the new package you want is > under WEB>>(select)wget > > then google wget to see how to use it... it pretty simple and a good way to > get data or other things from the web. > > I hope this what you were going for. > > Garret > > > > defn noob wrote: >> >> Believe me I have googled and read the faqs but I can't find how to >> download from the web. >> >> I have installed cygwin and it works but I think I need a package although >> web was default in my download. >> >> 1. how do I install packages once I already have installed cygwin? >> >> 2. what do I write do download from a specific internetadress. >> >> best regards cirfu >> >> >> >> __ >> Ta semester! - sök efter resor hos Kelkoo. >> Jämför pris på flygbiljetter och hotellrum här: >> http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052 >> >> >> -- >> Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple >> Problem reports: http://cygwin.com/problems.html >> Documentation: http://cygwin.com/docs.html >> FAQ: http://cygwin.com/faq/ >> >> >> > > -- > View this message in context: > http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html > Sent from the Cygwin list mailing list archive at Nabble.com. > > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > _ Get ideas on sharing photos from people like you. Find new ways to share. http://www.windowslive.com/explore/photogallery/posts?ocid=TXT_TAGLM_WL_Photo_Gallery_082008 -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
Re: Can't find how to fetch from the web
are you talking about using wget to download files or webpages? all you have to do is open the setup.exe and the new package you want is under WEB >>(select)wget then google wget to see how to use it... it pretty simple and a good way to get data or other things from the web. I hope this what you were going for. Garret defn noob wrote: > > Believe me I have googled and read the faqs but I can't find how to > download from the web. > > I have installed cygwin and it works but I think I need a package although > web was default in my download. > > 1. how do I install packages once I already have installed cygwin? > > 2. what do I write do download from a specific internetadress. > > best regards cirfu > > > > __ > Ta semester! - sök efter resor hos Kelkoo. > Jämför pris på flygbiljetter och hotellrum här: > http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052 > > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > > > -- View this message in context: http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001016.html Sent from the Cygwin list mailing list archive at Nabble.com. -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
Re: Can't find how to fetch from the web
are you talking about using wget to download files or webpages? all you have to do is open the setup.exe and the new package you want is under WEB >>(select)wget then google wget to see how to use it... it pretty simple and a goog way to get data or other things from the web. I hope this what you were going for. Garret defn noob wrote: > > Believe me I have googled and read the faqs but I can't find how to > download from the web. > > I have installed cygwin and it works but I think I need a package although > web was default in my download. > > 1. how do I install packages once I already have installed cygwin? > > 2. what do I write do download from a specific internetadress. > > best regards cirfu > > > > __ > Ta semester! - sök efter resor hos Kelkoo. > Jämför pris på flygbiljetter och hotellrum här: > http://www.kelkoo.se/c-169901-resor-biljetter.html?partnerId=96914052 > > > -- > Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple > Problem reports: http://cygwin.com/problems.html > Documentation: http://cygwin.com/docs.html > FAQ: http://cygwin.com/faq/ > > > -- View this message in context: http://www.nabble.com/Can%27t-find-how-to-fetch-from-the-web-tp18920885p19001011.html Sent from the Cygwin list mailing list archive at Nabble.com. -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
Re: Can't find how to fetch from the web
On Mon, Aug 11, 2008 at 06:43:00AM +, Circular Function wrote: >Believe me I have googled and read the faqs but I can't find how to >download from the web. Go back to the main cygwin page at http://cygwin.com/ and read the section called "Installing and Updating Cygwin". -- Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple Problem reports: http://cygwin.com/problems.html Documentation: http://cygwin.com/docs.html FAQ: http://cygwin.com/faq/
