Re: Any cfhttp gurus out there?
Try adding these params: cfhttpparam type=header name=Accept-Encoding value=* / cfhttpparam type=Header name=TE value=deflate;q=0 / Sounds like the response is gzipped by IIS. I used to be able hit this link and get results with a cfdump... http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx Now, all I get is a value of Connection Failure for cfhttp.fileconent. I know the link works since I can add it to FireFox and a Live Bookmark is created. Any ideas? Is it an encoding or a useragent issue? I'm on a CF8 box. Thanks, Che ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309196 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Any cfhttp gurus out there?
I used to be able hit this link and get results with a cfdump... http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx Now, all I get is a value of Connection Failure for cfhttp.fileconent. I know the link works since I can add it to FireFox and a Live Bookmark is created. Any ideas? Is it an encoding or a useragent issue? I'm on a CF8 box. The only way to tell, generally, is to make your HTTP request identical to a browser's (user agent, etc), then turn off request headers one by one until it doesn't work (again). Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309152 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Any cfhttp gurus out there?
Dave, what do you mean exactly? Do you mean any browser? I've tried a few and get the same results each time. See snippet below. cfset useragent = Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.4) Gecko/20070515 Firefox/2.0.4 cfhttp url=http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx; method=GET result=xmlFeed useragent=#useragent# cfdump var=#xmlFeed# -Original Message- I used to be able hit this link and get results with a cfdump... http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx Now, all I get is a value of Connection Failure for cfhttp.fileconent. I know the link works since I can add it to FireFox and a Live Bookmark is created. Any ideas? Is it an encoding or a useragent issue? I'm on a CF8 box. The only way to tell, generally, is to make your HTTP request identical to a browser's (user agent, etc), then turn off request headers one by one until it doesn't work (again). ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309154 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Any cfhttp gurus out there?
Use This cfhttp url=http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx; method=GET useragent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv: 1.8.1.4) Gecko/20070515 Firefox/2.0.4 cfhttpparam name=.ASPXANONYMOUS value=AN1DWgAeyQEkMmZhMjM2MDYtYmYxMi00ZjI2LTllN2ItZTlmYjE1ZDNjZDg22EXDw-MnaTwXkMMbrNP5GJXW9Is1 type=cookie /cfhttp !--- ..ASPXANONYMOUS=RNSBgAEeyQEkYTUwZTk1ZjgtMzdiZS00YjQ5LTg3MWMtNjM4ZWM1NDM2NDIyLNqDJas541do9ZIsYBuDspaV34o1; expires=Wed, 24-Sep-2008 04:53:35 GMT; path=/; HttpOnly [ASR] --- cfset variables.mycookie = ListFirst(CFHTTP.Responseheader[Set-Cookie], ;) cfset variables.mycookie = ReplaceNoCase(variables.mycookie, .ASPXANONYMOUS=, ) cfhttp url=http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx; method=GET useragent=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 cfhttpparam type=HEADER name=User-Agent value=Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 cfhttpparam type=HEADER name=Accept value=text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 cfhttpparam type=HEADER name=Accept-Language value=en-us,en;q=0.5 cfhttpparam type=HEADER name=Accept-Encoding value=gzip,deflate cfhttpparam type=HEADER name=Accept-Charset value=ISO-8859-1,utf-8;q=0.7,*;q=0.7 cfhttpparam type=HEADER name=Keep-Alive value=300 cfhttpparam type=HEADER name=Connection value=keep-alive cfhttpparam type=HEADER name=Host value=www.dealsonwheels.com cfhttpparam name=.ASPXANONYMOUS value=#variables.mycookie# type=cookie /cfhttp cfdump var=#CFHTTP# -- Alan Rother Adobe Certified Advanced ColdFusion MX 7 Developer Manager, Phoenix Cold Fusion User Group, AZCFUG.org ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309156 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Any cfhttp gurus out there?
Dump out the entire cfhttp to see what the headers look like. It may be that they are using connection keep-alive to prevent spidering or something else. In some cases the page is doing a redirect and you don't see it because cfhttp turns on redirect as a default. Setting it to no may tell you more about the request. Once my computer is free (it's bogged down parsing a million plus comics) I'll test it out to see what I can. On Wed, Jul 16, 2008 at 1:53 PM, Che Vilnonis [EMAIL PROTECTED] wrote: I used to be able hit this link and get results with a cfdump... http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx Now, all I get is a value of Connection Failure for cfhttp.fileconent. I know the link works since I can add it to FireFox and a Live Bookmark is created. Any ideas? Is it an encoding or a useragent issue? I'm on a CF8 box. Thanks, Che ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309157 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Any cfhttp gurus out there?
Dave, what do you mean exactly? Do you mean any browser? I've tried a few and get the same results each time. I mean, find out EXACTLY what your browser is sending, and send the same thing. Not just User-Agent, but all the other HTTP request headers too. Use CFHTTPPARAM TYPE=CGI to set the other headers, and use the HTTP_ prefix: for example, HTTP_HOST. Here are the headers from Firebug: Host: www.dealsonwheels.com User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0 Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-us,en;q=0.5 Accept-Encoding: gzip,deflate Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7 Keep-Alive: 300 Connection: keep-alive Cache-Control: max-age=0 I got a cookie the first time I tried, but it apparently isn't required. I took it out using the Modify Headers extension, and everything worked fine. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309158 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Any cfhttp gurus out there?
Sorry, I did not mean to hit send... Quick explanation. There are two CFHTTP, the first gets a cookie value back from the server, the second makes use fo the cookie, I don't know if the server cares, but I've seen security models like that before, so it's good to send a cookie back, it makes you look authentic. Second, I added all of the HTTP request params my firefox install was sending. I got them by using a FF add on called HttpFox, which lets you see all of your request and response params. Also, you can delete my comment in the middle of the code, I was using that as a comparison while I filtered out the cookie value from the CFHTTP. HTH =] -- Alan Rother Adobe Certified Advanced ColdFusion MX 7 Developer Manager, Phoenix Cold Fusion User Group, AZCFUG.org ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309159 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Any cfhttp gurus out there?
Alan/Dave... thanks... now I get it. Had not run into something quite like that before. Alan, thanks for the headsup on HttpFox. Regards, Che -Original Message- From: Alan Rother [mailto:[EMAIL PROTECTED] Sent: Wednesday, July 16, 2008 2:31 PM To: CF-Talk Subject: Re: Any cfhttp gurus out there? Sorry, I did not mean to hit send... Quick explanation. There are two CFHTTP, the first gets a cookie value back from the server, the second makes use fo the cookie, I don't know if the server cares, but I've seen security models like that before, so it's good to send a cookie back, it makes you look authentic. Second, I added all of the HTTP request params my firefox install was sending. I got them by using a FF add on called HttpFox, which lets you see all of your request and response params. Also, you can delete my comment in the middle of the code, I was using that as a comparison while I filtered out the cookie value from the CFHTTP. HTH =] -- Alan Rother Adobe Certified Advanced ColdFusion MX 7 Developer Manager, Phoenix Cold Fusion User Group, AZCFUG.org ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309161 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Any cfhttp gurus out there?
Also, if you're parsing the content you get back, perhaps you'd benefit from cffeed, ie. cffeed source=http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx; query=qry_chevs cfdump var=#qry_chevs# I tried the exact code above and got the expected result. I then tried the code below using cfhttp and recieved 'Connection Failure': cfhttp url=http://www.dealsonwheels.com/dowrss/chevrolet_camaro.aspx; method=get/ cfdump var=#cfhttp.FileContent# HTH Dominic -- Blog it up: http://fusion.dominicwatson.co.uk ~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;203748912;27390454;j Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:309166 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
