A browser can be configured to accept cookies from a server
while a spider does not seem to have an ability to accept
cookie(s), hence it failed to go further (been redirected to
some other place).
Spiders have whatever ability you provide them - they're programs that you
write yourself.
Rest(cookies[x],'=')#
/cfloop
/cfhttp
-Original Message-
From: Chunshen Li [mailto:[EMAIL PROTECTED]
Sent: Monday, February 23, 2004 9:53 AM
To: CF-Talk
Subject: Re: Break the block, and SURVIVE, any way?
Now, I'm totally confused or have not waken up yet :)
It seems either ua pro
Yep, typo.Sorry about that.
-Original Message-
From: Chunshen Li [mailto:[EMAIL PROTECTED]
Sent: Tuesday, February 24, 2004 1:51 PM
To: CF-Talk
Subject: Re: Break the block, and SURVIVE, any way?
Yes, your follow-up makes a lot of sense to me except the GET method in the
following block
ake a look at the cookies that the server sent to ME ---
cfdump var=#cfhttp.responseHeader#
cfabort
Yep, typo.Sorry about that.
-Original Message-
From: Chunshen Li [mailto:[EMAIL PROTECTED]
Sent: Tuesday, February 24, 2004 1:51 PM
To: CF-Talk
Subject: Re: Break the block, and SURVIVE, any
Yes, your follow-up makes a lot of sense to me except the GET
method in the following block, is it a typo? meant to be
POST? I thought cfhttpparam subtag is used with POST method
only.
If you're using CFMX, I think you can use CFHTTPPARAM with GET as well as
POST. This was one of my pet
Did you send to [EMAIL PROTECTED] account?If so, could be that at that moment
my mail box was full, it's now definitely has room.The email address associated with this
account is an old one I never use it now.Thanks.
Yes, your follow-up makes a lot of sense to me except the GET
method in the
On Friday 20 Feb 2004 20:50 pm, ChunshenLi wrote:
cfhttpparam name=ua
type=Header value=Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
It's still redirected to yahoo.Did I miss something?
It's user-agent, isn't it ? Check the RFC.
--
Tom Chiverton
Advanced ColdFusion Programmer
Tel:
Now, I'm totally confused or have not waken up yet :)
It seems either ua problem or cookie problem or both.
But here's my take on this fiasco, this particular case, process flow-wise,
normally a web client sends a request to a remote web server,
the server checks ua and write some cookes to the
On Monday 23 Feb 2004 14:53 pm, ChunshenLi wrote:
Web server write cookie to requester/web client, aka ua,
but cfhttpparam type=Cookie ... seems to say, hey, take this cookie from
us (POST method) instead of accepting a cookie.
Is my understanding if cfhttpparam type=Cookie incorrect?
The
#ListFirst(cookies[x],'=')#
value=#ListRest(cookies[x],'=')#
/cfloop
/cfhttp
-Original Message-
From: Chunshen Li [mailto:[EMAIL PROTECTED]
Sent: Monday, February 23, 2004 9:53 AM
To: CF-Talk
Subject: Re: Break the block, and SURVIVE, any way?
Now, I'm totally confused or have not waken up ye
My last posting in response to your note below (posted around 9 AM this morning)
did not show up.Don't know what's going on?
Quite a few of my msgs seem to have been hijacked, for what?
On Monday 23 Feb 2004 14:53 pm, ChunshenLi wrote:
Web server write cookie to requester/web client, aka ua,
Sorry my last msg may not have been clear.What I meant was,
the cfhttpparam type=cookie subtag is to write a cookie to the target server
while for my spider, it's a different story, it trys to minic a browser.
A browser can be configured to accept cookies from a server
while a spider does not seem
On Friday 20 Feb 2004 03:23 am, ChunshenLi wrote:
Which attribute of cfhttp is for referer headers? I've already tried
user_agent to no avail (tried both static value and dynamic value
[CGI.http_user_agent]).
http://livedocs.macromedia.com/coldfusion/6.1/htmldocs/tags-p59.htm#wp1100049
Hello, hello, Dick, John, Tom, ... ?
Hi,
I need to use cfhttp to access site a, b and c, which is critical to
the app.But site b and c blocks cfhttp access, now, I would think
that Google etc. search engines also crawl site b and c, and site b
and c certainly welcomes search engine
Thanks.
So, I tried the following (trying to send some cookies over and UA info over first)
cftry
cfhttp url="" ThrowOnError=yes redirect=No method=post
cfhttpparam name=doubleclick type=Cookie value=test_cookie CheckForPermission doubleclick.net/1024*
cfhttpparam name=maxserve type=Cookie
So, I tried the following (trying to send some cookies over
and UA info over first) cftry cfhttp ...
...
cfhttpparam name=ua type=Header value=Mozilla/4.0
(compatible; MSIE 6.0; Windows NT 5.1) /cfhttp
It's still redirected to yahoo.Did I miss something?
The header name for user agent
I need to use cfhttp to access site a, b and c, which is
critical to the app. But site b and c blocks cfhttp access,
now, I would think that Google etc. search engines also
crawl site b and c, and site b and c certainly welcomes
search engine crawlers. If the assumption is correct, would
There are two common differences between the behavior of a user's browser
and that of a spider. First, spiders often send a different user-agent
request header. Second, they typically request pages frequently and
predictably, since they simply process what they receive and since they
don't have to
Since cfhttp is an http request I wonder how they block it? How about
letting cfhttp pretend to be an IE browser, using the useragent attribute of
cfhttp,
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
John.
-Original Message-
From: Chunshen Li [mailto:[EMAIL PROTECTED]
Sent: 19
Can you access the desired pages at sites b c with a browser?
If so, you should be able to access these pages with CFHTTP.
You may need to do a little detective work to handle cookies and
redirects, but you should be able to do it.
Dick
On Feb 19, 2004, at 6:13 AM, Chunshen Li (Don) wrote:
On Thursday 19 Feb 2004 14:13 pm, ChunshenLi wrote:
scary spider :) to break in?
Forge the user_agent/referer headers.
--
Tom Chiverton
Advanced ColdFusion Programmer
Tel: +44(0)1749 834997
email: [EMAIL PROTECTED]
BlueFinger Limited
Underwood Business Park
Wookey Hole Road, WELLS. BA5 1AF
You may need to do a little detective work to handle cookies and
redirects, but you should be able to do it.
OK. How to handle cookies?Current the site redirects to yahoo.I've looked
closely the redirect attribute and set its value to No, and with UserAgent value as well per
the guy's
John, thanks, please see my response to Dick.
Don
Since cfhttp is an http request I wonder how they block it? How about
letting cfhttp pretend to be an IE browser, using the useragent attribute of
cfhttp,
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
John.
-Original Message-
One way is to manually access the pages with a browser and see what
cookies are sent;
1) close all browser windows except the one you will use to access the
target page
2) Clear all cookies (usually a browser preferences/option)
3) Set browser to ask you before excepting cookies (usually a
OK. Time back to cookie.
Dick, you seem to be correct.Following your recommendation, I noticed 4 cookies
were written to my box, now, for that you should be able to duplicate that in a CF program,
It seems different language uses different schema for cookie setup, following is the a sample
Which attribute of cfhttp is for referer headers? I've already tried user_agent
to no avail (tried both static value and dynamic value [CGI.http_user_agent]).
On Thursday 19 Feb 2004 14:13 pm, ChunshenLi wrote:
scary spider :) to break in?
Forge the user_agent/referer headers.
--
Tom
26 matches
Mail list logo
