> -Original Message-
> From: Dave Watts [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 7:21 PM
> To: CF-Talk
> Subject: RE: Fetching a website?
>
> > We have these conversations a lot. Somebody asks how to do
> > something and somebody (somet
> We have these conversations a lot. Somebody asks how to do
> something and somebody (sometimes myself) gets all high-and-
> mighty that they should be using a better, more appropriate tool.
>
> But the world doesn't work that way. We have limitations.
>
> Sometimes we have to do the best we c
> -Original Message-
> From: Dave Watts [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 6:24 PM
> To: CF-Talk
> Subject: RE: Fetching a website?
>
> > > > I still maintain that a well-written CF app can still beat a
> >
> > > I still maintain that a well-written CF app can still beat a
> > > crappily written pure Java app.
> >
> > Absolutely. However, part of writing a well-written application is
> > choosing the appropriate language for the task.
>
> With one caveat: choose the most appropriate language that
>
> -Original Message-
> From: Dave Watts [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 4:47 PM
> To: CF-Talk
> Subject: RE: Fetching a website?
>
> > I still maintain that a well-written CF app can still beat a
> > crappily written pure Java
> I still maintain that a well-written CF app can still beat a
> crappily written pure Java app.
Absolutely. However, part of writing a well-written application is choosing
the appropriate language for the task.
Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
Fig Leaf Software provide
housi mueller wrote:
> At the moment I do have only basic knowledge about java. It would be not
> sufficient to write threaded classes. But I will work on it =:0)
An unthreaded java class will be magnitudes faster than a
synchronous CF application because it can maintain the
connection. CF will
> -Original Message-
> From: Russ [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 3:32 PM
> To: CF-Talk
> Subject: RE: Fetching a website?
>
> Why not just write a simple java app that could be perhaps called from cf?
> I've been usually switc
At the moment I do have only basic knowledge about java. It would be not
sufficient to write threaded classes. But I will work on it =:0)
Russ <[EMAIL PROTECTED]> wrote:
Why not just write a simple java app that could be perhaps called from cf?
I've been usually switching to java and writing some
Thank you for the detailed explanation.
Now I learned something new. Right now I am not concerned
about performence so I will go one with CF.
Thank you
Helmut
Jim Davis <[EMAIL PROTECTED]> wrote:
> >> I saw wget already. I know why to invent the wheel again, if
> >> it already exists... but
st 10, 2005 3:05 PM
To: CF-Talk
Subject: RE: Fetching a website?
> -Original Message-
> From: Meli Helmut [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 2:16 PM
> To: CF-Talk
> Subject: Re: Fetching a website?
>
> >> I saw wget already. I know why to in
> -Original Message-
> From: Meli Helmut [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 2:16 PM
> To: CF-Talk
> Subject: Re: Fetching a website?
>
> >> I saw wget already. I know why to invent the wheel again, if
> >> it already exists...
http://www.lawyersweeklyusa.com/images/lwlogo.gif";
path="C:\" file="image.gif">
Works like a charm. Lovely for dling PDFs from state and federal court sites.
Cool, I will file that to the back of my head for the future when I may need to
do this. Just one of those things I've never needed to
I should have stated that, rather than asking.
You can just use the cfhttp file and path attributes to save a
binary/include file directly to disk.
http://www.lawyersweeklyusa.com/images/lwlogo.gif";
path="C:\" file="image.gif">
Works like a charm. Lovely for dling PDFs from state and federal co
st 10, 2005 11:16 AM
To: CF-Talk
Subject: RE: Fetching a website?
As for performance I would highly recommend checking out the Asynch gateway
- using this in CF MX 7 you can launch multiple threads at your target to
collect all those little assets (images, scripts, styles, etc) instead of
waitin
>I see, you just love a challenge! Hey, get it to work and submit it for a
>CFDJ article.
When I get it to work I will definitely publish the project...
~|
Find out how CFTicket can increase your company's customer support
effi
st 10, 2005 11:16 AM
To: CF-Talk
Subject: RE: Fetching a website?
As for performance I would highly recommend checking out the Asynch gateway
- using this in CF MX 7 you can launch multiple threads at your target to
collect all those little assets (images, scripts, styles, etc) instead of
waitin
>Dave is right that CF isn't even close to the best tool for the job... but
>for what it's worth this ColdFusion (CF MX 7) is the best ColdFusion ever
>for this job. ;^)
>
>I think it's a great exercise to try - you'll learn a lot and will end up
>with a nice tool that could solve a lot of problem
Can't you just us the cfhttp file and path attributes to save the
binary/included files directly to disk?
I don't know. I have never, ever tried to get a binary file from another
system using http. My gut says it's probably possible; my head has no idea
how. It would be interesting to know,
Can't you just us the cfhttp file and path attributes to save the
binary/included files directly to disk?
On 8/10/05, Ian Skinner <[EMAIL PROTECTED]> wrote:
> As many have said, it can be done. But as many have also said, it's not
> something CF is going to be good at, so I doubt you are going t
I have used WebCopier to do what you are asking for. I think it is a great
shareware program.
-Mike Chabot
On 8/10/05, housi mueller <[EMAIL PROTECTED]> wrote:
>
> I would like to know how to grab a entire website, download and save it to
> the harddisk. Replace all absolute paths into relati
> -Original Message-
> From: Meli Helmut [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 10, 2005 2:03 PM
> To: CF-Talk
> Subject: Re: Fetching a website?
>
> I just wanted to write an application like this on my one. This will give
> me a good idea how to pa
>> I saw wget already. I know why to invent the wheel again, if
>> it already exists... but I would like to write something like
>> this on my one...
>
>I submit that CF is a spectacularly poor choice for doing this, though.
>
Could you also tell me please why CF is a poor choice to do this and w
I see, you just love a challenge! Hey, get it to work and submit it for a
CFDJ article.
-Original Message-
From: Meli Helmut [mailto:[EMAIL PROTECTED]
Sent: Wednesday, August 10, 2005 11:03 AM
To: CF-Talk
Subject: Re: Fetching a website?
I just wanted to write an application like
As many have said, it can be done. But as many have also said, it's not
something CF is going to be good at, so I doubt you are going to find anything
already done in it.
But if you want to do this; the major pieces you are going to need are
which will give you a page. Refind() will allow yo
Meli Helmut wrote:
>
> I just wanted to write an application like this on my one. This will give me
> a good idea how to parse a website etc. There are some Spider written in PHP
> so I thought to write something like this in ColdFusion.
Then maybe it is a good idea to take a look at the source
>Actually, HTTrack works very well. I've used it a couple times. Any reason
>you don't just use it?
>
>
>I would like to know how to grab a entire website, download and save it to
>the harddisk. Replace all absolute paths into relative paths so that the
>site can be viewed offline.
>
>I would li
Yeah, I agree. Seems like the wrong tool for the job. Sure you can bang in
nails with a screw driver, but should you?
-Original Message-
From: Dave Watts [mailto:[EMAIL PROTECTED]
Sent: Wednesday, August 10, 2005 9:31 AM
To: CF-Talk
Subject: RE: Fetching a website?
> I saw w
Actually, HTTrack works very well. I've used it a couple times. Any reason
you don't just use it?
-Original Message-
From: housi mueller [mailto:[EMAIL PROTECTED]
Sent: Wednesday, August 10, 2005 8:58 AM
To: CF-Talk
Subject: Fetching a website?
I would like to know how to grab a enti
>> Maybe CF is a poor choice but it should be possible...
>
>It is certainly possible. CF gives you all of the functionality you need -
>you simply need to write the code to use it. However, even if you do so, it
>will probably not perform suitably, since that's not the kind of thing that
>CF is de
> Maybe CF is a poor choice but it should be possible...
It is certainly possible. CF gives you all of the functionality you need -
you simply need to write the code to use it. However, even if you do so, it
will probably not perform suitably, since that's not the kind of thing that
CF is designed
>Start reading up on CFHTTP and Regular Expressions. CFHTTP will convert
>all links to fully-qualified links (if you set the appropriate
>attribute) and the regular expressions will find all links within the
>document.
>
>M!ke
I already made some tests with CFHTTP. But it needs more. Looping tr
> I submit that CF is a spectacularly poor choice for doing this, though.
Maybe CF is a poor choice but it should be possible...
__
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
~
Meli Helmut wrote:
>
> I saw wget already. I know why to invent the wheel again, if it already
> exists... but I would like to write something like this on my one...
Read the source and you know what it takes :) But I would
recommend cURL over wget because the license is less restrictive.
Joch
> I saw wget already. I know why to invent the wheel again, if
> it already exists... but I would like to write something like
> this on my one...
I submit that CF is a spectacularly poor choice for doing this, though.
Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
Fig Leaf Softwar
>> I would like to know how to grab a entire website, download
>> and save it to the harddisk. Replace all absolute paths into
>> relative paths so that the site can be viewed offline.
>
>Cfexecute
>wget
>
>--
>Damien McKenna - Web Developer - [EMAIL PROTECTED]
>The Limu Company - http://www.the
Start reading up on CFHTTP and Regular Expressions. CFHTTP will convert
all links to fully-qualified links (if you set the appropriate
attribute) and the regular expressions will find all links within the
document.
M!ke
-Original Message-
From: housi mueller [mailto:[EMAIL PROTECTED]
S
On Wednesday 10 August 2005 16:58, housi mueller wrote:
> I would like to know how to grab a entire website, download and save it to
> the harddisk. Replace all absolute paths into relative paths so that the
> site can be viewed offline.
wget with the '-m' mirror option... ?
--
Tom Chiverton
> I would like to know how to grab a entire website, download
> and save it to the harddisk. Replace all absolute paths into
> relative paths so that the site can be viewed offline.
Cfexecute
wget
--
Damien McKenna - Web Developer - [EMAIL PROTECTED]
The Limu Company - http://www.thelimucompan
39 matches
Mail list logo
