Re: Parsing/Crawler Questions - solution

2009-03-08 Thread lkcl
list-bounces+bedouglas=earthlink@python.org > > [mailto:python-list-bounces+bedouglas=earthlink@python.org]on Behalf > Oflkcl > Sent: Saturday, March 07, 2009 2:34 AM > To: python-l...@python.org > Subject: Re: Parsing/Crawler Questions - solution > > On Mar 7, 12:19

RE: Parsing/Crawler Questions - solution

2009-03-07 Thread bruce
Behalf Of lkcl Sent: Saturday, March 07, 2009 2:34 AM To: python-list@python.org Subject: Re: Parsing/Crawler Questions - solution On Mar 7, 12:19 am, rounderwe...@gmail.com wrote: > So, it sounds like your update means that it is related to a specific > url. > > I'm curious about

Re: Parsing/Crawler Questions - solution

2009-03-07 Thread lkcl
On Mar 7, 12:19 am, rounderwe...@gmail.com wrote: > So, it sounds like your update means that it is related to a specific > url. > > I'm curious about this issue myself. I've often wondered how one > could properly crawl anAJAX-ish site when you're not sure how quickly > the data will be returned

Re: Parsing/Crawler Questions - solution

2009-03-07 Thread Lie Ryan
bruce wrote: john... again the problem i'm facing really has nothing to do with a specific url... the app i have for the usc site works... but for any number of reasons... you might get different results when running the app.. -the server could be screwed up.. -data might be cached -data mi

Re: Parsing/Crawler Questions - solution

2009-03-06 Thread rounderweget
; -Original Message- > From: python-list-bounces+bedouglas=earthlink@python.org > > [mailto:python-list-bounces+bedouglas=earthlink@python.org]on Behalf > Of John Nagle > Sent: Thursday, March 05, 2009 10:54 AM > To: python-l...@python.org > Subject: Re: Parsin

RE: Parsing/Crawler Questions - solution

2009-03-05 Thread bruce
@python.org]on Behalf Of John Nagle Sent: Thursday, March 05, 2009 10:54 AM To: python-list@python.org Subject: Re: Parsing/Crawler Questions - solution Philip Semanchuk wrote: > On Mar 5, 2009, at 12:31 PM, bruce wrote: > >> hi.. >> >> the url i'm focusing on is irrele

RE: Parsing/Crawler Questions - solution

2009-03-05 Thread bruce
t's on the site... ain't screen scraping fun!!! -Original Message- From: python-list-bounces+bedouglas=earthlink@python.org [mailto:python-list-bounces+bedouglas=earthlink@python.org]on Behalf Of John Nagle Sent: Thursday, March 05, 2009 10:54 AM To: python-list@python.org Sub

Re: Parsing/Crawler Questions - solution

2009-03-05 Thread John Nagle
Philip Semanchuk wrote: On Mar 5, 2009, at 12:31 PM, bruce wrote: hi.. the url i'm focusing on is irrelevant to the issue i'm trying to solve at this time. Not if we're to understand the situation you're trying to describe. From what I can tell, you're saying that the target site displays d