Hi,
Im writing a simple feed crawler using tasks. Feed entries are stored
in Entry model. I use guids to check whether an entry exists or not,
to avoid entries from begin crawled more than once.. But my checking
mechanism seems to be failing..
Here is the check function and Entry model that i use
if this was the case, and do not claim it to be the case:)
> But in analyzing chains of events, it seemed that this could have been
> the root cause for certain situations.
>
> That's why I too am interested the answer to this question.
>
> johnP
>
> On Dec 18, 12:05
any Exceptions, instead they were
returning inconsistent results. It got fixed when i rearranged some of
the stuff so that the put can be done outside callback.
On Dec 19, 10:04 am, johnP wrote:
> z33m - just looked at your thread, and see that the query in question
> is similar to
&g
im trying to make something like a feed reader. Im using feedparser.py
to parse the feeds like this
def fetch_feed(url, modified = None, etag = None):
import feedparser
headers = {}
if modified:
headers['If-Modified-Since'] = modified
if etag:
headers['If-None-Matc
cache,max-age=0', 'Pragma':'no-
cache'}
f_result = urlfetch.fetch(feed_url, None, urlfetch.GET, fetch_headers)
Thanx anyway!!
On Feb 1, 2:16 pm, z33m wrote:
> im trying to make something like a feed reader. Im using feedparser.py
> to parse the feeds like this
Im writing a twitter app. It accepts commands as Direct Messages, so i
have setup a third party cronjob service to invoke a handler that
processes DMs at regular intervals. I have a Model 'Info' that has
just one entry, it stores some common data which are used in many
places in the App(in this ca
()
info.put()
return info
info = Info.get_info()
On Apr 2, 9:59 pm, Jeff S wrote:
> Hi z33m,
>
> Is it possible that the info model which contains the msg_polled time
> is not being updated and still contains an old value for msg_polled? I
> think it would be hel
