Re: design problem..how to store web page's data for later comparison

2010-10-14 Thread Eric Chamberlain
You may want to store a hash of the page and use that for the comparison, then if the user wants to see the difference between the two pages, pull up the full page. On Oct 11, 2010, at 3:07 AM, jimgardener wrote: > hi > I am trying to write an application that checks a web page today and > aga

Re: design problem..how to store web page's data for later comparison

2010-10-12 Thread Jirka Vejrazka
> Yes, it's definitely possible. DBs support very large text fields nowadays, I > wouldn't worry about it. Postgres's text field type is only limited by the > 1GB value-size limit general to all Postgres DB fields. Plus, you can easily compresss web pages very effectively using built-in Python

Re: design problem..how to store web page's data for later comparison

2010-10-12 Thread jimgardener
thank Jonathan..it was very helpful.. jim > Good luck, > Jonathan > -- You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-us...@googlegroups.com. To unsubscribe from this group, send email to django-users+

Re: design problem..how to store web page's data for later comparison

2010-10-11 Thread Jonathan Barratt
Hi Jim, > How can I do this?I can get the page data of current moment as a > string using urllib.urlopen and store it in a variable, say > current_page_data.But ,how do I store yesterday's data so that I can > compare the two?Do I need to store it as a field in database?(I am not > very familiar w

design problem..how to store web page's data for later comparison

2010-10-11 Thread jimgardener
hi I am trying to write an application that checks a web page today and again checks it after somedays and compares them.For this purpose I need to store the page data on these 2 occassions in my program . How can I do this?I can get the page data of current moment as a string using urllib.urlop