Pls help me...I want to save data to my database but I am unable to

2014-01-25 Thread Max Cuban
This is my first programming pet project. I have the following script that extracts links from specific sites and display them on the web(via django). The script work fine but I'm unable to save any stuff in my database. Hence if I run the code, I get the output I want but then it always extracts

Pls help me...I want to save scraped data automatically to my database(cleaner version)

2014-01-25 Thread Max Cuban
I have asked this question earlier but this should make more sense than the earlier version and I don't want anyone who could potentially helped to be put off by the initial mess even if I updated it with my cleaner version as a reply I want to save the links scraped to be save in my database so

Python/Django Extract and append only new links

2013-12-31 Thread Max Cuban
I am putting together a project using Python 2.7 Django 1.5 on Windows 7. I believe this should be on the django group but I haven't had help from there so I figured I would try the python list I have the following view: views.py: def foo(): site = http://www.foo.com/portal/jobs; hdr =

strip away html tags from extracted links

2013-11-29 Thread Max Cuban
I have the following code to extract certain links from a webpage: from bs4 import BeautifulSoup import urllib2, sys import re def tonaton(): site = http://tonaton.com/en/job-vacancies-in-ghana; hdr = {'User-Agent' : 'Mozilla/5.0'} req = urllib2.Request(site, headers=hdr) jobpass