Hi. As I understand you want run scrapy spiders using django(by simple pressing a button) and in view(I guess) you are starting the spider?
if you want to achieve smth like this you should consider using scrapyd for it. Scrapyd allows you easily deploy and run spider(check the docs) Now, using django, you can easily schedule a spider by calling API( http://scrapyd.readthedocs.org/en/latest/api.html#schedule-json) and by passing proper settings or parameters to spider. Basically this is how I implemented smth similar and it works. On Tuesday, December 17, 2013 4:09:35 PM UTC+2, miguel vargas wrote: > > thank you very much for scrapy! > > I have problems when using scrapy within a django view of this because I > need a robot that receives parameters and run. then my difficulty is on the > side that generates the error "signal only works in main thread" when > invoking > it inside the script. or works once and then have problems with twisted > reactor. I can not be run by a command. > > anyone has experience in this field, how to save that error and run within > a django view calling the robot scrapy? > > atte. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
