Thanks for your reply. What I really wanted from my question is some advice debugging the spider, or a reason why it doesn't work, or requests for more information that I can provide. I don't know if starting another process for the spider might interfere with scrapy's requirement of running in the main thread for signals to work <https://groups.google.com/forum/#!topic/scrapy-users/bq7AjAf3nFg>. I'll give scrapyd a look and see if it can help. Thanks again.
On Friday, November 28, 2014 5:04:03 PM UTC+2, Nicolás Alejandro Ramírez Quiros wrote: > > Isn't simpler initiate the spider in an isolated process and when it > finished inform back the client and the client inform the server? > > If you still want to do it your way, maybe scrapyd has the answer. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
