I think I should use an extension (my first one !)
so here's what I did :
1. in settings :
EXTENSIONS = {
'backrub.extensions.TestProxy': 100,
}
2. in extensions :
class TestProxy():
def __init__(self, crawler):
spider = TestProxySpider()
crawler.crawl(spider)
@classmethod
def from_crawler(cls, crawler):
ext = cls(crawler)
return ext
But I now have a :
AssertionError: Spider already attached
How can I add my TestProxySpider before the current running spider ?
>From the docs (http://doc.scrapy.org/en/latest/topics/api.html), I imagine
this is related to "engine" but this is only a guess ...
Does anybody have played with multiple spiders in a crawler to give me a
clue ? ;)
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
