There is no official way right now. Can you give us more information about your issue? How much information, estimated pages to crawl?, also if you can give us the reason you want to do it this way would be great.
El lunes, 25 de agosto de 2014 14:11:32 UTC-3, Hang escribió: > > Dear all, > > I'm new to scrapy and python, I want to build up an application that using > scrapy to acquire information from a website. > Is there any way of using scrapy in my python code and also return the > results into some variables that I can use inside my code? > > I found something to call the crawler programmatically, but I have no idea > how to get the results. > > spider = TestSpider() > settings = get_project_settings() > crawler = Crawler(settings) > crawler.signals.connect(reactor.stop, signal=signals.spider_closed) > crawler.configure() > crawler.crawl(spider) > crawler.start() > log.start() > reactor.run() > > Any help is appriatiated:) > > Thanks, > Hang > > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
