I 'd guess scrapy wouldn't complain if you used a generator as start_urls.
If it does, file an issue at github.
You are thinking of a problem called "enumeration of regular languages",
look it up. It differs from deciding whether a sentence belongs in a
language. (s/language/regex/g if unclear)
I take interest in such problems but if you don't and just want to solve
this specific scenario try the following snippet:
start_urls = imap('http://www.example.com/page/{0:02}'.format, xrange(12,21
))
On Tuesday, 29 April 2014 09:42:57 UTC+3, wilby yang wrote:
>
> I am now using scrapy's CrawlSpider, which requires you to specify a list
> of start_urls?
> I am wondering is it possible to specify a range of start_urlsusing
> regular expression like 'http://www.example.com/page/[12..20]'
>
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
