Hi,
i would like for each page (in pagination) crawled, to retrieve/get the
value of page.
so if we are on page 1, i want to retrieve "1", if i'm on page 2, i want to
get "2"
here is a simple example of my code:
def parse_start_url(self, response):
return {"page number" : response.url.xxx}
where xxx should return the value of url argument/parameter.
However i do not know how to do that in scrapy :(
my url should look like that:
http://myweb.com/list?p=1
http://myweb.com/list?p=2
http://myweb.com/list?p=3
maybe there could be more parameters, so i can not search for string "p="
as i do not know how many digit the page number will be.
how can i do that ? Is there a way to get the parameter value ?
i search and i found something about getattr(response.url,
the_missing_param) but i was not able to find more help or documentation
about it.
thx a lot
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
