Finally I have used this Rule :
rules = (
Rule(SgmlLinkExtractor( *restrict_xpaths*=('//th[@class="headline"]'
), tags=("a"),attrs=("href"),allow=(r''),
process_value=my_process_value),callback
='my_parser', follow=False),
)
def my_process_value(value):
print '---->'+value
return
I get the links I want, links within the restricted_xpath, it´s work. this
is the output:
---->#Day=2013-12-24&Id=*33*
But . . . I would like to do the same using allow and process_value. Do you
know how I can do it ?
El martes, 24 de diciembre de 2013 23:31:43 UTC+1, Roberto López escribió:
>
> Hi.
>
> I have to extract and follow links like this:
>
> <a href="#date=2013-12-24&Id=1269282">Tynwald Titan</a>
>
> The next rule doesn't work, no links found
>
> rules = ( Rule(SgmlLinkExtractor(allow=r''), callback='parse_item', follow
> =True), )
>
> Do you know how I can do it ?
>
> Best regards
>
>
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/groups/opt_out.
