Hello Paul,
Thanks for providing solution for changing xml elements.
This seems working for me. Now searching to add option to split output xml
files based on number of records.
Also, current output is single line file (all xml tags are in same line),
could you suggest if there is some way to format xml and add line break
after each xml tags ?
Thanks,
On Monday, May 26, 2014 5:53:29 PM UTC+5:30, Paul Tremberth wrote:
>
> Hi,
>
> regarding question 1.,
> you can create your own XML feed exporter class,
> subclassing the default XmlItemExporter class
> calling XmlItemExporter's __init__ method with 2 arguments root_element
> and item_element, to override the default "items" and "item" node names,
> and overriding the method writing node values and multi-valued nodes
>
> from scrapy.contrib.exporter import XmlItemExporter
>
>
> class CustomXmlItemExporter(XmlItemExporter):
>
> def __init__(self, file, **kwargs):
> super(CustomXmlItemExporter, self).__init__(file,
> root_element="ads",
> item_element="ad",
> **kwargs)
>
> def _export_xml_field(self, name, serialized_value):
> self.xg.startElement(name, {})
> if hasattr(serialized_value, 'items'):
> for subname, value in serialized_value.items():
> self._export_xml_field(subname, value)
> elif hasattr(serialized_value, '__iter__'):
> for value in serialized_value:
> self._export_xml_field('customnodename', value)
> else:
> self._xg_characters(serialized_value)
> self.xg.endElement(name)
>
> Finally, you should tell scrapy to use this custom exporter via
> settings.py, something like this:
>
> FEED_EXPORTERS = {
> 'xml': 'myproject.exporter.CustomXmlItemExporter',}
>
>
> Hope this helps.
>
> Paul.
>
> On Monday, May 26, 2014 10:08:03 AM UTC+2, [email protected] wrote:
>>
>> Hello!
>>
>> Could someone get time to look into this and providing some solution?
>>
>> Thanks,
>>
>> On Wednesday, May 21, 2014 4:15:26 PM UTC+5:30, [email protected] wrote:
>>>
>>> Hi,
>>>
>>> I am beginners with scrapy and also with the python. So far I could
>>> manage to create some basic spiders based on given examples in scrapy doc.
>>>
>>> Now I would like to extend the default features according to custom
>>> requirement. Atm I am trying to change the default tag names in output xml.
>>> For example,
>>>
>>> 1) By default it generates xml with item_element='item' and
>>> root_element='items', instead I want to change it to item_element='ad' and
>>> root_element='ads'. Also multi-value fields are exported by each value
>>> inside the <value> element which i want to change with another name.
>>>
>>> 2) I want to split the data into multiple xmls based on the number of
>>> records per xml. For example, 5000 <ad> per xml.
>>>
>>> I have tried to look into
>>> http://doc.scrapy.org/en/0.22/topics/exporters.html#xmlitemexporter but
>>> I could not get clear idea. Could someone provide me exact filename and
>>> code which can be used to implement this change?
>>>
>>> Any help / suggestions would be appreciated.
>>>
>>> Thanks,
>>>
>>>
>>>
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
