Hi, I'm new to Scrapy and i'm trying to crawl homes listings from a website and store them in a mysql db using a pipeline class. The problem is that all homes don't have values for all the fields declared in my Scrapy item class. And when my mysql pipeline runs insert or update queries, those partially defined homes fail to load because of the missing fields.
Does anyone have already encountered such problem ? How did you solve it ? Best regards, Damien -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
