Hey, So I've been working on a scrapy project for the passed month that scraped specific offers from webpages belonging to various retailers. The more I code the more I realize a refactor is due soon. I notice my pipelines are very similar for each retailer with slight differences. My goal is to generalize my pipelines to make them usable by all of my spiders (10 so far).
Anyways, that was just a little background of where I'm at. My main hope for this topic was to get some other scrapy users to share a link to their open source projects! My experience with scrapy so far is for a company I work for so unfortunately I can't share the github link. If there is already a topic open where people share their scrapy projects please link me to it as I didn't see it while browsing this group! Thanks! -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
