*Quick Intro* My name is Edwin Marshall and currently only write code in my free time GSOC seems like a good way to both improve an open source project and add applicable experience to my resume so that I can start coding professionally. I don't have any experience with scrapy, but have done some web scraping in the past. As such, I indent on taking the next few days in between work and school to familiarize myself with the API before application submissions are open on the 10th.
*The Real Question* I saw that scrapy was interested in porting to python 3 (which I have experience doing on multiple projects), but that might also require porting of some twisted code. I was wondering if you guys (and gals) have considered porting to something pyuv based, such as evergreen? It would be interesting to see what performance improvements (if any) could be gained by using lightweight threads. An alternative might be gruvi or raw pyuv. I was originally thinking about gevent, but last I checked it neither worked on python3 nor reliably worked on windows. If the landscape has changed, that could also be an option. Sorry if any of this sounds presumptuous. I'm horrible at introductions and in a bit of a rush (have to go to my unfulfilling day job shortly) [1] Evergreen: https://pypi.python.org/pypi/evergreen [2] Gruvi: https://pypi.python.org/pypi/gruvi/0.9.2 [3] pyuv: https://pypi.python.org/pypi/pyuv -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
