i overwrite mem schedule queue,and and update queue size,the problem had resolved.
在 2015年5月7日星期四 UTC+8下午5:40:42，crawler写道： > > > <https://lh3.googleusercontent.com/-2sEeF2u-I7E/VUsyAyR_5qI/AAAAAAAAABs/1XWvORuXK2c/s1600/1.png> > > hi，I have run six scrapy spider in my centos,wow, > > this spider use so many memory, i want to release that memory, > > i want to know how to release memory in scrapy, > > who can help me,i am very appreciate. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
