Did you add it to ITEM_PIPELINES dict first? http://doc.scrapy.org/en/latest/topics/item-pipeline.html#activating-an-item-pipeline-component
Четвер, 17 квітня 2014 р. 07:35:44 UTC+3 користувач masroor javed написав: > > Hi Suyatoslav, i tried to put codes from given pipeline but data could not > inserted. > Well i m also confused that is there any other command to insert the data. > firstly i use to this command to run the spider " spider crawl spidername" > may i know this command is also work for pipeline code or not? because i > used this command but data couldn't inserted and there is no error. > so please let me know what should i do? > > > On Thu, Apr 17, 2014 at 3:16 AM, Svyatoslav Sydorenko < > [email protected] <javascript:>> wrote: > >> Try using this pipeline.. >> http://snipplr.com/view/66986/mysql-pipeline/ >> >> Середа, 16 квітня 2014 р. 13:35:34 UTC+3 користувач masroor javed написав: >> >>> Hi All I tried to insert data into mysql database but data could not be >>> insert and there is no error during run the crawl. >>> My pipeline code is below and pls suggest me how to insert. >>> Is there any command for scrapy crawl to insert into mysql data same as >>> excel like "scrapy crawl -o datafile.csv -t csv" or simply run the spider >>> like " scrapy crawl spidername"? >>> Please help me guys i am new in scrapy. >>> >>> import sys >>> import MySQLdb >>> import hashlib >>> from scrapy.exceptions import DropItem >>> from scrapy.http import Request >>> >>> class PagitestPipeline(object): >>> def __init__(self): >>> self.conn = MySQLdb.connect("localhost","root"," >>> ","test",charset="utf8", use_unicode=True ) >>> self.cursor = self.conn.cursor() >>> >>> def process_item(self, item, spider): >>> try: >>> self.cursor.execute("INSERT INTO infosec (titlename, standname) >>> VALUES ('%s', '%s')", >>> (item['titlename'].encode('utf-8'), >>> item['standname'].encode('utf-8'))) >>> >>> self.conn.commit() >>> >>> >>> except MySQLdb.Error, e: >>> print "Error %d: %s" % (e.args[0], e.args[1]) >>> >>> >>> return item >>> >> -- >> You received this message because you are subscribed to the Google Groups >> "scrapy-users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> To post to this group, send email to [email protected]<javascript:> >> . >> Visit this group at http://groups.google.com/group/scrapy-users. >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
