用scrapy爬蟲時,一直報錯:NotImplementedError: MaoyanSpider.parse callback is not defined


最近在用scarpy爬蟲,但是一直報錯如下:

#####################

C:\Users\Administrator\AppData\Local\Programs\Python\Python37-32\python.exe E:/spiders_test/day7/Maoyan/begin.py
我是open_spider函數
2020-07-22 10:33:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://maoyan.com/board/4?offset=0> (referer: None)
Traceback (most recent call last):
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python37-32\lib\site-packages\twisted\internet\defer.py", line 654, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python37-32\lib\site-packages\scrapy\spiders\__init__.py", line 84, in parse
raise NotImplementedError('{}.parse callback is not defined'.format(self.__class__.__name__))
NotImplementedError: MaoyanSpider.parse callback is not defined
我是close_spider函數

#####################

仔細的檢查也沒有發現語法錯誤,但就是報這個錯,一直無法運行抓取數據,后來看了一下函數名,寫成了parese(),而應該寫成parse()這樣的形式,並且查詢資料也發現,函數名必須是parse或者以parse開頭的名字才可以:

 

 


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM