最近在用scarpy爬蟲,但是一直報錯如下:
#####################
C:\Users\Administrator\AppData\Local\Programs\Python\Python37-32\python.exe E:/spiders_test/day7/Maoyan/begin.py
我是open_spider函數
2020-07-22 10:33:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://maoyan.com/board/4?offset=0> (referer: None)
Traceback (most recent call last):
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python37-32\lib\site-packages\twisted\internet\defer.py", line 654, in _runCallbacks
current.result = callback(current.result, *args, **kw)
File "C:\Users\Administrator\AppData\Local\Programs\Python\Python37-32\lib\site-packages\scrapy\spiders\__init__.py", line 84, in parse
raise NotImplementedError('{}.parse callback is not defined'.format(self.__class__.__name__))
NotImplementedError: MaoyanSpider.parse callback is not defined
我是close_spider函數
#####################
仔細的檢查也沒有發現語法錯誤,但就是報這個錯,一直無法運行抓取數據,后來看了一下函數名,寫成了parese(),而應該寫成parse()這樣的形式,並且查詢資料也發現,函數名必須是parse或者以parse開頭的名字才可以: