今天把本地運行OK的scrapy爬蟲程序搗鼓到服務器上運行,結果報了以下錯誤
2018-10-11 19:00:19 [twisted] CRITICAL: Unhandled error in Deferred:
2018-10-11 19:00:19 [twisted] CRITICAL:
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/twisted/internet/defer.py", line 1418, in _inlineCallbacks
result = g.send(result)
File "/usr/local/lib/python3.7/site-packages/scrapy/crawler.py", line 82, in crawl
yield self.engine.open_spider(self.spider, start_requests)
ModuleNotFoundError: No module named '_sqlite3'
網上搜說sqlite3模塊沒有,需要安裝並重新編譯,然而網上各種方式都無效,好坑,最后在stackoverflow上找到個有效的方式
第一步安裝 sqlite-devel
第二步 cd到python3源碼目錄 運行./configure --enable-loadable-sqlite-extensions && make && sudo make install
附有效方式的地址 https://stackoverflow.com/questions/1210664/no-module-named-sqlite3
