[scrapy] CannotListenError: Couldn’t listen on [Errno 98] Address already in use.
问题描述:
在调试spider的时候一直报如下错误:
ERROR: Error caught on signal handler: <bound method ?.start_listening of <scrapy.telnet.TelnetConsole instance at 0x96bba0c>>
CannotListenError: Couldn’t listen on 127.0.0.1:6073: [Errno 98] Address already in use.
但是能够正常爬取数据,百度相关问题,出来的都是些不相关的网页,最后通过Google在 stackoverflow上找到解决办法。
![[scrapy] CannotListenError: Couldn't listen on [Errno 98] Address already in use. [scrapy] CannotListenError: Couldn't listen on [Errno 98] Address already in use.](/image/aHR0cDovL2Nkbi5qaW5iaXRvdS5uZXQvd3AtY29udGVudC91cGxvYWRzLzIwMTYvMDgvZjE0MWNmMWI4OTllNmI0NDU2ZjMxODA4MTFkOGY0YzJfY2xpcGJvYXJkLnBuZw==.png)
原因分析:
不能使用telnet console同时运行两个scrapy进程(scrapy shell)
解决办法:
关掉一个scrapy shell,或者在settings.py中添加如下代码禁用telnet console
EXTENSIONS = { 'scrapy.telnet.TelnetConsole': None }
来源:http://jinbitou.net/2016/08/18/1992.html

